Summary of the invention
The object of the present invention is to provide a kind of assisting hearing method and system based on mobile device, can on mobile device, realize the function of hearing aids, improve user's hearing level.
For addressing the above problem, the invention provides a kind of assisting hearing method based on mobile device, comprising:
Export the test tone of a plurality of frequencies, the threshold of audibility with test subscriber under described a plurality of frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to described user;
According to described audiogram, judge described user's hearing loss type, according to described hearing loss type selecting, match accordingly prescriptive formula;
According to described apolegamy prescriptive formula and audiogram, determine that testing of described user join parameter;
Gather voice signal, and according to testing of described user, join parameter and described voice signal is done after the processing of raising speech discrimination score, play.
Further, in said method, export the test tone of a plurality of frequencies, the threshold of audibility of test subscriber under described a plurality of frequencies, and the step that the threshold of audibility under described a plurality of frequencies generates audiogram according to described user comprises:
Export successively the test tone of a plurality of frequencies, and the threshold of audibility of test subscriber under described a plurality of frequencies successively;
If the threshold of audibility difference of user under first frequency and last frequency is less than or equal to 5dBHL, judge the threshold of audibility of two frequency multiplication frequencies differs whether be more than or equal to 20dBHL; If not, according to described user, the threshold of audibility under described a plurality of frequencies generates audiogram; If so, test the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the threshold of audibility of described half frequency multiplication frequency and described user;
If the threshold of audibility difference of user under first frequency and last frequency is greater than 5dBHL, the threshold of audibility of test subscriber under described a plurality of frequencies successively again, until differing, the threshold of audibility under first frequency and last frequency is less than or equal to 5dBHL, and the threshold of audibility that judges two frequency multiplication frequencies differs whether be more than or equal to 20dBHL, if not, according to the user of last test, the threshold of audibility under described a plurality of frequencies generates audiogram; If so, test the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the user of the threshold of audibility of half frequency multiplication frequency and last test.
Further, in said method, in described a plurality of frequencies, first frequency is identical with last frequency.
Further, in said method, described a plurality of frequencies comprise: 1000Hz, 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz, 1000Hz.
Further, in said method, the step of the threshold of audibility of test subscriber under each frequency comprises:
Step 1: obtain the hearing level initial value of user under current frequency, and start to export test tone, the initial hearing level of described test tone subtracts 10dBHL for the hearing level initial value of user under current frequency, if user does not hear test tone, with mono-grade of 5dBHL, gain in strength, until user hears test tone;
Step 2: user hears after test tone, reduces intensity with mono-grade of 10dBHL, until user does not hear test tone, then gains in strength with mono-grade of 5dBHL, until user hears test tone, records the current hearing level of this test tone;
After repeated execution of steps two or three times is above, whether the judgement wherein current hearing level of three records is same hearing level, if not, continue execution step more than two or three times, until three current hearing levels of record are same hearing level again, recording described same hearing level is the threshold of audibility under described current frequency.
Further, in said method, described hearing loss type comprises conduction deafness, perceptive deafness and mixed deafness.
Further, in said method, when described hearing loss type is perceptive deafness, selecting corresponding apolegamy prescriptive formula is POGO or NAL-RP.
Further, in said method, when described hearing loss type is conduction deafness or mixed deafness, selecting corresponding apolegamy prescriptive formula is DSL[i/o] or IHAFF.
Further, in said method, according to described apolegamy prescriptive formula and audiogram, determine that testing of described user join the step of parameter and comprise:
Each frequency partition is entered to corresponding passage;
Obtain default pain territory and flex point;
According to described apolegamy prescriptive formula and audiogram, determine the input-output curve of each passage;
According to described input-output curve, pain territory and flex point, determine the linear amplifier section of each input-output curve and the insertion gain of non-linear amplifier section.
Further, in said method, gather voice signal, and according to testing of described user, join parameter and described voice signal is made to improve the step of playing after the processing of speech discrimination score comprise:
Gather voice signal, and described voice signal is carried out to low-pass filtering;
Voice signal after low-pass filtering is carried out to analog-to-digital conversion, with generating digital signal;
According to the insertion gain of the linear amplifier section of each input-output curve and non-linear amplifier section, described digital signal is done to the processing of multichannel compensating for frequency response;
The digital signal of the processing through multichannel compensating for frequency response is carried out to digital-to-analogue conversion, to generate voice and to play.
Further, in said method, gather voice signal, and according to testing of described user, join parameter and described voice signal is made to improve the step of playing after the processing of speech discrimination score comprise:
Gather voice signal, and described voice signal is carried out to low-pass filtering;
Voice signal after low-pass filtering is carried out to analog-to-digital conversion, with generating digital signal;
Described digital signal is done to the processing that voice strengthen;
According to the insertion gain of the linear amplifier section of each input-output curve and non-linear amplifier section, to strengthen the digital signal of processing through voice, do the processing of multichannel compensating for frequency response;
The digital signal of the processing through multichannel compensating for frequency response is carried out to digital-to-analogue conversion, to generate voice and to play.
Further, in said method, when mobile device is single Mike, the method for the processing that described voice strengthen is to utilize the comb filter method of the quasi periodicity denoising of voice, the Kalman filtering method based on model class, the spectrum-subtraction based on spectral amplitude estimation class or any in Wiener Filter Method.
Further, in said method, when mobile device is microphone array, the method for the processing that described voice strengthen is any in the undistorted response Beam-former of minimum variance, linear restriction minimum method Beam-former or the generalized side lobe canceller in adaptive beam formation method.
Further, in said method, the processing method of described multichannel compensating for frequency response be following any:
Adopt interpolation half-band filter, realize the equally distributed bank of filters of equiband; Or
Application comb filter coordinates a plurality of harmonic oscillators to digital signal frequency split, and each railway digital signal weighting after frequency division is added to output; Or
Application loudness compensation formula and frequency domain sampling FIR filter design method, according to frequency domain gain design time domain filtering, the digital signal filter to input.
Further, in said method, described test tone is pure tone, one or more in sound or pulse sound of twitering.
According to another side of the present invention, a kind of assisting hearing system based on mobile device is provided, comprising:
Audiometry module, for exporting the test tone of a plurality of frequencies, the threshold of audibility with test subscriber under described a plurality of frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to described user;
Test and join module, for judge described user's hearing loss type according to described audiogram, according to described hearing loss type selecting, match accordingly prescriptive formula, according to described apolegamy prescriptive formula and audiogram, determine that testing of described user join parameter;
Assisting hearing module, for gathering voice signal, and joins parameter according to testing of described user and described voice signal is done after the processing of raising speech discrimination score, play.
Further, in said system, described audiometry module comprises:
Output unit, for exporting successively the test tone of a plurality of frequencies;
Audiogram unit, for the threshold of audibility of test subscriber under described a plurality of frequencies successively; If the threshold of audibility difference of user under first frequency and last frequency is less than or equal to 5dBHL, judge the threshold of audibility of two frequency multiplication frequencies differs whether be more than or equal to 20dBHL; If not, according to described user, the threshold of audibility under described a plurality of frequencies generates audiogram; If so, test the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the threshold of audibility of described half frequency multiplication frequency and described user; If the threshold of audibility difference of user under first frequency and last frequency is greater than 5dBHL, the threshold of audibility of test subscriber under described a plurality of frequencies successively again, until differing, the threshold of audibility under first frequency and last frequency is less than or equal to 5dBHL, and the threshold of audibility that judges two frequency multiplication frequencies differs whether be more than or equal to 20dBHL, if not, according to the user of last test, the threshold of audibility under described a plurality of frequencies generates audiogram; If so, test the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the user of the threshold of audibility of half frequency multiplication frequency and last test.
Further, in said system, it is identical with last frequency that described output unit is exported in a plurality of frequencies first frequency.
Further, in said system, described output unit is exported a plurality of frequencies and is comprised: 1000Hz, 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz, 1000Hz.
Further, in said system, audiogram unit, for obtaining the hearing level initial value of user under current frequency, and starting to export test tone, the initial hearing level of described test tone subtracts 10dBHL for the hearing level initial value of user under current frequency, if user does not hear test tone, with mono-grade of 5dBHL, gain in strength, until user hears test tone; Carry out three above threshold of audibility tests: user hears after test tone, with mono-grade of 10dBHL, reduces intensity, until user does not hear test tone, then gains in strength with mono-grade of 5dBHL, until user hears test tone, records the current hearing level of this test tone; Whether the judgement wherein current hearing level of three records is same hearing level, if not, continue to carry out three above threshold of audibility tests, until three current hearing levels of record are same hearing level again, recording described same hearing level is the threshold of audibility under described current frequency.
Further, in said system, described in test and join the hearing loss type that module judges and comprise conduction deafness, perceptive deafness and mixed deafness.
Further, in said system, when described hearing loss type is perceptive deafness, described testing joined module to select corresponding apolegamy prescriptive formula is POGO or NAL-RP, when described hearing loss type is conduction deafness or mixed deafness, described in test join module to select corresponding apolegamy prescriptive formula be DSL[i/o] or IHAFF.
Further, in said system, described in test and join module, for each frequency partition is entered to corresponding passage; Obtain default pain territory and flex point; According to described apolegamy prescriptive formula and audiogram, determine the input-output curve of each passage; According to described input-output curve, pain territory and flex point, determine the linear amplifier section of each input-output curve and the insertion gain of non-linear amplifier section.
Further, in said system, described assisting hearing module comprises:
Low-pass filter unit, for gathering voice signal, and carries out low-pass filtering to described voice signal;
AD conversion unit, for carrying out analog-to-digital conversion by the voice signal after low-pass filtering, with generating digital signal;
Compensating for frequency response unit, for doing the processing of multichannel compensating for frequency response according to the insertion gain of the linear amplifier section of each input-output curve and non-linear amplifier section to described digital signal;
D/A conversion unit, for the digital signal of the processing through multichannel compensating for frequency response is carried out to digital-to-analogue conversion, to generate voice and to play.
Further, in said system, described assisting hearing module also comprises voice enhancement unit, the processing strengthening for described digital signal being made to voice.
Further, in said system, when mobile device is single Mike, the processing method that described voice enhancement unit adopts is to utilize the comb filter method of the quasi periodicity denoising of voice, the Kalman filtering method based on model class, the spectrum-subtraction based on spectral amplitude estimation class or any in Wiener Filter Method.
Further, in said system, when mobile device is microphone array, the processing method that described voice enhancement unit adopts is any in the undistorted response Beam-former of minimum variance, linear restriction minimum method Beam-former or the generalized side lobe canceller in adaptive beam formation method.
Further, in said system, the processing method of the multichannel compensating for frequency response that described compensating for frequency response unit adopts be following any:
Adopt interpolation half-band filter, realize the equally distributed bank of filters of equiband; Or
Application comb filter coordinates a plurality of harmonic oscillators to digital signal frequency split, and each railway digital signal weighting after frequency division is added to output; Or
Application loudness compensation formula and frequency domain sampling FIR filter design method, according to frequency domain gain design time domain filtering, the digital signal filter to input.
Further, in said system, it is pure tone that described audiometry module is exported described test tone, one or more in sound or pulse sound of twitering.Compared with prior art, the present invention is by the test tone of output different frequency, test and the threshold of audibility of recording user under different frequency, and the threshold of audibility under different frequency generates audiogram according to user, according to described audiogram judgement user's hearing loss type, according to described hearing loss type selecting, match accordingly prescriptive formula, according to described apolegamy prescriptive formula and audiogram, determine that testing of user join parameter, and gather voice signal, according to testing of user, joining parameter again does described voice signal to play after the processing of raising speech discrimination score, can utilize mobile device test subscriber's hearing loss situation, and the audiogram of automatic recording user, according to different user audiogram, automatically test and join, carry out targetedly hearing compensation, thereby by the audiometry function of audiometer, it is integrated that the testing of hearing aid fitting software joined the function of function and hearing aids.
In addition, the assisting hearing method based on mobile device or system, when being user-friendly to, can not expose user's self physiological defect.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation.
Embodiment mono-
The invention provides a kind of for example, assisting hearing method based on mobile device (mobile phone), China cellphone subscriber has reached 1,000,000,000 families at present, and the price of mobile phone is still declining year by year, the price of mobile phone is well below hearing aids, assisting hearing method based on mobile device can be shared hardware resource with mobile phone, saves the development cost of hardware resource.Therefore, based on a kind of assisting hearing methods based on mobile device of mobile device design such as mobile phones, there is stronger practicality.
The assisting hearing method based on mobile device of the present embodiment comprises that step S1 is to step S4, the assisting hearing method based on mobile device of the present embodiment describing in detail below in conjunction with Fig. 1 to Fig. 6.
Step S1, exports the test tone of a plurality of frequencies, the threshold of audibility with test subscriber under a plurality of frequencies, and the threshold of audibility under a plurality of frequencies generates audiogram according to described user.The effect of this step is test subscriber's hearing loss situation, and the hearing test result of automatic recording user, can be by the human-computer interaction interface on mobile device and hearing test program, allow user in quiet environment, worn after earphone, clicked and start test, can first to mobile device, carry out volume calibration, then start test subscriber's hearing, and the audiogram of automatic recording user.
Wherein, described test tone can in pure tone, twiter sound or pulse sound one or more.Concrete, according to tester's age and test case select pure tone, twiter sound or pulse sound, in general, old man uses the more of sound of twitering, the sound of twitering more can cause tested people's attention; And young man is reflected soon, use the in the majority of pure tone test, pulse sound is the pure tone being interrupted, pulse sound and pure tone can be used alternatingly.Can on mobile device, utilize electroacoustics principle, by circuits such as electronic, amplification, decay, produce the test tone of different frequency and intensity, also can in mobile device, store test signal, use player software to play and audiometry, by parameter, arrange, send the test tone of different frequency and intensity, and by the audio output device output test tone on mobile device.At official testing and recording user before the threshold of audibility under different frequency, can first adopt subjective calibration check to carry out volume calibration, before carrying out volume calibration, first determine on mobile device and plug in the earphone, then quietly under environment, testing, first ask a normal young man of hearing to test, normal young man has been with after earphone, the volume of mobile device is transferred to maximum, mobile device sends a test tone, if user can hear a faint test tone, next, first slowly by turning down sound volume, until test tone disappears, then, heighten bit by bit again volume, to the normal young man of hearing, think that test tone starts again to occur stopping again, now volume is defined as 0dBHL.Next, volume adjustment knob maintains static, and person hard of hearing has been worn earphone, can start official testing and the recording user threshold of audibility under different frequency.
In one embodiment of this invention, step S1 specifically can comprise step S10~S19, below in conjunction with Fig. 2, introduces in detail above-mentioned steps S10~S19.
Step S10, exports the test tone under 1000Hz, 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz, 1000Hz successively.
Step S11, successively test and the threshold of audibility of recording user under 1000Hz, 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz, 1000Hz frequency.
Step S12, judges whether the threshold of audibility difference under first 1000Hz frequency and last 1000Hz frequency is less than or equal to 5dBHL, if so, forwards step S13 to, if not, forwards step S16 to.
Step S13, judges the threshold of audibility of two frequency multiplication frequencies differs whether be more than or equal to 20dBHL; If not, forward step S14 to, if so, forward step S15 to;
Step S14, the threshold of audibility according to described user under described a plurality of frequencies generates audiogram;
Step S15, tests the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the threshold of audibility of described half frequency multiplication frequency and described user;
Step S16, the threshold of audibility of test subscriber under described a plurality of frequencies successively, is less than or equal to 5dBHL until the threshold of audibility under first frequency and last frequency differs, and forwards step S17 to again;
Step S17, judges the threshold of audibility of two frequency multiplication frequencies differs whether be more than or equal to 20dBHL, if not, forwards step S18 to; If so, forward step S19 to.
Step S18, the threshold of audibility according to the user of last test under described a plurality of frequencies generates audiogram;
Step S19, tests the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the user of the threshold of audibility of half frequency multiplication frequency and last test.
Generally first survey compared with Jia Er or strong ear (the good ear of hearing), then survey the poor ear of another hearing, attention is when starting to test, preferably first give a larger sound (20dB left and right in threshold value), allow patient can hear very clearly this sound, thereby allow patient understand this to which type of sound is reacted, avoid patient that other back drop (as tinnitus sound) is obscured mutually with test tone, make inaccurate reaction.Also can suitably adjust the kind of test tone, as change the sound etc. of twitering into, come with the tinnitus range of sound other.In this step S11, give sustainable 1~2 second of sound time, must not be shorter than interval time to the sound time, this is because needs are generally 1~2 second complete recovery time after adapting to, and in addition, gives sound time and the interval time should be irregular.Whole testing time max 20 mins, otherwise can make experimenter tired and be difficult to obtain reliable result.
In step S11, test and recording user are at each frequency (1000Hz, 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz or 1000Hz) under the step of the threshold of audibility can adopt any in rise method and lifting and lowering method, more employing rise method clinically, as shown in Figure 3, in one embodiment of the invention, adopt rise method to test with recording user at each frequency (1000Hz, 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz or 1000Hz) under the step of the threshold of audibility specifically can comprise step S111~step S114:
Step S111, obtain the hearing level initial value of user under current frequency, and start to export test tone, the initial hearing level of described test tone subtracts 10dBHL for the hearing level initial value of user under current frequency, if user does not hear test tone, with mono-grade of 5dBHL, gain in strength, until user hears test tone.Concrete, the unit of hearing level is dBHL(HL:hearing level), hearing level is the hearing loss absolute value measuring, the mankind's the sense of hearing is limited, temperature when water freezing is decided to be in the of 0 degree Celsius, the sound of several different frequencies that audiologist just can hear normal young man stipulates that the sound normal person of aural null size can hear reluctantly into aural null (0dBHL) artificially.
In one embodiment of this invention, in step S111, when current frequency is first 1000Hz frequency, obtain the threshold of audibility of user under the familiar test of 1000Hz, 40dBHL as first 1000Hz frequency hearing level initial value, concrete, before test and recording the threshold of audibility under first 1000Hz frequency, can first be familiar with test: with the test tone of 1000Hz, 40dBHL intensity to tested ear, if hear reluctantly, mono-grade of every 20dBHL reduces intensity until user (patient) can not hear reluctantly; And then mono-grade of 10dB increases progressively, until user patient can hear again reluctantly, record the current threshold of audibility, repeatedly above-mentioned reduction and increase progressively be familiar with test 3 times, if the same hearing level that wherein the current hearing level of 2 above records is, the hearing level initial value under first 1000Hz frequency using this hearing level, can start test and record the threshold of audibility under first 1000Hz frequency; In current frequency for except first 1000Hz during frequency, be followed successively by 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz or second 1000Hz of 1000Hz() time, obtain the threshold of audibility of user under a upper frequency as hearing level initial value, for example, during 2000Hz, the threshold of audibility of usining under first 1000Hz is as hearing level initial value; During 3000Hz, the threshold of audibility of usining under 2000Hz is as hearing level initial value, and the rest may be inferred, do not repeat them here.
Step S112, user hears after test tone, with mono-grade of 10dBHL, reduces intensity, until user does not hear test tone, then gains in strength with mono-grade of 5dBHL, until user hears test tone, records the current hearing level of this test tone.Concrete, as experimenter's hearing extreme difference, should test to maximum output sound intensity place.After repeating step S112 five times, forward step S113 to.
Step S113, whether the judgement wherein current hearing level of three records is same hearing level, if so, forwards step S114 to, otherwise, forward step S112 to.
Step S114, recording this same hearing level is the threshold of audibility under current frequency.
Further, can calculate the loss of speech frequency averaging according to audiogram, and to user, show test results on the screen of mobile terminal.Specifically, on pure-tone average PTA, 500Hz, 1000Hz, tri-Frequency points of 2000Hz account for 70% in the importance that determines the intelligibility of speech, are the critical range of weighing auditory function.For this reason, the World Health Organization adopts the mean value of 500Hz, 1000Hz, these three Frequency point hearing losses of 2000Hz, as the foundation of dividing Hearing grade.In addition, the World Health Organization promulgated the new criteria for classifying in 1997, and standard has than before increased the threshold of audibility of a 4000Hz, has taken into full account the situation of the HFHL of person hard of hearing, has certain clinical value, existing these new standards that adopt more.According to the average hearing loss of 500Hz, 1000Hz, 2000Hz and 4000Hz, deafness is divided into 4 grades, can be after audiometry finishes, on the screen of mobile device, to user, show test results, also can report test result to user speech, test result can be as shown in the table:
Test result |
The speech frequency averaging threshold of audibility (deafness) |
Normally |
Be less than 26dBHL |
Mild deafness |
26-40dBHL |
Moderate is deaf |
41-60dBHL |
Severe is deaf |
61-80dBHL |
Utmost point severe is deaf |
Be greater than 80dBHL |
For example, person hard of hearing is respectively 55dBHL, 50dBHL, 50dBHL, 70dBHL at the threshold of audibility of 500Hz, 1000Hz, 2000Hz, 4000Hz, and his average hearing loss is (55+50+50+70)/4=56.25, and corresponding test result is that moderate is deaf.
Step S2, judges described user's hearing loss type according to described audiogram, according to described hearing loss type selecting, match accordingly prescriptive formula.Concrete, apolegamy prescriptive formula is a kind of apolegamy debugging foundation of basis, determines to test join parameter according to apolegamy prescriptive formula, user also can do corresponding adjustment according to the impression after hearing aid and individual difference.
Preferably, described in step S2, hearing loss type can comprise conduction deafness, perceptive deafness and mixed deafness.Concrete, normal person's audiogram can show that KL is 0~20dBHL in each frequency range, and conductance hearing is at 0~25dBHL, and gas, bone conduction spacing are in 10dBHL.Conduction deafness shows as conductance dysacousis and KL is normal; bone conduction curve is normal or approach normal; air conduction curve hearing loss is between 30~60dBHL; general low frequency hearing loss is heavier; more than gas, bone conduction spacing are greater than 10dBHL; the audiogram feature of conduction deafness is: the hearing loss higher-frequency district of air conduction curve low frequency range is for very, and bone conduction threshold is normal or approach normal.The conductance threshold of audibility is not in any frequency in 60dBHL, and audiometric curve is smooth, without rising sharply rapid drawdown, perceptive deafness shows as conductance, BC threshold all improves, without Air-bone gap value, (be same as conductance and bone conduction output intensity and when audiometer is calibrated, admit of the error of 3~5dBHL, therefore the difference that moral character is led be greater than 10dBHL just think exist Air-bone gap value), the audiogram feature of perceptive deafness is: gas, bone conduction curve is corresponding decline all, low frequency range hearing is better, more tremendously high frequency district hearing loss is heavier, moral character lead curve is substantially coincide or is differed 5dBHL, the audiometric curve rapid drawdown that can rise sharply, can there be V high frequency region, U, W, slope, suddenly fall, some frequency threshold of audibility loss of conductance can be greater than 60dBHL, how 8kHz is above can not experience, gas, bone conduction curve is all the damaged or high frequency hearing of paddy shape and does not fall person suddenly and often show cochlear deafness, be common in noise, pinking, ototoxic deafness, mixed deafness shows as AC threshold and BC threshold all improves, but exist Air-bone gap value, the audiogram feature of mixed deafness is: not only bone conduction declines, air conduction hearing loss is more, audiometric curve can rise and fall suddenly, moral character spacing can be greater than 15dBHL in low frequency range, be common in tympanitis and have noise induced damage or ototoxicity, conduction deafness late period, the lost damage of limitation etc., performance low frequency be take conduction deafness as main, moral character has obvious spacing between leading, and high frequency gas, bone conduction all decline, the two difference is small or disappear.
Preferably, when described hearing loss type is perceptive deafness, selecting corresponding apolegamy prescriptive formula is POGO(prescription of gain and output, gain and output prescription) or NAL-RP(National Acoustic Laboratories revised profound), when described hearing loss type is conduction deafness or mixed deafness, selecting corresponding apolegamy prescriptive formula is DSL[i/o] (Desired sensation level [input/output]), IHAFF(Independent hearing aid fitting forum independence hearing aids selection forum).Wherein, DSL[i/o] be " I/O formula [i/o] " that Cornelisse Seewald Jamieson proposed March nineteen ninety-five.
The deterministic process of the insertion gain that the POGO formula of take is below introduced in detail as example.
POGO formula be nineteen eighty-three by the McCandless of Utah, USA university and the Lyregaard paper of Denmark Oticon company, this formula is only applicable to sensorineural deafness.
Insertion gain is defined as the hearing level at nearly eardrum place in external auditory meatus, and the insertion gain that POGO formula is required is as shown in the table:
Frequency (Hz) |
Insertion gain (dBHL) |
250 |
1/2HTL-10 |
500 |
1/2HTL-5 |
1000 |
1/2HTL |
2000 |
1/2HTL |
3000 |
1/2HTL |
4000 |
1/2HTL |
In upper table, HTL is Hearing Threshold Level, is the threshold of audibility.
The POGO formula second edition (POGP II) of releasing for 1987, for the hearing loss that is more than or equal to 65dBHL, has given more compensation.Revised insertion gain formula is:
IG=1/2HTL-C+1/2(HTL-65)
In formula, at 250Hz place, C=10dBHL;
At 500Hz place, C=10dBHL;
Other frequency places, C=0dBHL.
When input be the left and right ear audiogram of person hard of hearing of sensorineural deafness as shown in Figure 6 time, utilize result that POGO formula calculates required insertion gain as following table:
While adopting other formula, the deterministic process of insertion gain determines that with adopting POGO formula required insertion gain is similar, is not repeated herein.
Step S3, determines that according to described apolegamy prescriptive formula and audiogram testing of described user join parameter.Concrete, the hearing loss situation that user is different has determined that its electro mechanical parameter needing also may be different, therefore, and should be according to user's hearing loss situation, select different apolegamy prescriptive formula to obtain suitable testing and join parameter, to give user different compensating for frequency response.In addition, can also join on interface testing of mobile device arrange softly, loudly, supper bass etc. is for the option of the convenient selection of user, if in the input without hearing loss situation, output softly, loudly, the respective default of supper bass tests and joins parameter.
In one embodiment of this invention, step S3 comprises: each frequency partition is entered to corresponding passage; Obtain default pain territory and flex point; According to described apolegamy prescriptive formula and audiogram, determine the input-output curve of each passage; According to described input-output curve, pain territory and flex point, determine the linear amplifier section of each input-output curve and the insertion gain of non-linear amplifier section.Wherein, the threshold of pain is for hearing the sound pressure level that makes people's ear start to produce pain when sound, and flex point is the intersection point of linear amplifier section and non-linear amplifier section.
Step S4, gathers voice signal, and according to testing of described user, joins parameter and described voice signal is done after the processing of raising speech discrimination score, play.Concrete, the limited storage space of the algorithm in hearing aids in the market, therefore require algorithm to accomplish that as far as possible amount of calculation is little, memory space is little, therefore need to trade off in computing capability and the highest listening between effect, and the present embodiment can be shared the hardware resource that mobile device provides, due to the digital signal processing chip on mobile device, to have memory space large, the features such as processing speed is fast, therefore, optional with the large but effective algorithm of amount of calculation in this step, to improve the signal to noise ratio of voice signal, and then the obstacle person's that improves one's hearing speech discrimination score, give the auditory effect that person hard of hearing is comfortable, also can adjust flexibly and update algorithm in addition.And mobile device can provide enough large power consumption, the present embodiment can not be subject to the restriction of power consumption, opens a plurality of application programs simultaneously, and can use for a long time.In addition; the sound that on market, existing hearing aids loud speaker sends can leak conventionally to microphone; cause output signal that the feedback phenomenon of high-intensity vibration (uttering long and high-pitched sounds) occurs, and the position of the microphone of the present embodiment based on mobile device and loud speaker is far away, is difficult for occurring feedback phenomenon.
In one embodiment of this invention, as shown in Figure 4, step S4 specifically can comprise:
Step S411, gathers voice signal, and described voice signal is carried out to low-pass filtering, with voice signal more than filtering 8000Hz;
Step S412, carries out analog-to-digital conversion by the voice signal after low-pass filtering, with generating digital signal;
Step S413, does the processing of multichannel compensating for frequency response according to the insertion gain of the linear amplifier section of each input-output curve and non-linear amplifier section to described digital signal.Concrete, the function of multichannel compensating for frequency response is the amplitude that increases targetedly or reduce the input speech signal of certain frequency band, and voice signal is dropped in the earshot of person hard of hearing, assisting hearing obstacle person listens the voice signal of understanding that obtains, listens.Can on mobile device, design to test and join interface, user can test and join parameter and select hearing aid effect, insertion gain, flex point etc., in the hope of reaching the most comfortable effect of listening to;
Step S414, carries out digital-to-analogue conversion by the digital signal of the processing through multichannel compensating for frequency response, to generate voice and to play.
In another embodiment of the present invention, as shown in Figure 5, step S4 specifically can comprise:
Step S421, gathers voice signal, and described voice signal is carried out to low-pass filtering;
Step S422, carries out analog-to-digital conversion by the voice signal after low-pass filtering, with generating digital signal;
Step S423, does to described digital signal the processing that voice strengthen; Concrete, voice strengthen refer to when voice signal by various noise jamming, even flood after, from noise background, extract useful voice signal, suppress, the method for reduction noise jamming; The object that voice strengthen is to improve voice quality, promotes clearness and intelligibility, reduces auditory fatigue; The voice signal that the microphone of mobile device collects, inevitably can be disturbed by background noise, and therefore, voice enhancement algorithm needs; Voice enhancement algorithm can improve speech articulation and the intelligibility of input speech signal, allows user can hear better sound, and then the ability that exchanges with conference of raising, facilitates it to carry out the verbal communication in daily life; Preferably, when mobile device is single Mike, can utilize the statistical property of single channel noisy speech signal to remove noise, the method for the processing that described voice strengthen is to utilize the comb filter method of the quasi periodicity denoising of voice, the Kalman filtering method based on model class, the spectrum-subtraction based on spectral amplitude estimation class or any in Wiener Filter Method; In addition, when mobile device is microphone array, the method of the processing that described voice strengthen is adaptive beam formation method, conventional have the undistorted response Beam-former of minimum variance, linear restriction minimum method Beam-former and a generalized side lobe canceller, wherein widely used is generalized side lobe canceller (GSC) in adaptive beam formation method, and improving one's methods can more effective inhibition uncorrelated noise for multichannel Weiner filter being introduced to the non-self-adapting passage method of generalized side lobe canceller, blocking matrix is carried out to dimension-reduction treatment;
Step S424, does the processing of multichannel compensating for frequency response to strengthen the digital signal of processing through voice according to the insertion gain of the linear amplifier section of each input-output curve and non-linear amplifier section.In addition, the severe hearing loss patient who completely loses for high frequency hearing, also can on mobile device, apply shift frequency algorithm and frequency compression algorithm, whole speech manual is compressed to low frequency part or high frequency is transferred to merely to low frequency, to make full use of patient's low frequency residue hearing.Also can be on mobile device the functions such as environment recognition function, natural direction method, clean method for de-noising and intelligent optimization are provided;
Step S425, carries out digital-to-analogue conversion by the digital signal of the processing through multichannel compensating for frequency response, to generate voice and to play.For example can play by the loud speaker on mobile device.
Preferably, in step S413 or step S424, the processing method of described multichannel compensating for frequency response can for following any: adopt interpolation half-band filter, realize the equally distributed bank of filters of equiband; Or application comb filter coordinates a plurality of harmonic oscillators to digital signal frequency split, and each railway digital signal weighting after frequency division is added to output; Or application loudness compensation formula and frequency domain sampling FIR filter design method, according to frequency domain gain design time domain filtering, the digital signal filter to input.Wherein, adopt interpolation half-band filter, realize the equally distributed bank of filters of equiband, and application comb filter coordinates a plurality of harmonic oscillators to digital signal frequency split, and the amount of calculation of each railway digital signal weighting addition output intent after frequency division is less, application loudness compensation formula and frequency domain sampling FIR filter design method, according to frequency domain gain design time domain filtering, although the digital signal filter method amount of calculation to input is larger, but with respect to traditional time domain dividing method, the method has reduced voice distortion, for improving speech discrimination score, is highly profitable.
Person hard of hearing is at the mobile device of wearing the present embodiment after a period of time, person hard of hearing tentatively adapts to after hearing aids, without carrying out later stage return visit to special chinic, readjusts the parameter of hearing aids, person hard of hearing can own tuning parameter, to save time and travelling expenses.The assisting hearing method of the present embodiment based on mobile device has large power consumption, high performance-price ratio, feature simple to operate; can utilize the basic equipment on mobile device, as microphone, loudspeaker, earphone etc., be user-friendly to; can not expose its physiological defect, protection privacy of user.
Embodiment bis-
As shown in Figure 7, the present invention also provides the another kind of assisting hearing system based on mobile device, comprises audiometry module 1, tests and join module 2 and assisting hearing module 3.
Audiometry module 1, exports the test tone of a plurality of frequencies, the threshold of audibility with test subscriber under described a plurality of frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to described user.
Optionally, the described test tone of described audiometry module 1 output be pure tone, in twiter sound or pulse sound one or more.
In one embodiment of this invention, described audiometry module 1 comprises output unit 11, record cell 12 and audiogram unit 13.
Output unit 11, for exporting successively the test tone of a plurality of frequencies, as exported successively the test tone under 1000Hz, 2000Hz, 3000Hz, 4000Hz, 6000Hz, 8000Hz, 250Hz, 500Hz, 1000Hz.In a plurality of frequencies of described output unit 11 output, first frequency is identical with last frequency.
Audiogram unit 12, for the threshold of audibility of test subscriber under described a plurality of frequencies successively; If the threshold of audibility difference of user under first frequency and last frequency is less than or equal to 5dBHL, judge the threshold of audibility of two frequency multiplication frequencies differs whether be more than or equal to 20dBHL; If not, according to described user, the threshold of audibility under described a plurality of frequencies generates audiogram; If so, test the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the threshold of audibility of described half frequency multiplication frequency and described user; If the threshold of audibility difference of user under first frequency and last frequency is greater than 5dBHL, the threshold of audibility of test subscriber under described a plurality of frequencies successively again, until differing, the threshold of audibility under first frequency and last frequency is less than or equal to 5dBHL, and the threshold of audibility that judges two frequency multiplication frequencies differs whether be more than or equal to 20dBHL, if not, according to the user of last test, the threshold of audibility under described a plurality of frequencies generates audiogram; If so, test the threshold of audibility of half frequency multiplication frequency between described two frequency multiplication frequencies, and the threshold of audibility under described a plurality of frequencies generates audiogram according to the user of the threshold of audibility of half frequency multiplication frequency and last test.
Preferably, described audiogram unit 12, for obtaining the hearing level initial value of user under current frequency, and start to export test tone, the initial hearing level of described test tone subtracts 10dBHL for the hearing level initial value of user under current frequency, if user does not hear test tone, with mono-grade of 5dBHL, gain in strength, until user hears test tone; Carry out three above threshold of audibility tests: user hears after test tone, with mono-grade of 10dBHL, reduces intensity, until user does not hear test tone, then gains in strength with mono-grade of 5dBHL, until user hears test tone, records the current hearing level of this test tone; Whether the judgement wherein current hearing level of three records is same hearing level, if not, continue to carry out three above threshold of audibility tests, until three current hearing levels of record are same hearing level again, recording described same hearing level is the threshold of audibility under described current frequency.
Preferably, when current frequency is first 1000Hz frequency, described audiogram unit 12 obtains the threshold of audibility of user under the familiar test of 1000Hz, 40dBHL as hearing level initial value; In current frequency, for except first 1000Hz during frequency, described audiogram unit 12 obtains the threshold of audibility of user under a upper frequency as hearing level initial value.
Test and join module 2, for judge described user's hearing loss type according to described audiogram, according to described hearing loss type selecting, match accordingly prescriptive formula, according to described apolegamy prescriptive formula and audiogram, determine that testing of described user join parameter.
Preferably, described in, test and join the hearing loss type that module 2 judges and comprise conduction deafness, perceptive deafness and mixed deafness.When described hearing loss type is perceptive deafness, test and join module 2 to select corresponding apolegamy prescriptive formula be POGO or NAL-RP, when described hearing loss type is conduction deafness or mixed deafness, tests and join module 2 to select corresponding apolegamy prescriptive formula be DSL[i/o] or IHAFF.
In one embodiment of this invention, described in test and join module 2, for each frequency partition is entered to corresponding passage; Obtain default pain territory and flex point; According to described apolegamy prescriptive formula and audiogram, determine the input-output curve of each passage; According to described input-output curve, pain territory and flex point, determine the linear amplifier section of each input-output curve and the insertion gain of non-linear amplifier section.
Assisting hearing module 3, for gathering voice signal, and joins parameter according to testing of described user and described voice signal is done after the processing of raising speech discrimination score, play.
In one embodiment of this invention, described assisting hearing module 3 comprises low-pass filter unit 31, AD conversion unit 32, compensating for frequency response unit 33 and D/A conversion unit 34.
Low-pass filter unit 31, for gathering voice signal, and carries out low-pass filtering to described voice signal.
AD conversion unit 32, for carrying out analog-to-digital conversion by the voice signal after low-pass filtering, with generating digital signal.
Compensating for frequency response unit 33, for doing the processing of multichannel compensating for frequency response according to the insertion gain of the linear amplifier section of each input-output curve and non-linear amplifier section to described digital signal.
The processing method of the multichannel compensating for frequency response that in one embodiment of this invention, described compensating for frequency response unit adopts be following any:
Adopt interpolation half-band filter, realize the equally distributed bank of filters of equiband; Or application comb filter coordinates a plurality of harmonic oscillators to digital signal frequency split, and each railway digital signal weighting after frequency division is added to output; Or application loudness compensation formula and frequency domain sampling FIR filter design method, according to frequency domain gain design time domain filtering, the digital signal filter to input.
D/A conversion unit 34, for the processing digital signal of process multichannel compensating for frequency response is carried out to digital-to-analogue conversion, to generate voice and to play.
Preferably, described assisting hearing module 3 also comprises voice enhancement unit 35, the processing strengthening for described digital signal being made to voice.When mobile device is single Mike, the processing method that described voice enhancement unit 35 adopts is to utilize the comb filter method of the quasi periodicity denoising of voice, the Kalman filtering method based on model class, the spectrum-subtraction based on spectral amplitude estimation class or any in Wiener Filter Method.When mobile device is microphone array, the processing method that described voice enhancement unit 35 adopts is any in the undistorted response Beam-former of minimum variance, linear restriction minimum method Beam-former or the generalized side lobe canceller etc. in adaptive beam formation method.
Other detailed content of embodiment bis-specifically can, referring to each appropriate section of embodiment mono-, not repeat them here.
In sum, the present invention is by the test tone of output different frequency, test and the threshold of audibility of recording user under different frequency, and the threshold of audibility under different frequency generates audiogram according to user, according to described audiogram judgement user's hearing loss type, according to described hearing loss type selecting, match accordingly prescriptive formula, according to described apolegamy prescriptive formula and audiogram, determine that testing of user join parameter, and gather voice signal, according to testing of user, joining parameter again does described voice signal to play after the processing of raising speech discrimination score, can utilize mobile device test subscriber's hearing loss situation, and the audiogram of automatic recording user, according to different user audiogram, automatically test and join, carry out targetedly hearing compensation, thereby by the audiometry function of audiometer, it is integrated that the testing of hearing aid fitting software joined the function of function and hearing aids.In addition, the assisting hearing method based on mobile device or system, when being user-friendly to, can not expose user's self physiological defect.
In this specification, each embodiment adopts the mode of going forward one by one to describe, and each embodiment stresses is the difference with other embodiment, between each embodiment identical similar part mutually referring to.For the disclosed system of embodiment, owing to corresponding to the method disclosed in Example, so description is fairly simple, relevant part partly illustrates referring to method.
Professional can also further recognize, unit and the algorithm steps of each example of describing in conjunction with embodiment disclosed herein, can realize with electronic hardware, computer software or the combination of the two, for the interchangeability of hardware and software is clearly described, composition and the step of each example described according to function in the above description in general manner.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can specifically should be used for realizing described function with distinct methods to each, but this realization should not thought and exceeds scope of the present invention.
Obviously, those skilled in the art can carry out various changes and modification and not depart from the spirit and scope of the present invention invention.Like this, if within of the present invention these are revised and modification belongs to the scope of the claims in the present invention and equivalent technologies thereof, the present invention is also intended to comprise these change and modification.