CN105050014A - Hearing-aid device and method based on smart phone - Google Patents

Abstract

The invention discloses a hearing-aid device and method based on a smart phone. The device and method have the advantages that 1) a digital hearing-aid function is realized by the smart phone, use of an expensive special-purposed DSP chip of a digital hearing aid is avoided, the cost can be reduced, convenience is provided for use and carrying, and thus, corrective therapy can be carried out on more patients with hearing impairment; 2) a single-channel microphone of the smart phone is used to realize the digital hearing-aid function, it is not required to use a microphone array to collect signals, and the cost and circuit complexity are reduced; 3) sound signals collected by the microphone of the smart phone are divided into N channels, the hearing compensation parameter of the patients with hearing impairment is adjusted in each channel, so that the hearing compensation effect is better, and use is more comfortable; and 4) in each hearing compensation channel, hearting compensation is carried out by using sound pressure level segmented compression figure line, residual hearing of the patients can be protected, and the compensation effect can be ensured.

Description

A kind of auditory prosthesis based on smart mobile phone and implementation method

Technical field

The present invention relates to a kind of auditory prosthesis based on smart mobile phone and implementation method.

Background technology

Hearing loss can have a strong impact on the physical and mental health of dysaudia (barrier listened in abbreviation) patient, and wear hearing aid listens barrier patient to improve the most effective means of hearing at present.In China, barrier population, the Hearing aid technology of backwardness and the otherness of Chinese and English itself are listened by huge old-age group, all make the research of Chinese numbers Hearing aid technology be faced with formidable challenges.

Due to have independent intellectual property right, can the company of production figures hearing aid signal process special chip little, so the digital deaf-aid on market is expensive, simultaneously again because hearing aid fitting needs special hearing test instrument, so patient must go to have the hearing aids brand shop testing the ability of joining buy hearing aids.Fancy price and testing is joined threshold and is caused much listening barrier patient to can not get the treatment of needs, and the deficiencies in the prior art make digital deaf-aid popularity rate not high.

Application number be 201010528865.7 patent discloses a kind of sound compensating parameter computational methods and equipment, sound compensation system, by calculate user the Frequency point in compensating parameter is determined to the perceived loudness of tested speech under specified intensity.In this patent, will barrier be listened owing to the fundamental frequency of voice and the defect of formant frequency signal, the method for hearing aid compensates the critical band at fundamental frequency and formant place.But according to audiology document, patient is to pure tone perception and the difference to speech perception, and mainly due to time domain resolution and the frequency resolution reduction of patient, namely with frequency adjacent signal contiguous to the time can not be distinguished.In this case, corresponding to this frequency critical band signal strengthens can not improve time domain resolution and frequency resolution.Therefore the tone testing adopted in this patent can not play good effect.Secondly, the sound compensation equipment described in this patent, compensates according to the compensating parameter that hearing test result is corresponding sound import, and compensating parameter does not adjust with the sound pressure level size of sound import.And for listening barrier patient, due to reducing of its sense of hearing dynamic range, although its minimal sound pressure levels that can hear is raised, its patient maximum sound pressure level also reduces.If compensating parameter does not adjust with the sound pressure level size of sound import, then, when sound pressure level signal inputs, the signal after compensation exceedes the dynamic range of patient, and patient can feel fried ear and be difficult to stand.

Summary of the invention

For the problems referred to above, the invention provides a kind of auditory prosthesis based on smart mobile phone and implementation method, utilize smart mobile phone universal in the market, design realizes a kind of smart mobile phone digital hearing device and the implementation method with hearing compensation function, low and the hearing compensation better effects if of cost, uses more comfortable.

For realizing above-mentioned technical purpose, reach above-mentioned technique effect, the present invention is achieved through the following technical solutions:

A kind of auditory prosthesis based on smart mobile phone, comprise smart mobile phone body, described smart mobile phone body is built-in with microphone, loud speaker and memory, it is characterized in that, also comprises the hearing loss test module, parameter calculating module and the hearing compensation module that are connected with smart mobile phone body respectively;

Described hearing loss test module comprises sound and plays submodule, user feedback submodule and parameter sub module stored, wherein, user plays by sound the pure tone that submodule listens to the frequency of varying strength successively, and by user feedback submodule, hearing loss test module is fed back to the perception situation of the sound heard, hearing loss test module is according to the pure tone audiometry THR of the feedback of user by each for user frequency _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N) stored by parameter sub module stored, i=1,2 ..., N is frequency corresponding to each hearing test frequency;

Described parameter calculating module is according to the multi-frequency pure tone audiometry THR recorded _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N) and calculate the hearing compensation parameter of hearing compensation passage corresponding to each test frequency;

Described hearing compensation module compensates according to the sound of the hearing compensation parameter calculated to hearing compensation passage corresponding to each test frequency.

Based on a hearing aid implementation method for smart mobile phone, it is characterized in that, comprise the steps:

S01: successively hearing loss test is carried out to N number of sound frequency, be specially:

01A) sound plays the pure tone that submodule plays the frequency of varying strength successively, and user is listened to by earphone;

01B) user is to the perception situation of the sound heard, is fed back by user feedback submodule;

The pure tone audiometry THR of each frequency 01C) is obtained according to the feedback of user _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N), i=1,2 ..., N is frequency corresponding to each hearing test frequency;

S02: to each hearing test frequency i, parameter calculating module tests the pure tone audiometry THR of the user obtained according to this frequency _ni, comfortable threshold MCL _ni, threshold of pain UCL _niand normal adult is at the pure tone audiometry THR of this frequency _ui, comfortable threshold MCL _uiwith threshold of pain UCL _uicalculate the hearing compensation parameter of hearing compensation passage corresponding to this frequency, be specially:

To each hearing compensation passage, the pure tone audiometry THR obtained with user test _ni, comfortable threshold MCL _niwith threshold of pain UCL _nias flex point, point four sections of calculating hearing compensation parameter k _ij, i=1,2 ..., N; J=1,2,3,4:

$k_{i1}=\frac{{\mathrm{THR}}_{\mathrm{ui}}-0}{{\mathrm{THR}}_{\mathrm{ni}}-0}$ (formula 1)

$k_{i2}=\frac{{\mathrm{MCL}}_{\mathrm{ui}}-{\mathrm{THR}}_{\mathrm{ui}}}{{\mathrm{MCL}}_{\mathrm{ni}}-{\mathrm{THR}}_{\mathrm{ni}}}$ (formula 2)

$k_{i3}=\frac{{\mathrm{UCL}}_{\mathrm{ui}}-{\mathrm{MCL}}_{\mathrm{ui}}}{{\mathrm{UCL}}_{\mathrm{ni}}-{\mathrm{MCL}}_{\mathrm{ni}}}$ (formula 3)

K _i4=0 (formula 4);

S03: according to the hearing compensation parameter k calculated _ij, hearing compensation module compensates the sound that each tests hearing compensation passage corresponding to frequency, is specially:

03A) by digital audio and video signals s (m) that smart mobile phone microphone gathers, m=1,2 ..., M carries out framing;

03B) decomposition of N channel bank of filters is carried out to every frame signal s (m), obtain N number of channel decomposition signal s _i(m), i=1,2 ..., N, the analysis filter bank centre frequency of each passage is the test frequency in step S01;

03C) successively to each i, i=1,2 ..., N carries out following calculating:

C-01) the decomposed signal s of i passage is calculated by (formula 5) _ithe input sound pressure level SPLIN of (m) _i(unit is dB):

${\mathrm{SPLIN}}_i=20\log \frac{{\left|\right|s_i\left(m\right)\left|\right|}^2}{R\×p_{\mathrm{ref}}}$ (formula 5)

Wherein, p _reffor reference sound pressure value, generally get 2 × 10 in atmosphere ^-5pa, R are calibration factor, are determined by smart mobile phone microphone gain, || || be 2-norm of vector;

C-02) according to the i-th channel decomposition signal s calculated _ithe input sound pressure level SPLIN of (m) _i, calculate the i-th passage compensation gain of hearing-aid COEFFICIENT K by formula (6) _i;

$\left\{\begin{array}{cc}{K}_i=k_{i1},& {\mathrm{SPLIN}}_i<{\mathrm{THR}}_{\mathrm{ni}}\\ K_i=k_{i2},& {\mathrm{THR}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{MCL}}_{\mathrm{ni}}\\ K_i=k_{i3},& {\mathrm{MCL}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{ICL}}_{\mathrm{ni}}\\ K_i=k_{i4},& {\mathrm{SPLIN}}_i\&GreaterEqual;{\mathrm{UCL}}_{\mathrm{ni}}\end{array}\right.$ (formula 6)

C-03) (formula 7) is used to calculate the i-th channel decomposition signal s _im output sound pressure level SPLOUT that () is corresponding _i;

$\left\{\begin{array}{cc}{\mathrm{SPLOUT}}_i=K_i\&times;{\mathrm{SPLIN}}_i,& {\mathrm{SPLIN}}_i<{\mathrm{THR}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{THR}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{THR}}_{\mathrm{ni}}),& {\mathrm{THR}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{MCL}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{MCL}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{MCL}}_{\mathrm{ni}}),& {\mathrm{MCL}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{UCL}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{UCL}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{UCL}}_{\mathrm{ni}}),& {\mathrm{SPLIN}}_i\&GreaterEqual;{\mathrm{UCL}}_{\mathrm{ni}}\end{array}\right.$ (formula 7)

C-04) (formula 8) is used to calculate the i-th channel decomposition signal s _im () needs the sound pressure level Δ SPL compensated _i, unit is dB,

Δ SPL _i=λ _i× (SPLOUT _i-SPLIN _i), i=1,2 ..., N (formula 8)

Wherein, λ _ibe the penalty coefficient of the i-th passage, value is between (0,1);

C-05) use (formula 9) by the i-th channel decomposition signal s _im () needs the sound pressure level Δ SPL compensated _ibe converted into the gain A of the i-th passage _i, i=1,2 ..., N;

$A_i={10}^{\frac{\mathrm{\&Delta;SP}{L}_i}{20}},i=\mathrm{1,2},..,N$ (formula 9)

03D) carrying out gain to each passage input decomposed signal is A _i, i=1,2 ..., the compensation of N, compensation formula as (formula 10), y in formula _im () is i-th multi-channel output signal after compensation, obtain the output signal y after N number of channel compensation altogether _i(m), i=1,2 ..., N;

Y _i(m)=A _i* s _i(m), i=1,2 ..., N (formula 10)

03E) to N number of multi-channel output signal y _i(m), i=1,2 ..., it is comprehensive that N carries out bank of filters, comprehensively obtain total output y (m), m=1,2 ..., M, as digital audio input signal s (m) of framing, m=1,2 ..., framing output signal y (m) that M is corresponding.

The invention has the beneficial effects as follows:

The first, the present invention realizes digital hearing aid function by smart mobile phone, avoids using expensive digital deaf-aid special DSP chip, can reduce costs, and easy to use and carry, makes more to listen barrier patient can obtain hearing corrective therapy.

The second, the present invention uses smart mobile phone single channel microphone just can realize digital hearing aid function, without the need to using microphone array collection signal, reduces costs and circuit complexity.

Three, the voice signal that smart mobile phone microphone collects is divided into N number of passage by the present invention, regulates the hearing compensation parameter of listening barrier patient, make the hearing compensation better effects if of smart mobile phone auditory prosthesis, use more comfortable in each passage.

Four, in each hearing compensation passage, the present invention uses the compression figure line of sound pressure level segmentation to carry out hearing compensation, both can protect the residual hearing listening barrier patient, can ensure compensation effect again.

Five, compensating parameter adjusts with the sound pressure level size of sound import, gives large compensation when inputting little sound pressure level signal, and in input compared with giving little compensation during sound pressure level, the uncompensation when input exceedes the sound pressure level of patient's sense of hearing dynamic range.Namely the present invention when measure obtain the threshold of audibility of patient, comfortable threshold and the threshold of pain, input signal in each frequency band is divided into four sections according to sound pressure level, and every section gives different compensating parameters, makes patient more clear when listening small-signal, listen during large-signal and do not explode ear, obtain more comfortable audio experience.

Accompanying drawing explanation

Fig. 1 is the structured flowchart of a kind of auditory prosthesis based on smart mobile phone of the present invention;

Fig. 2 is the hearing compensation compression figure line of the present invention i-th passage;

Fig. 3 is the digital hearing device hearing compensation process schematic that the present invention is based on smart mobile phone;

Fig. 4 is that hearing of the present invention tests the example audiogram of joining module measurement and obtaining;

Fig. 5 is auditory prosthesis input and output voice signal oscillogram of the present invention.

Embodiment

Below in conjunction with accompanying drawing and specific embodiment, technical solution of the present invention is described in further detail, can better understand the present invention to make those skilled in the art and can be implemented, but illustrated embodiment is not as a limitation of the invention.

A kind of auditory prosthesis based on smart mobile phone, as shown in Figure 1, comprise smart mobile phone body, described smart mobile phone body is built-in with microphone, loud speaker and memory, also comprises the hearing loss test module, parameter calculating module and the hearing compensation module that are connected with smart mobile phone body respectively.Hearing loss test module is used for the hearing loss situation of test patient, parameter calculating module is used for patient's hearing loss situation of test to be converted to hearing compensation parameter, hearing compensation module changes sound based on hearing compensation parameter, thus realizes hearing-aid function.

It should be noted that, hearing loss test module, parameter calculating module and hearing compensation module as the peripheral equipment of smart mobile phone body, also can be able to be built in smart mobile phone body.

Below modules is introduced:

Hearing loss test module comprises sound and plays submodule, user feedback submodule and parameter sub module stored:

User plays by sound the pure tone that submodule listens to the frequency of varying strength successively, and by user feedback submodule, hearing loss test module is fed back to the perception situation of the sound heard, hearing loss test module is according to the pure tone audiometry THR of the feedback of user by each for user frequency _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N) stored by parameter sub module stored, i=1,2 ..., N is frequency corresponding to each hearing test frequency.

General desirable 125Hz, 250Hz, 500Hz, 1KHz, 2KHz, 3KHz, 4KHz, 6KHz eight frequencies are tested, and at each frequency, sound is play audio signal sound pressure level that submodule exports earphone to and paramountly to be increased progressively gradually from low.Wherein, listen barrier patient from the pure tone audiometry THR that can't hear the tonal signal sound pressure level just heard and be marked as this frequency _ni, i=1,2 ..., N, N are frequency number, are taken as 8 here; The tonal signal sound pressure level of listening barrier patient sensation can not hear also the most comfortable is marked as comfortable threshold MCL _ni, i=1,2 ..., N, listens barrier patient perceived sounds to cause too greatly the tonal signal sound pressure level of pain to be marked as threshold of pain UCL _ni, i=1,2 ..., N, for the hearing of barrier patient is listened in protection, just no longer continues to increase after sound pressure level to the threshold of pain to measure.The threshold of audibility be completed, comfortable threshold and the threshold of pain are stored by parameter sub module stored.

Parameter calculating module is according to the multi-frequency pure tone audiometry THR recorded _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N) and calculate the hearing compensation parameter of hearing compensation passage corresponding to each test frequency.

Hearing compensation module compensates according to the sound of the hearing compensation parameter calculated to hearing compensation passage corresponding to each test frequency.

Based on a hearing aid implementation method for smart mobile phone, comprise the steps:

S01: successively hearing loss test is carried out to N number of sound frequency, be specially:

01A) sound plays the pure tone that submodule plays the frequency of varying strength successively, and user is listened to by earphone;

01B) user is to the perception situation of the sound heard, is fed back by user feedback submodule;

General desirable 125Hz, 250Hz, 500Hz, 1KHz, 2KHz, 3KHz, 4KHz, 6KHz eight frequencies are tested, and at each frequency, sound is play audio signal sound pressure level that submodule exports earphone to and paramountly to be increased progressively gradually from low.Wherein, listen barrier patient from the pure tone audiometry THR that can't hear the tonal signal sound pressure level just heard and be marked as this frequency _ni, i=1,2 ..., N, N are frequency number, are taken as 8 here; The tonal signal sound pressure level of listening barrier patient sensation can not hear also the most comfortable is marked as comfortable threshold MCL _ni, i=1,2 ..., N, listens barrier patient perceived sounds to cause too greatly the tonal signal sound pressure level of pain to be marked as threshold of pain UCL _ni, i=1,2 ..., N, for the hearing of barrier patient is listened in protection, just no longer continues to increase after sound pressure level to the threshold of pain to measure.

The pure tone audiometry THR of each frequency 01C) is obtained according to the feedback of user _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N), i=1,2 ..., N is frequency corresponding to each hearing test frequency;

Preferably, N=8, frequency i=1,2 ..., the hearing test frequency that N is corresponding is respectively 125Hz, 250Hz, 500Hz, 1KHz, 2KHz, 3KHz, 4KHz, 6KHz.

S02: to each hearing test frequency i, parameter calculating module tests the pure tone audiometry THR of the user obtained according to this frequency _ni, comfortable threshold MCL _ni, threshold of pain UCL _niand normal adult is at the pure tone audiometry THR of this frequency _ui, comfortable threshold MCL _uiwith threshold of pain UCL _uicalculate the hearing compensation parameter of hearing compensation passage corresponding to this frequency (wherein, the hearing compensation port number of smart mobile phone auditory prosthesis is hearing test frequency number (N=8), the corresponding hearing compensation passage of each test frequency, the hearing compensation passage that this frequency is corresponding refers to the sound channel of frequency centered by this frequency, and the passband of adjacent sound passage is adjacent but non-intersect.In addition, for the ease of each threshold value and the normal threshold value of distinguishing tests, on the Parametric Representation of correspondence, add subscript n and u) respectively, be specially:

To each hearing compensation passage, calculate each slope over 10 of hearing compensation compression figure line of sound pressure level segmentation, wherein, THR _ui, MCL _ui, UCL _uican consult standard contour of equal loudness to obtain, as shown in Figure 2, abscissa is the input sound pressure level SPLIN of the i-th passage _i, ordinate is the output sound pressure level SPLOUT after the i-th passage hearing compensation _i, the pure tone audiometry THR obtained with user test _ni, comfortable threshold MCL _niwith threshold of pain UCL _nias flex point, in each passage, acoustic pressure fraction four sections is calculated hearing compensation parameter k _ij, i=1,2 ..., N; J=1,2,3,4:

$k_{i1}=\frac{{\mathrm{THR}}_{\mathrm{ui}}-0}{{\mathrm{THR}}_{\mathrm{ni}}-0}$ (formula 1)

$k_{i2}=\frac{{\mathrm{MCL}}_{\mathrm{ui}}-{\mathrm{THR}}_{\mathrm{ui}}}{{\mathrm{MCL}}_{\mathrm{ni}}-{\mathrm{THR}}_{\mathrm{ni}}}$ (formula 2)

$k_{i3}=\frac{{\mathrm{UCL}}_{\mathrm{ui}}-{\mathrm{MCL}}_{\mathrm{ui}}}{{\mathrm{UCL}}_{\mathrm{ni}}-{\mathrm{MCL}}_{\mathrm{ni}}}$ (formula 3)

K _i4=0 (formula 4);

The situation of more sound pressure level segmentations can be analogized.

S03: according to the hearing compensation parameter k calculated _ij, hearing compensation module compensates the sound that each tests hearing compensation passage corresponding to frequency, specifically as shown in Figure 3:

03A) smart mobile phone microprocessor carries out AD conversion to microphone input signal s (t) (t is the time), obtains discrete digital audio signal s (m), and m is discrete number of samples here, sample frequency f _s16KHz can be set to; By digital audio and video signals s (m) that smart mobile phone microphone gathers, m=1,2 ..., M carries out framing, general, and frame length M can be set to 256;

03B) decomposition of N channel bank of filters is carried out to every frame signal s (m), obtain N number of channel decomposition signal s _i(m), i=1,2 ..., N, the analysis filter bank centre frequency of each passage is the test frequency in step S01;

03C) successively to each i, i=1,2 ..., N carries out following calculating:

C-01) the decomposed signal s of i passage is calculated by (formula 5) _ithe input sound pressure level SPLIN of (m) _i(unit is dB):

${\mathrm{SPLIN}}_i=20\log \frac{{\left|\right|s_i\left(m\right)\left|\right|}^2}{R\&times;p_{\mathrm{ref}}}$ (formula 5)

Wherein, p _reffor reference sound pressure value, generally get 2 × 10 in atmosphere ^-5pa, R are calibration factor, are determined by smart mobile phone microphone gain, || || be 2-norm of vector;

C-02) according to the i-th channel decomposition signal s calculated _ithe input sound pressure level SPLIN of (m) _i, calculate the i-th passage compensation gain of hearing-aid COEFFICIENT K by formula (6) _i;

$\left\{\begin{array}{cc}{K}_i=k_{i1},& {\mathrm{SPLIN}}_i<{\mathrm{THR}}_{\mathrm{ni}}\\ K_i=k_{i2},& {\mathrm{THR}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{MCL}}_{\mathrm{ni}}\\ K_i=k_{i3},& {\mathrm{MCL}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{ICL}}_{\mathrm{ni}}\\ K_i=k_{i4},& {\mathrm{SPLIN}}_i\&GreaterEqual;{\mathrm{UCL}}_{\mathrm{ni}}\end{array}\right.$ (formula 6)

C-03) (formula 7) is used to calculate the i-th channel decomposition signal s _im output sound pressure level SPLOUT that () is corresponding _i;

$\left\{\begin{array}{cc}{\mathrm{SPLOUT}}_i=K_i\&times;{\mathrm{SPLIN}}_i,& {\mathrm{SPLIN}}_i<{\mathrm{THR}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{THR}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{THR}}_{\mathrm{ni}}),& {\mathrm{THR}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{MCL}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{MCL}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{MCL}}_{\mathrm{ni}}),& {\mathrm{MCL}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{UCL}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{UCL}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{UCL}}_{\mathrm{ni}}),& {\mathrm{SPLIN}}_i\&GreaterEqual;{\mathrm{UCL}}_{\mathrm{ni}}\end{array}\right.$ (formula 7)

C-04) (formula 8) is used to calculate the i-th channel decomposition signal s _im () needs the sound pressure level Δ SPL compensated _i, unit is dB,

Δ SPL _i=λ _i× (SPLOUT _i-SPLIN _i), i=1,2 ..., N (formula 8)

Wherein, λ _ibe the penalty coefficient of the i-th passage, obtained by non-linear prescriptive formula, general value is between (0,1);

C-05) use (formula 9) by the i-th channel decomposition signal s _im () needs the sound pressure level Δ SPL compensated _ibe converted into the gain A of the i-th passage _i, i=1,2 ..., N;

$A_i={10}^{\frac{\mathrm{\&Delta;SP}{L}_i}{20}},i=\mathrm{1,2},..,N$ (formula 9)

03D) carrying out gain to each passage input decomposed signal is A _i, i=1,2 ..., the compensation of N, compensation formula as (formula 10), y in formula _im () is i-th multi-channel output signal after compensation, obtain the output signal y after N number of channel compensation altogether _i(m), i=1,2 ..., N;

Y _i(m)=A _i* s _i(m), i=1,2 ..., N (formula 10)

03E) to N number of multi-channel output signal y _i(m), i=1,2 ..., it is comprehensive that N carries out bank of filters, comprehensively obtain total output y (m), m=1,2 ..., M, as digital audio input signal s (m) of framing, m=1,2 ..., framing output signal y (m) that M is corresponding.

Preferably, step 03E) in, framing is outputed signal the earphone that y (m) exports user's use to.

In step 03E) terminate after, continue compensate subsequent time digital audio input signal and export, user use earphone in can obtain real-time compensation after sound, realize digital hearing aid function.

The smart mobile phone digital hearing device that the present invention proposes and implementation method can utilize single channel microphone collected sound signal in smart mobile phone, and the microprocessor chip in smart mobile phone can be utilized to realize hearing compensation function according to the hearing compensation parameter of listening barrier patient hearing test to obtain.

Accompanying drawing 4 is that a typical case listens the audiogram hindering patient and utilize the present invention's measurement to obtain, and comprises the pure tone audiometry THR of eight frequencies _ni(i=1,2 ..., 8), comfortable threshold MCL _ni(i=1,2 ..., 8) and threshold of pain UCL _ni(i=1,2 ..., 8) parameter figure line.These Parameter Switch are become the hearing compensation parameter of eight passages, wherein the centre frequency of each passage is eight frequencies of above-mentioned measurement.

After above-mentioned hearing compensation parameter is determined, accompanying drawing 5 is one section of smart mobile phone auditory prosthesis input and output voice signal oscillogram, wherein scheming (a) is microphone input speech signal oscillogram, and figure (b) is the output voice signal oscillogram corresponding with it.Export voice signal waveform envelope as can see from Figure 5 and remain input speech signal envelope, ensure that the property understood of voice signal, export voice signal amplitude simultaneously and amplify, acoustic energy is compensated.

The invention has the beneficial effects as follows:

The first, the present invention realizes digital hearing aid function by smart mobile phone, avoids using expensive digital deaf-aid special DSP chip, can reduce costs, and easy to use and carry, makes more to listen barrier patient can obtain hearing corrective therapy.

The second, the present invention uses smart mobile phone single channel microphone just can realize digital hearing aid function, without the need to using microphone array collection signal, reduces costs and circuit complexity.

Three, the voice signal that smart mobile phone microphone collects is divided into N number of passage by the present invention, regulates the hearing compensation parameter of listening barrier patient, make the hearing compensation better effects if of smart mobile phone auditory prosthesis, use more comfortable in each passage.

Four, in each hearing compensation passage, the present invention uses the compression figure line of sound pressure level segmentation to carry out hearing compensation, both can protect the residual hearing listening barrier patient, can ensure compensation effect again.

Five, compensating parameter adjusts with the sound pressure level size of sound import, gives large compensation when inputting little sound pressure level signal, and in input compared with giving little compensation during sound pressure level, the uncompensation when input exceedes the sound pressure level of patient's sense of hearing dynamic range.Namely the present invention when measure obtain the threshold of audibility of patient, comfortable threshold and the threshold of pain, input signal in each frequency band is divided into four sections according to sound pressure level, and every section gives different compensating parameters, makes patient more clear when listening small-signal, listen during large-signal and do not explode ear, obtain more comfortable audio experience.

These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in the technical field that other are relevant, be all in like manner included in scope of patent protection of the present invention.

Claims (6)

1. the auditory prosthesis based on smart mobile phone, comprise smart mobile phone body, described smart mobile phone body is built-in with microphone, loud speaker and memory, it is characterized in that, also comprises the hearing loss test module, parameter calculating module and the hearing compensation module that are connected with smart mobile phone body respectively;

Described hearing loss test module comprises sound and plays submodule, user feedback submodule and parameter sub module stored, wherein, user plays by sound the pure tone that submodule listens to the frequency of varying strength successively, and by user feedback submodule, hearing loss test module is fed back to the perception situation of the sound heard, hearing loss test module is according to the pure tone audiometry THR of the feedback of user by each for user frequency _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N) stored by parameter sub module stored, i=1,2 ..., N is frequency corresponding to each hearing test frequency;

Described parameter calculating module is according to the multi-frequency pure tone audiometry THR recorded _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N) and calculate the hearing compensation parameter of hearing compensation passage corresponding to each test frequency;

Described hearing compensation module compensates according to the sound of the hearing compensation parameter calculated to hearing compensation passage corresponding to each test frequency.

2., based on a hearing aid implementation method for smart mobile phone, it is characterized in that, comprise the steps:

S01: successively hearing loss test is carried out to N number of sound frequency, be specially:

01A) sound plays the pure tone that submodule plays the frequency of varying strength successively, and user is listened to by earphone;

01B) user is to the perception situation of the sound heard, is fed back by user feedback submodule;

The pure tone audiometry THR of each frequency 01C) is obtained according to the feedback of user _ni(i=1,2 ..., N), comfortable threshold MCL _ni(i=1,2 ..., N) and threshold of pain UCL _ni(i=1,2 ..., N), i=1,2 ..., N is frequency corresponding to each hearing test frequency;

S02: to each hearing test frequency i, parameter calculating module tests the pure tone audiometry THR of the user obtained according to this frequency _ni, comfortable threshold MCL _ni, threshold of pain UCL _niand normal adult is at the pure tone audiometry THR of this frequency _ui, comfortable threshold MCL _uiwith threshold of pain UCL _uicalculate the hearing compensation parameter of hearing compensation passage corresponding to this frequency, be specially:

To each hearing compensation passage, the pure tone audiometry THR obtained with user test _ni, comfortable threshold MCL _niwith threshold of pain UCL _nias flex point, point four sections of calculating hearing compensation parameter k _ij, i=1,2 ..., N; J=1,2,3,4:

$k_{i1}=\frac{{\mathrm{THR}}_{\mathrm{ui}}-0}{{\mathrm{THR}}_{\mathrm{ni}}-0}$ (formula 1)

$k_{i2}=\frac{{{\mathrm{MCL}}_{\mathrm{ui}}-\mathrm{THR}}_{\mathrm{ui}}}{{{\mathrm{MCL}}_{\mathrm{ni}}-\mathrm{THR}}_{\mathrm{ni}}}$ (formula 2)

$k_{i3}=\frac{{{\mathrm{UCL}}_{\mathrm{ui}}-\mathrm{MCL}}_{\mathrm{ui}}}{{{\mathrm{UCL}}_{\mathrm{ni}}-\mathrm{MCL}}_{\mathrm{ni}}}$ (formula 3)

K _i4=0 (formula 4);

S03: according to the hearing compensation parameter k calculated _ij, hearing compensation module compensates the sound that each tests hearing compensation passage corresponding to frequency, is specially:

03A) by digital audio and video signals s (m) that smart mobile phone microphone gathers, m=1,2 ..., M carries out framing;

03B) decomposition of N channel bank of filters is carried out to every frame signal s (m), obtain N number of channel decomposition signal s _i(m), i=1,2 ..., N, the analysis filter bank centre frequency of each passage is the test frequency in step S01;

03C) successively to each i, i=1,2 ..., N carries out following calculating:

C-01) the decomposed signal s of i passage is calculated by (formula 5) _ithe input sound pressure level SPLIN of (m) _i(unit is dB):

${\mathrm{SPLIN}}_i=20\lg \frac{{\left|\right|s_i\left(m\right)\left|\right|}^2}{R\&times;p_{\mathrm{ref}}}$ (formula 5)

Wherein, p _reffor reference sound pressure value, generally get 2 × 10 in atmosphere ^-5pa, R are calibration factor, are determined by smart mobile phone microphone gain, || || be 2-norm of vector;

C-02) according to the i-th channel decomposition signal s calculated _ithe input sound pressure level SPLIN of (m) _i, calculate the i-th passage compensation gain of hearing-aid COEFFICIENT K by formula (6) _i;

$\left\{\begin{array}{cc}{K}_i=k_{i1},& {\mathrm{SPLIN}}_i<{\mathrm{THR}}_{\mathrm{ni}}\\ K_i=k_{i2},& {\mathrm{THR}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{MCL}}_{\mathrm{ni}}\\ K_i=k_{i3},& {\mathrm{MCL}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{UCL}}_{\mathrm{ni}}\\ K_i=k_{i4},& {\mathrm{SPLIN}}_i\&GreaterEqual;{\mathrm{UCL}}_{\mathrm{ni}}\end{array}\right.$ (formula 6)

C-03) (formula 7) is used to calculate the i-th channel decomposition signal s _im output sound pressure level SPLOUT that () is corresponding _i;

$\left\{\begin{array}{cc}{\mathrm{SPLOUT}}_i=K_i\&times;{\mathrm{SPLIN}}_i,& {\mathrm{SPLIN}}_i<{\mathrm{THR}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{THR}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{THR}}_{\mathrm{ni}}),& {\mathrm{THR}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{MCL}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{MCL}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{MCL}}_{\mathrm{ni}}),& {\mathrm{MCL}}_{\mathrm{ni}}\&le;{\mathrm{SPLIN}}_i<{\mathrm{UCL}}_{\mathrm{ni}}\\ {\mathrm{SPLOUT}}_i={\mathrm{UCL}}_{\mathrm{ui}}+K_i\&times;({\mathrm{SPLIN}}_i-{\mathrm{UCL}}_{\mathrm{ni}}),& {\mathrm{SPLIN}}_i\&GreaterEqual;{\mathrm{UCL}}_{\mathrm{ni}}\end{array}\right.$ (formula 7)

C-04) (formula 8) is used to calculate the i-th channel decomposition signal s _im () needs the sound pressure level Δ SPL compensated _i, unit is dB,

Δ SPL _i=λ _i× (SPLOUT _i-SPLIN _i), i=1,2 ..., N (formula 8)

Wherein, λ _ibe the penalty coefficient of the i-th passage, value is between (0,1);

C-05) use (formula 9) by the i-th channel decomposition signal s _im () needs the sound pressure level Δ SPL compensated _ibe converted into the gain A of the i-th passage _i, i=1,2 ..., N;

$A_i={10}^{\frac{\mathrm{\&Delta;}{\mathrm{SPL}}_i}{20}},i=\mathrm{1,2},...,N$ (formula 9)

03D) carrying out gain to each passage input decomposed signal is A _i, i=1,2 ..., the compensation of N, compensation formula as (formula 10), y in formula _im () is i-th multi-channel output signal after compensation, obtain the output signal y after N number of channel compensation altogether _i(m), i=1,2 ..., N;

Y _i(m)=A _is _i(m), i=1,2 ..., N (formula 10)

03E) to N number of multi-channel output signal y _i(m), i=1,2 ..., it is comprehensive that N carries out bank of filters, comprehensively obtain total output y (m), m=1,2 ..., M, as digital audio input signal s (m) of framing, m=1,2 ..., framing output signal y (m) that M is corresponding.

3. a kind of hearing aid implementation method based on smart mobile phone according to claim 2, is characterized in that, described N=8, frequency i=1,2 ..., the hearing test frequency that N is corresponding is respectively 125Hz, 250Hz, 500Hz, 1KHz, 2KHz, 3KHz, 4KHz, 6KHz.

4. a kind of hearing aid implementation method based on smart mobile phone according to claim 2, is characterized in that, described M=256.

5. a kind of hearing aid implementation method based on smart mobile phone according to claim 2, is characterized in that, step 03E) in, framing is outputed signal the earphone that y (m) exports user's use to.

6. a kind of hearing aid implementation method based on smart mobile phone according to claim 5, is characterized in that, in step 03E) terminate after, continue compensate subsequent time digital audio input signal and export.