JP5246700B2 - Hearing aid system - Google Patents
Hearing aid system Download PDFInfo
- Publication number
- JP5246700B2 JP5246700B2 JP2009011748A JP2009011748A JP5246700B2 JP 5246700 B2 JP5246700 B2 JP 5246700B2 JP 2009011748 A JP2009011748 A JP 2009011748A JP 2009011748 A JP2009011748 A JP 2009011748A JP 5246700 B2 JP5246700 B2 JP 5246700B2
- Authority
- JP
- Japan
- Prior art keywords
- hearing aid
- unit
- signal
- signal component
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims description 62
- 230000006870 function Effects 0.000 claims description 34
- 238000012546 transfer Methods 0.000 claims description 34
- 238000000605 extraction Methods 0.000 claims description 19
- 238000012544 monitoring process Methods 0.000 claims description 13
- 210000005069 ears Anatomy 0.000 claims description 11
- 230000015572 biosynthetic process Effects 0.000 claims description 9
- 238000003786 synthesis reaction Methods 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 8
- 230000002194 synthesizing effect Effects 0.000 claims description 5
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims 1
- 210000003128 head Anatomy 0.000 description 28
- 238000004891 communication Methods 0.000 description 11
- 238000000034 method Methods 0.000 description 9
- 230000005236 sound signal Effects 0.000 description 6
- 230000001629 suppression Effects 0.000 description 4
- 230000003321 amplification Effects 0.000 description 3
- 238000003199 nucleic acid amplification method Methods 0.000 description 3
- 210000003454 tympanic membrane Anatomy 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Description
本発明は、補聴器を両耳に装用する補聴システムであって、音声は強調され雑音は抑制される補聴システムに関する。 The present invention relates to a hearing aid system in which a hearing aid is worn on both ears, and the present invention relates to a hearing aid system in which speech is enhanced and noise is suppressed.
両耳に装用した補聴器のマイクロホンの出力信号に含まれる雑音を抑制する技術としては、各マイクロホンの出力信号の平均自乗誤差が最小となるようにフィルタ係数を設定する技術が知られている（例えば、特許文献１参照）。
また、両耳に装用した聴音装置のマイクロホンが受信した音信号を強調する技術としては、各マイクロホンで受信した音信号を音声と騒音に分離し、音声信号をＷａｖｅｌｅｔ変換して分析したデータを互いに送受信し、互いの分析データから音声の方向を推定し、この方向の音信号を強調する技術が知られている（例えば、特許文献２参照）。
As a technique for suppressing noise contained in the output signal of a hearing aid microphone worn in both ears, a technique for setting a filter coefficient so as to minimize the mean square error of the output signal of each microphone is known (for example, , See Patent Document 1).
In addition, as a technique for emphasizing the sound signal received by the microphone of the hearing device worn in both ears, the sound signal received by each microphone is separated into sound and noise, and the data analyzed by wavelet transform of the sound signal are mutually connected. A technique is known that transmits and receives signals, estimates the direction of sound from each other's analysis data, and emphasizes the sound signal in this direction (see, for example, Patent Document 2).
しかし、特許文献１に記載の技術においては、一方向の雑音しか抑制することができないという問題がある。また、特許文献２に記載の技術においては、ノイズ除去の処理をして音声信号のＳＮ比を向上させた後でなければ音源方向の推定ができないので、処理が重たくなるという問題がある。 However, the technique described in Patent Document 1 has a problem that only noise in one direction can be suppressed. Further, the technique described in Patent Document 2 has a problem that the sound source direction cannot be estimated unless noise removal processing is performed and the S / N ratio of the audio signal is improved, so that the processing becomes heavy.
本発明は、従来の技術が有するこのような問題点に鑑みてなされたものであり、その目的とするところは、複数の方向から監視する音声と雑音に対し、音声は強調され、雑音は抑制される補聴システムを提供しようとするものである。 The present invention has been made in view of such problems of the prior art, and the object of the present invention is to enhance the voice and suppress the noise with respect to the voice and noise monitored from a plurality of directions. It is intended to provide a hearing aid system.
上記課題を解決すべく請求項１に係る発明は、マイクロホンの出力信号を補聴処理し、補聴処理された信号をイヤホンにより音圧に変換して出力する補聴器を両耳に装用する補聴システムにおいて、各補聴器の前記マイクロホンの出力信号から頭部伝達関数の逆特性を用いて予め設定しておいた各方向より到来する音を推定し、この推定した各方向の音のエンベロープの低周波数成分の変調度合の左右の差が所定の値より小さい音を強調する処理手段を設けたものである。 In order to solve the above-mentioned problem, the invention according to claim 1 is a hearing aid system in which a hearing aid that wears hearing aids in both ears for hearing aid processing of an output signal of a microphone, converts the hearing aid processed signal into sound pressure by an earphone, and outputs the sound pressure. Estimate the sound coming from each direction set in advance using the inverse characteristics of the head-related transfer function from the output signal of the microphone of each hearing aid, and modulate the low-frequency component of the sound envelope of each estimated direction Processing means for emphasizing a sound whose degree of right and left is smaller than a predetermined value is provided.
請求項２に係る発明は、マイクロホンの出力信号を補聴処理部で補聴処理し、補聴処理された信号をイヤホンにより音圧に変換して出力する補聴器を両耳に装用すると共に、これらの補聴器に相互にデータ通信を行うための送受信部を備える補聴システムであって、各補聴器にはマイクロホンの出力信号に予め設定しておいた音の監視方向の頭部伝達関数の逆特性を畳み込んで各監視方向の信号成分を推定する各信号成分抽出処理部と、この各信号成分抽出処理部が算出した各方向の信号成分に頭部伝達関数を畳み込む頭部伝達関数処理部と、前記各信号成分抽出処理部が算出した各方向の信号成分のエンベロープを算出するエンベロープ算出部と、このエンベロープ算出部が算出した各方向の信号成分のエンベロープについて設定されたカットオフ周波数で高周波数成分を除去するローパスフィルタ部と、このローパスフィルタ部が出力した各方向の信号成分の変調度合を算出する変調度合算出部を設け、一方の補聴器には、前記変調度合算出部から出力された変調度合と前記送受信部を介して他方の補聴器の前記変調度合算出部から出力された変調度合を入力して各同一方向の変調度合の差分を算出し、この差分と所定値を比較して音声の到来方向を推定する音声到来方向推定部と、前記頭部伝達関数処理部で求めた各方向の信号成分と、前記マイクロホンの出力信号と、前記音声到来方向推定部で求めた到来方向を入力し、各方向の信号成分が音声の到来方向であるか否かに応じて合成し前記補聴処理部へ出力する合成部を設け、他方の補聴器には、前記頭部伝達関数処理部で求めた各方向の信号成分と、前記マイクロホンの出力信号と、前記送受信部を介して前記音声到来方向推定部で求めた音声の到来方向を入力し、各方向の信号成分が音声の到来方向であるか否かに応じて合成し前記補聴処理部へ出力する合成部を設けたものである。 The invention according to claim 2 wears in both ears a hearing aid that performs hearing aid processing on the output signal of the microphone in the hearing aid processing unit, converts the hearing aid processed signal into sound pressure by the earphone, and outputs the sound pressure to both ears. A hearing aid system including a transmission / reception unit for performing data communication with each other, and each hearing aid convolves with the inverse characteristic of the head-related transfer function in the sound monitoring direction set in advance in the output signal of the microphone. Each signal component extraction processing unit that estimates a signal component in the monitoring direction, a head-related transfer function processing unit that convolves a head-related transfer function with the signal component in each direction calculated by each signal component extraction processing unit, and each signal component An envelope calculation unit that calculates the envelope of the signal component in each direction calculated by the extraction processing unit, and the envelope set for the envelope of the signal component in each direction calculated by the envelope calculation unit. A low-pass filter unit that removes high-frequency components at the toe-off frequency and a modulation degree calculation unit that calculates the modulation degree of the signal component in each direction output by the low-pass filter unit are provided, and one of the hearing aids has the modulation degree calculation unit The modulation degree output from the modulation degree output from the modulation degree calculation unit of the other hearing aid is input via the transmission / reception unit, and the difference between the modulation degrees in the same direction is calculated. A voice arrival direction estimation unit that estimates a voice arrival direction by comparison, a signal component in each direction obtained by the head related transfer function processing unit, an output signal of the microphone, and a voice arrival direction estimation unit An arrival direction is input, a synthesis unit is provided for synthesizing according to whether or not the signal component in each direction is the arrival direction of sound, and outputting to the hearing aid processing unit, and the other hearing aid has the head related transfer function processing Part The obtained signal component in each direction, the output signal of the microphone, and the voice arrival direction obtained by the voice arrival direction estimation unit via the transmission / reception unit are input, and the signal component in each direction is the voice arrival direction. A synthesizing unit for synthesizing and outputting to the hearing aid processing unit according to whether or not there is provided.
本発明によれば、マイクロホンの出力信号を頭部伝達関数の逆特性で各方向成分に分けることで、音声成分のＳＮ比を向上させることができる。複数の方向から音声が到達しても、音声が到来する複数方向に対して音声を強調することができる。複数の方向から雑音が到達しても、雑音が到来する複数方向に対して雑音を抑制することができる。分別した方向の信号をマイクロホンの出力信号に合成するため、周囲の音が消されないので、安全に装用できる。両耳に補聴器を装用するので、各々のマイクロホンの出力信号を頭部伝達関数の逆特性で各方向成分に分けることにより、頭部伝達関数の誤差による影響が抑えられる。 According to the present invention, the S / N ratio of the sound component can be improved by dividing the output signal of the microphone into each direction component by the inverse characteristic of the head-related transfer function. Even if sound arrives from a plurality of directions, the sound can be emphasized with respect to a plurality of directions from which the sound comes. Even if noise arrives from a plurality of directions, the noise can be suppressed with respect to a plurality of directions from which the noise comes. Since the signal in the separated direction is synthesized with the output signal of the microphone, the surrounding sound is not erased, so it can be worn safely. Since hearing aids are worn on both ears, the influence of head-related transfer function errors can be suppressed by dividing the output signal of each microphone into each directional component based on the inverse characteristics of the head-related transfer function.
また、耳かけ型補聴器の場合のように耳介の後側のマイクロホンで採取した音でも、頭部伝達関数でマイクロホンの位置を補正すれば、鼓膜近傍の音に補正してイヤホンから出力できるので、装用者にとって、より自然な音として聴取することができるようになる。 Also, even if the sound is collected with a microphone behind the pinna, as in the case of a hearing aid, if the position of the microphone is corrected with the head-related transfer function, it can be corrected to the sound near the eardrum and output from the earphone. For the wearer, it can be heard as a more natural sound.
以下に本発明の実施の形態を添付図面に基づいて説明する。ここで、図１は本発明に係る補聴システムのブロック図である。 Embodiments of the present invention will be described below with reference to the accompanying drawings. Here, FIG. 1 is a block diagram of a hearing aid system according to the present invention.
本発明は、補聴器のマイクロホンの出力信号から頭部伝達関数（ＨＲＴＦ：Head-Related Transfer Function）を用いて予め設定しておいた各方向より到来する音を推定し、これらの音が音声である場合には強調し、雑音である場合には抑制するものである。頭部伝達関数（ＨＲＴＦ）とは、音源から鼓膜までの音響伝達関数で、音が音源から鼓膜に到るまでの頭部や耳介による周波数特性を相対音圧レベル（ｄＢ）で示したものである。 The present invention estimates sounds coming from each direction set in advance using a head-related transfer function (HRTF) from an output signal of a microphone of a hearing aid, and these sounds are voices. In case of noise, it is emphasized. The head-related transfer function (HRTF) is an acoustic transfer function from the sound source to the eardrum, and shows the frequency characteristics of the head and pinna in terms of relative sound pressure level (dB) until the sound reaches the eardrum from the sound source. It is.
例えば、方位角（例えば正面方向を基準）の場合で、水平面上４５度間隔の８方向から到来する音圧に本発明を適用した場合について説明する。補聴器のマイクロホンに到達した音圧に対し、８方向の頭部伝達関数（ＨＲＴＦ）の逆特性を畳み込み、各方向（８方向）の信号成分を推定する。即ち、予め設定した８方向について、到来すると仮想した音源の音圧を推定することができる。方向毎に推定した音圧は、点音源である音声に対して必然的にＳＮ比が向上する。 For example, a case will be described in which the present invention is applied to sound pressures arriving from eight directions at intervals of 45 degrees on a horizontal plane in the case of an azimuth angle (for example, based on the front direction). The inverse of the 8-direction head-related transfer function (HRTF) is convoluted with the sound pressure that has reached the microphone of the hearing aid to estimate the signal components in each direction (8 directions). That is, the sound pressure of a virtual sound source can be estimated when it arrives in eight preset directions. The sound pressure estimated for each direction inevitably improves the signal-to-noise ratio with respect to the sound that is a point sound source.
８方向の推定音圧のうち、例えば音声成分の割合が大きいものを選択して増幅し、もとのマイクロホンの出力信号に加算すれば、設定方向のうち音声成分が到来する複数の方向に高い増幅率を持つことができる。つまり、複数方向の音声信号に対して強調することができる。 Of the estimated sound pressures in 8 directions, for example, the one with a large proportion of the sound component is selected and amplified, and added to the output signal of the original microphone. Can have an amplification factor. That is, it is possible to emphasize a multidirectional audio signal.
また、８方向の推定音圧のうち、例えば音声成分の割合が低いものを選択し、もとのマイクロホンの出力信号から減算すれば、設定方向のうち音声が到来しない方向の信号成分を抑制することができる。音声の強調とノイズの抑制のどちらか一方でもよいし、両方を機能させてもよい。 In addition, if the estimated sound pressure in the eight directions is selected, for example, the one with a low ratio of the sound component is selected and subtracted from the output signal of the original microphone, the signal component in the direction in which no sound arrives among the set directions is suppressed be able to. Either one of speech enhancement and noise suppression may be used, or both may be functioned.
本発明に係る補聴システムは、図１に示すように、右耳に装用する右側補聴器２と左耳に装用する左側補聴器３からなる。右側補聴器２は、マイクロホン５、ＤＳＰ（Digital Signal Processor）６、通信用ＩＣ（Integrated Circuit）７、イヤホン８などからなる。ＤＳＰ６は、設定部１０、各方向信号成分抽出処理部１１、エンベロープ算出部１２、ローパスフィルタ部１３、変調度合算出部１４、音声到来方向判定部１５、ＨＲＴＦ処理部１６、合成部１７、補聴処理部１８などを備えている。通信用ＩＣ７は、送信部１９と受信部２０からなる。右側補聴器２には、設定部１０に記憶された複数の設定の選択を切り替える切替スイッチ２１を備える。 As shown in FIG. 1, the hearing aid system according to the present invention includes a right hearing aid 2 worn on the right ear and a left hearing aid 3 worn on the left ear. The right hearing aid 2 includes a microphone 5, a DSP (Digital Signal Processor) 6, a communication IC (Integrated Circuit) 7, an earphone 8, and the like. The DSP 6 includes a setting unit 10, each direction signal component extraction processing unit 11, an envelope calculation unit 12, a low-pass filter unit 13, a modulation degree calculation unit 14, a voice arrival direction determination unit 15, an HRTF processing unit 16, a synthesis unit 17, and a hearing aid process. Part 18 and the like. The communication IC 7 includes a transmission unit 19 and a reception unit 20. The right hearing aid 2 is provided with a changeover switch 21 for switching selection of a plurality of settings stored in the setting unit 10.
また、左側補聴器３は、マイクロホン２５、ＤＳＰ（Digital Signal Processor）２６、通信用ＩＣ（Integrated Circuit）２７、イヤホン２８などからなる。ＤＳＰ２６は、各方向信号成分抽出処理部３１、エンベロープ算出部３２、ローパスフィルタ部３３、変調度合算出部３４、ＨＲＴＦ処理部３６、合成部３７、補聴処理部３８などを備えている。通信用ＩＣ２７は、送信部２９と受信部３０からなる。 The left hearing aid 3 includes a microphone 25, a DSP (Digital Signal Processor) 26, a communication IC (Integrated Circuit) 27, an earphone 28, and the like. The DSP 26 includes a directional signal component extraction processing unit 31, an envelope calculation unit 32, a low-pass filter unit 33, a modulation degree calculation unit 34, an HRTF processing unit 36, a synthesis unit 37, a hearing aid processing unit 38, and the like. The communication IC 27 includes a transmission unit 29 and a reception unit 30.
切替スイッチ２１と設定部１０は、右側補聴器２または左側補聴器３の何れかに設ければよい。また、右耳に装用する右側補聴器２と左耳に装用する左側補聴器３との間のデータ通信の方法としては、電線、電波や生体間などでよく、特に限定されない。電線の場合は、通信用ＩＣ７，２７を設けなくてもよい。 The changeover switch 21 and the setting unit 10 may be provided in either the right hearing aid 2 or the left hearing aid 3. Further, the data communication method between the right hearing aid 2 worn on the right ear and the left hearing aid 3 worn on the left ear may be an electric wire, radio wave, living body, or the like, and is not particularly limited. In the case of an electric wire, the communication ICs 7 and 27 need not be provided.
設定部１０には、右側マイクロホン５と左側マイクロホン２５に対し、音の監視方向の組合せを同じに設定する。また、設定部１０には、音の監視方向の組合せが複数記憶されている。音の監視方向の組合せとは、例えば上述の水平面上４５度間隔の８方向、水平面上前方側１８０度に対して３０度間隔の７方向、ｘｙｚ空間で各軸とｙ＝±ｘ，ｚ＝±ｘ，ｚ＝±ｙ上の正方向および逆方向の１８方向、任意に決めた複数の方向などである。なお、細かく多くの方向を設定しておけば、音声の監視方向の推定精度は上がるが、処理が重くなる。 In the setting unit 10, the same combination of sound monitoring directions is set for the right microphone 5 and the left microphone 25. The setting unit 10 stores a plurality of combinations of sound monitoring directions. The combination of sound monitoring directions is, for example, eight directions with 45 degree intervals on the horizontal plane, seven directions with 30 degree intervals with respect to 180 degrees on the front side on the horizontal plane, and each axis in the xyz space and y = ± x, z = 18 directions in the forward and reverse directions on ± x, z = ± y, a plurality of arbitrarily determined directions, and the like. Note that if many directions are set in detail, the estimation accuracy of the voice monitoring direction increases, but the processing becomes heavy.
右側マイクロホン５と左側マイクロホン２５では、頭部伝達関数（ＨＲＴＦ）および頭部伝達関数（ＨＲＴＦ）の逆特性が異なるので、設定部１０には、左右の補聴器の音の監視方向の組合せを構成する各方向に対応する頭部伝達関数（ＨＲＴＦ）およびその逆特性が記憶されている。更に、設定部１０には、ローパスフィルタ用カットオフ周波数、音声到来方向判定用閾値及び最大選択個数が記憶されている。 The right microphone 5 and the left microphone 25 have different head-related transfer function (HRTF) and inverse characteristics of the head-related transfer function (HRTF). Therefore, the setting unit 10 forms a combination of sound monitoring directions of the left and right hearing aids. A head related transfer function (HRTF) corresponding to each direction and its inverse characteristic are stored. Further, the setting unit 10 stores a low-pass filter cutoff frequency, a voice arrival direction determination threshold value, and a maximum selection number.
切替スイッチ２１を操作することで、複数の音の監視方向の組合せから１つの音の監視方向の組合せを選択することができる。
ここでは、右側マイクロホン５と左側マイクロホン２５が、共に装用者の正面方向を基準に水平方向４５度間隔の８方向の同一方向の組合せを選択した場合について説明をする。
By operating the changeover switch 21, a combination of monitoring directions of one sound can be selected from a combination of monitoring directions of a plurality of sounds.
Here, a case will be described in which the right microphone 5 and the left microphone 25 both select a combination of eight directions in the horizontal direction at 45 ° intervals based on the front direction of the wearer.
切替スイッチ２１の操作により音の監視方向の組合せが選択されると、設定部１０に記憶されている頭部伝達関数（ＨＲＴＦ）がＨＲＴＦ処理部１６に設定され、同じく設定部１０に記憶されている頭部伝達関数（ＨＲＴＦ）の逆特性が各方向信号成分抽出処理部１１に設定され、同じく設定部１０に記憶されているローパスフィルタ用カットオフ周波数がローパスフィルタ部１３に設定され、同じく設定部１０に記憶されている音声到来方向判定用閾値と最大選択個数が音声到来方向判定部１５に設定される。 When a combination of sound monitoring directions is selected by operating the changeover switch 21, the head related transfer function (HRTF) stored in the setting unit 10 is set in the HRTF processing unit 16 and is also stored in the setting unit 10. The inverse characteristic of the head related transfer function (HRTF) is set in each direction signal component extraction processing unit 11, and the low-pass filter cutoff frequency stored in the setting unit 10 is set in the low-pass filter unit 13. The voice arrival direction determination threshold and the maximum number of selections stored in the unit 10 are set in the voice arrival direction determination unit 15.
また、左側補聴器３に関する設定情報は、通信用ＩＣ７，２７を介して左側補聴器３に送られる。そして、設定部１０に記憶されている頭部伝達関数（ＨＲＴＦ）がＨＲＴＦ処理部３６に設定され、同じく設定部１０に記憶されている頭部伝達関数（ＨＲＴＦ）の逆特性が各方向信号成分抽出処理部３１に設定され、同じく設定部１０に記憶されているローパスフィルタ用カットオフ周波数がローパスフィルタ部３３に設定される。 In addition, setting information regarding the left hearing aid 3 is sent to the left hearing aid 3 via the communication ICs 7 and 27. Then, the head related transfer function (HRTF) stored in the setting unit 10 is set in the HRTF processing unit 36, and the inverse characteristics of the head related transfer function (HRTF) stored in the setting unit 10 are each directional signal component. The low-pass filter cutoff frequency set in the extraction processing unit 31 and also stored in the setting unit 10 is set in the low-pass filter unit 33.
右側マイクロホン５の出力信号が各方向信号成分抽出処理部１１に入力されると、各方向信号成分抽出処理部１１では、右側マイクロホン５の出力信号に８方向の頭部伝達関数（ＨＲＴＦ）の逆特性を畳み込み、８方向の信号成分を算出し、８方向の信号成分をエンベロープ算出部１２とＨＲＴＦ処理部１６へ出力する。
ＨＲＴＦ処理部１６では、各方向信号成分抽出処理部１１が出力した各方向の信号成分に頭部伝達関数を畳み込み、その演算結果を合成部１７へ出力する。
When the output signal of the right microphone 5 is input to each direction signal component extraction processing unit 11, the direction signal component extraction processing unit 11 converts the output signal of the right microphone 5 to the inverse of the head transfer function (HRTF) in eight directions. The characteristics are convolved, signal components in eight directions are calculated, and signal components in eight directions are output to the envelope calculating unit 12 and the HRTF processing unit 16.
The HRTF processing unit 16 convolves the head-related transfer function with the signal component in each direction output from each direction signal component extraction processing unit 11 and outputs the calculation result to the synthesis unit 17.
エンベロープ算出部１２では、各方向信号成分抽出処理部１１が出力した信号成分のエンベロープを算出し、ローパスフィルタ部１３へ出力する。ローパスフィルタ部１３では、エンベロープ算出部１２が出力した信号成分のエンベロープについて設定されたカットオフ周波数（例えば、４Ｈｚ）で高周波数成分を除去し、変調度合算出部１４へ出力する。変調度合算出部１４では、ローパスフィルタ部１３が出力した信号成分の変調度合を算出し、音声到来方向判定部１５へ出力する。 The envelope calculation unit 12 calculates the envelope of the signal component output from each direction signal component extraction processing unit 11 and outputs the envelope to the low-pass filter unit 13. The low-pass filter unit 13 removes a high frequency component at a cutoff frequency (for example, 4 Hz) set for the envelope of the signal component output from the envelope calculation unit 12 and outputs the high frequency component to the modulation degree calculation unit 14. The modulation degree calculation unit 14 calculates the modulation degree of the signal component output by the low-pass filter unit 13 and outputs it to the voice arrival direction determination unit 15.
また、左側マイクロホン２５の出力信号が各方向信号成分抽出処理部３１に入力されると、各方向信号成分抽出処理部３１では、左側マイクロホン２５の出力信号に８方向の頭部伝達関数（ＨＲＴＦ）の逆特性を畳み込み、８方向の信号成分を算出し、８方向の信号成分をエンベロープ算出部３２とＨＲＴＦ処理部３６へ出力する。ＨＲＴＦ処理部３６では、各方向信号成分抽出処理部３１が出力した各方向の信号成分に頭部伝達関数を畳み込み、その演算結果を合成部３７へ出力する。 When the output signal of the left microphone 25 is input to each direction signal component extraction processing unit 31, the direction signal component extraction processing unit 31 converts the head signal transfer function (HRTF) in eight directions to the output signal of the left microphone 25. The signal characteristics in the eight directions are calculated, and the signal components in the eight directions are output to the envelope calculating unit 32 and the HRTF processing unit 36. The HRTF processing unit 36 convolves the head-related transfer function with the signal component in each direction output from each direction signal component extraction processing unit 31, and outputs the calculation result to the synthesis unit 37.
エンベロープ算出部３２では、各方向信号成分抽出処理部３１が出力した信号成分のエンベロープを算出し、ローパスフィルタ部３３へ出力する。ローパスフィルタ部３３では、エンベロープ算出部３２が出力した信号成分のエンベロープについて設定されたカットオフ周波数（例えば、４Ｈｚ）で高周波数成分を除去し、変調度合判定部３４へ出力する。変調度合算出部３４では、ローパスフィルタ部３３が出力した信号成分の変調度合を算出し、通信用ＩＣ２７を介して右側補聴器２の音声到来方向判定部１５へ出力する。 The envelope calculation unit 32 calculates the envelope of the signal component output by each direction signal component extraction processing unit 31 and outputs the envelope to the low-pass filter unit 33. The low pass filter unit 33 removes the high frequency component at the cutoff frequency (for example, 4 Hz) set for the envelope of the signal component output by the envelope calculation unit 32 and outputs the high frequency component to the modulation degree determination unit 34. The modulation degree calculation unit 34 calculates the modulation degree of the signal component output from the low-pass filter unit 33 and outputs the modulation degree to the voice arrival direction determination unit 15 of the right hearing aid 2 via the communication IC 27.
音声到来方向判定部１５では、変調度合算出部１４，３４が出力した左右の変調度合について同方向の変調度合の差分を算出し、その差分値が設定された音声到来方向判定用閾値より小さい方向の差分値について小さいほうから設定された最大選択個数だけ選択し、その差分値の方向を合成部１７へ出力する。この方向が推定された音声の到来方向である。左側補聴器３には、音声到来方向判定部１５から通信用ＩＣ７，２７を介して合成部３７へ出力する。 The voice arrival direction determination unit 15 calculates the difference between the modulation degrees in the same direction for the left and right modulation degrees output by the modulation degree calculation units 14 and 34, and the difference value is smaller than the set voice arrival direction determination threshold. Are selected from the smaller ones, and the direction of the difference value is output to the combining unit 17. This direction is the estimated voice arrival direction. The left hearing aid 3 outputs the voice arrival direction determination unit 15 to the synthesis unit 37 via the communication ICs 7 and 27.
合成部１７，３７では、ＨＲＴＦ処理部１６，３６が出力した信号に対して、音声強調する場合は音声到来方向判定部１５が出力した方向について所定の振幅調整処理をしてマイクロホン５，２５の出力信号に同期させて加算する。雑音抑制をする場合は、ＨＲＴＦ処理部１６，３６が出力した信号に対して、音声到来方向判定部１５が出力した方向以外について所定の増幅処理をしてマイクロホン５，２５の出力信号から同期させて減算する。音声強調とノイズ抑制は、両方してもいいし、どちらか一方でもよい。 In the synthesizing units 17 and 37, when the speech is emphasized with respect to the signals output from the HRTF processing units 16 and 36, a predetermined amplitude adjustment process is performed in the direction output from the voice arrival direction determination unit 15 to perform the microphones 5 and 25. Add in synchronization with the output signal. When noise suppression is performed, the signals output from the HRTF processing units 16 and 36 are subjected to predetermined amplification processing in the direction other than the direction output from the voice arrival direction determination unit 15 and are synchronized with the output signals of the microphones 5 and 25. Subtract. Both voice enhancement and noise suppression may be performed, or one of them may be performed.
補聴処理部１８，３８では、合成部１７，３７から出力された信号に対し、装用者の聞こえの具合に合わせて、周波数および音圧ごとの増幅処理、ハウリング抑制、出力制限などの信号処理をする。補聴処理部１８，３８には、装用者の聞こえの具合に合わせた信号処理をするためのパラメータが記憶されている。補聴処理部１８，３８で信号処理された信号は、イヤホン８，２８へ出力され、イヤホン８，２８で音圧に変換されて出力される。 The hearing aid processing units 18 and 38 perform signal processing such as amplification processing for each frequency and sound pressure, howling suppression, and output restriction on the signals output from the synthesis units 17 and 37 in accordance with the degree of hearing of the wearer. To do. The hearing aid processing units 18 and 38 store parameters for signal processing in accordance with the degree of hearing of the wearer. The signals processed by the hearing aid processing units 18 and 38 are output to the earphones 8 and 28, converted into sound pressure by the earphones 8 and 28, and output.
設定部１０に記憶されている音の監視方向の組合せ、各方向の頭部伝達関数（ＨＲＴＦ）、ＨＲＴＦ逆特性およびローパスフィルタ用カットオフ周波数、音声到来方向判定用閾値及び最大選択個数と、補聴処理部１８，３８に記憶されているパラメータは、パーソナルコンピュータを補聴器２，３に接続して書き換え可能にすることもできる。 Combination of sound monitoring directions stored in setting unit 10, head related transfer function (HRTF) in each direction, HRTF inverse characteristics and low-pass filter cutoff frequency, threshold value for voice arrival direction determination and maximum number of selections, and hearing aid Parameters stored in the processing units 18 and 38 can be rewritten by connecting a personal computer to the hearing aids 2 and 3.
また、装用者の聞こえの状態に合わせて両耳でのバランスをとる両耳バランス処理部（不図示）を設ければ、頭部伝達関数（ＨＲＴＦ）での推定誤差によるアンバランス感を抑制することができる。 In addition, if a binaural balance processing unit (not shown) that balances both ears according to the hearing state of the wearer is provided, an unbalanced feeling due to an estimation error in the head related transfer function (HRTF) is suppressed. be able to.
以上のように、本発明に係る補聴システムは、各補聴器２，３のマイクロホン５，２５の出力信号から頭部伝達関数（ＨＲＴＦ）を用いて予め設定しておいた各方向より到来する音を推定し、この推定した各方向の音が音声で且つ左右のマイクロホン５，２５の出力信号のエンベロープの低周波成分の変調度合の差が所定の値より小さい音を強調することにより、複数の方向から音声が到達しても、音声が到来する複数方向に対して音声を強調することができ、複数の方向から雑音が到達しても、雑音が到来する複数方向に対して雑音を抑制することができる。 As described above, the hearing aid system according to the present invention receives sounds coming from the respective directions set in advance using the head-related transfer function (HRTF) from the output signals of the microphones 5 and 25 of the hearing aids 2 and 3. The sound in each direction thus estimated is a voice, and the sound in which the difference in the modulation degree of the low frequency component of the envelope of the output signals of the left and right microphones 5 and 25 is smaller than a predetermined value is emphasized. Even if the voice arrives from, the voice can be emphasized in multiple directions from which the voice arrives, and even if the noise arrives from multiple directions, the noise is suppressed in the multiple directions from which the noise comes Can do.
本発明によれば、複数の方向から音声が到達しても、複数方向に対して音声を強調することができ、また複数の方向から雑音が到達しても、複数方向に対して雑音を抑制することができる補聴システムを提供することができる。 According to the present invention, even when sound arrives from a plurality of directions, the sound can be emphasized in a plurality of directions, and even when noise arrives from a plurality of directions, the noise is suppressed in a plurality of directions. A hearing aid system can be provided.
２…右側補聴器、３…左側補聴器、５，２５…マイクロホン、６，２６…ＤＳＰ（処理手段）、７，２７…通信用ＩＣ、８，２８…イヤホン、１０…設定部、１１，３１…各方向信号成分抽出処理部、１２，３２…エンベロープ算出部、１３，３３…ローパスフィルタ部、１４，３４…変調度合算出部、１５…音声到来方向判定部、１６，３６…ＨＲＴＦ処理部、１７，３７…合成部、１８，３８…補聴処理部、１９，２９…送信部、２０，３０…受信部、２１…切替スイッチ。 2 ... right hearing aid, 3 ... left hearing aid, 5, 25 ... microphone, 6, 26 ... DSP (processing means), 7, 27 ... communication IC, 8, 28 ... earphone, 10 ... setting unit, 11, 31 ... each Direction signal component extraction processing unit, 12, 32 ... envelope calculation unit, 13, 33 ... low pass filter unit, 14, 34 ... modulation degree calculation unit, 15 ... voice arrival direction determination unit, 16, 36 ... HRTF processing unit, 17, 37... Synthesizer, 18, 38 .. Hearing Aid Processor, 19, 29... Transmitter, 20, 30.
Claims (2)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009011748A JP5246700B2 (en) | 2009-01-22 | 2009-01-22 | Hearing aid system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009011748A JP5246700B2 (en) | 2009-01-22 | 2009-01-22 | Hearing aid system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2010171688A JP2010171688A (en) | 2010-08-05 |
| JP5246700B2 true JP5246700B2 (en) | 2013-07-24 |
Family
ID=42703386
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2009011748A Active JP5246700B2 (en) | 2009-01-22 | 2009-01-22 | Hearing aid system |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP5246700B2 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10397710B2 (en) * | 2015-12-18 | 2019-08-27 | Cochlear Limited | Neutralizing the effect of a medical device location |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000059893A (en) * | 1998-08-06 | 2000-02-25 | Nippon Hoso Kyokai <Nhk> | Hearing aid device and its method |
| JP3933909B2 (en) * | 2001-10-29 | 2007-06-20 | 日本放送協会 | Voice / music mixture ratio estimation apparatus and audio apparatus using the same |
| DK1320281T3 (en) * | 2003-03-07 | 2013-11-04 | Phonak Ag | Binaural hearing aid and method for controlling such a hearing aid |
| JP4126025B2 (en) * | 2004-03-16 | 2008-07-30 | 松下電器産業株式会社 | Sound processing apparatus, sound processing method, and sound processing program |
| JP4543014B2 (en) * | 2006-06-19 | 2010-09-15 | リオン株式会社 | Hearing device |
-
2009
- 2009-01-22 JP JP2009011748A patent/JP5246700B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| JP2010171688A (en) | 2010-08-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10431239B2 (en) | Hearing system | |
| CN106937196B (en) | Hearing device | |
| US9681246B2 (en) | Bionic hearing headset | |
| US8526647B2 (en) | Listening device providing enhanced localization cues, its use and a method | |
| DK2629551T3 (en) | Binaural hearing aid system | |
| EP3833041B1 (en) | Earphone signal processing method and system, and earphone | |
| US20100002886A1 (en) | Hearing system and method implementing binaural noise reduction preserving interaural transfer functions | |
| US9432778B2 (en) | Hearing aid with improved localization of a monaural signal source | |
| US11438713B2 (en) | Binaural hearing system with localization of sound sources | |
| AU2016201028A1 (en) | Signal enhancement using wireless streaming | |
| US9516431B2 (en) | Spatial enhancement mode for hearing aids | |
| JP2014230280A (en) | Hearing aid with improved localization | |
| WO2008045476A2 (en) | System and method for utilizing omni-directional microphones for speech enhancement | |
| US7340073B2 (en) | Hearing aid and operating method with switching among different directional characteristics | |
| US20040258249A1 (en) | Method for operating a hearing aid device and hearing aid device with a microphone system in which different directional characteristics can be set | |
| EP2928213B1 (en) | A hearing aid with improved localization of a monaural signal source | |
| US20100046775A1 (en) | Method for operating a hearing apparatus with directional effect and an associated hearing apparatus | |
| JP5246700B2 (en) | Hearing aid system | |
| JP6568471B2 (en) | Hearing apparatus with sound source localization and associated method | |
| US20070127750A1 (en) | Hearing device with virtual sound source | |
| JP2000261894A (en) | Hearing aid with noise suppressing function | |
| EP3955594B1 (en) | Feedback control using a correlation measure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20111207 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20121126 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20121204 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20130111 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20130326 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20130403 |
|
| R150 | Certificate of patent or registration of utility model |
Free format text: JAPANESE INTERMEDIATE CODE: R150 Ref document number: 5246700 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20160419 Year of fee payment: 3 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
| R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |