JPS6333869B2 - - Google Patents
Info
- Publication number
- JPS6333869B2 JPS6333869B2 JP55043111A JP4311180A JPS6333869B2 JP S6333869 B2 JPS6333869 B2 JP S6333869B2 JP 55043111 A JP55043111 A JP 55043111A JP 4311180 A JP4311180 A JP 4311180A JP S6333869 B2 JPS6333869 B2 JP S6333869B2
- Authority
- JP
- Japan
- Prior art keywords
- spectral
- tactile stimulation
- tactile
- large number
- spectral component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired
Links
- 230000003595 spectral effect Effects 0.000 claims description 29
- 230000000638 stimulation Effects 0.000 claims description 21
- 208000032041 Hearing impaired Diseases 0.000 claims description 8
- 239000011159 matrix material Substances 0.000 claims description 7
- 230000005236 sound signal Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 description 3
- 230000015541 sensory perception of touch Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Description
【発明の詳細な説明】
本発明は、補聴器をもつてしても音情報を得る
ことができない聴覚障害者に触覚によつて音情報
を伝達する音声表示装置に関するものである。DETAILED DESCRIPTION OF THE INVENTION The present invention relates to an audio display device that transmits sound information through the sense of touch to a hearing-impaired person who is unable to obtain sound information even with a hearing aid.
聴覚障害者のために話し言葉や警報を伝達する
方法としては、それらを文字や波形パターンに変
換し、視覚や触覚を利用して代替提示する方法が
考えられる。例えば、音声認識の手法を用いて認
識結果を文字列の信号とすれば、ブラウン管等の
表示装置にそれらの文字列を表示することができ
るが、この場合には装置が高価で聴覚障害者個人
がそれを所有するには無理がある。また、音声の
特徴をパターンとしてブラウン管等に表示した
り、触覚的に呈示することもできるが、このよう
にして聴覚障害者の視覚を表示の読取りのために
占有することは、話者の唇や手の動きにより伝え
られる情報が無視されることになり、そのため障
害者の触覚を利用して音声を呈示する方式が最も
望ましい。 One possible method for transmitting spoken words and warnings for the hearing-impaired is to convert them into letters or waveform patterns and present them alternatively using visual or tactile senses. For example, if the recognition result is converted into a character string signal using a voice recognition method, those character strings can be displayed on a display device such as a cathode ray tube, but in this case, the device is expensive and cannot be used by hearing-impaired people. It is impossible for someone to own it. It is also possible to display the characteristics of the voice as a pattern on a cathode ray tube, etc., or to present it tactilely. Therefore, the most desirable method is to present audio using the tactile sense of the disabled person.
このように音声を触覚を通じて呈示する触覚表
示装置としては、従来、入力された音情報をいく
つかの周波数帯域に分割し、それぞれの周波数帯
域に対応する触振動素子を設けて、各周波数帯域
の出力に基づいてその触振動素子を駆動すること
により音声の特徴を表示し、この表示を時間的に
左から右へ流すようにしたものが知られている。 Conventionally, tactile display devices that present audio through the sense of touch have divided input sound information into several frequency bands, provided tactile vibration elements corresponding to each frequency band, and used A device is known in which the characteristics of the sound are displayed by driving the tactile vibration element based on the output, and the display is made to flow temporally from left to right.
しかしながら、この装置では、音声中の母音の
特徴を表示、認識させることができても、子音の
ような高域成分を含む音声を認識させることは困
難とされている。 However, although this device can display and recognize the characteristics of vowels in speech, it is difficult to recognize speech containing high-frequency components such as consonants.
また、触覚の心理物理特性によると、一般に時
間的空間的に変化する情報は知覚され易いという
特徴がある。 Furthermore, according to the psychophysical characteristics of the sense of touch, information that changes temporally and spatially is generally easy to perceive.
叙上に鑑み、本発明においては、聴覚障害者に
対して音情報を触覚情報として与えるに際し、そ
の音情報を多数の周波数帯域に分割し、中、低域
成分を２次元空間内の位置信号として用いると共
に、従来認識が困難であつた高域成分を表示の制
御信号として用い、これによつて２次元平面上に
音声の特徴に応じて時間的空間的に変動するパタ
ーンを呈示すると共に、子音の特徴を強調的に呈
示できるようにした点を特徴とするものである。 In view of the above, in the present invention, when providing sound information as tactile information to a hearing-impaired person, the sound information is divided into a large number of frequency bands, and the middle and low frequency components are converted into position signals in a two-dimensional space. In addition, the high-frequency component, which has been difficult to recognize in the past, is used as a display control signal, thereby presenting a pattern that varies temporally and spatially according to the characteristics of the voice on a two-dimensional plane. It is characterized by the ability to emphasize the characteristics of consonants.
以下、図面を参照して本発明の実施例について
詳述する。 Embodiments of the present invention will be described in detail below with reference to the drawings.
第１図は本発明に係る音声表示装置の構成を示
すもので、話者の話し言葉や警報等は、まずマイ
クロフオン１によつて電気的音声信号に変換さ
れ、アンプ２を経て周波数帯域フイルタ３に送ら
れる。この周波数帯域フイルタ３は、音信号の低
域、中域、高域の三つのスペクトル帯域F1，F2，
F3のうちの低域及び中域のスペクトル帯域につ
いて多数のスペクトル成分群f11，f12，…f1n、及
びf21，f22，…，f2oに分割し、それぞれのスペク
トル帯域及びスペクトル成分群ごとにフイルタ出
力を得るものである。 FIG. 1 shows the configuration of an audio display device according to the present invention. Words spoken by a speaker, alarms, etc. are first converted into electrical audio signals by a microphone 1, and then passed through an amplifier 2 to a frequency band filter 3. sent to. This frequency band filter 3 has three spectral bands F 1 , F 2 ,
The low and middle spectral bands of F 3 are divided into a large number of spectral component groups f 11 , f 12 , ... f 1n , and f 21 , f 22 , ..., f 2o , and each spectral band and spectrum are A filter output is obtained for each component group.
上記周波数帯域フイルタ３において分割された
低域及び中域のスペクトル帯域における多数のス
ペクトル成分群は、ｍ×ｎ個の触覚刺激素子５，
５，…をマトリツクス状に配列した触覚マトリツ
クス板４における縦横の触覚刺激素子列に対応さ
せるが、図示の例ではその低域のスペクトル成分
群f11〜f1nを横方向に配列したｍ列の触覚刺激素
子に対応させ、中域のスペクトル成分群f21〜f2o
を縦方向に配列したｎ行の触覚刺激素子に対応さ
せている。而して、周波数帯域フイルタ３におい
て分割した各スペクトル成分の出力は、設定レベ
ルを調整可能な比較器６においてそれぞれ設定レ
ベルと比較し、その出力が設定レベル以上の場合
に得られる比較器出力に基づいて、ｍ列ｎ行の触
覚刺激素子を選択動作させる。即ち、低域のスペ
クトル成分群と中域のスペクトル成分群中で比較
器出力があつたスペクトル成分に対応する触覚刺
激素子の列と行の交点に位置する触覚刺激素子を
選択して動作させる。 A large number of spectral component groups in the low and middle spectral bands divided by the frequency band filter 3 are divided into m×n tactile stimulation elements 5,
5, ... correspond to vertical and horizontal tactile stimulation element rows on the tactile matrix plate 4 arranged in a matrix, but in the illustrated example, the low frequency spectral component groups f 11 to f 1n are arranged in m rows horizontally. Corresponding to the tactile stimulation element, the mid-range spectral component group f 21 ~ f 2o
corresponds to n rows of tactile stimulation elements arranged in the vertical direction. The output of each spectrum component divided by the frequency band filter 3 is compared with a set level in a comparator 6 whose set level is adjustable, and when the output is equal to or higher than the set level, the comparator output is determined. Based on this, the tactile stimulation elements in m columns and n rows are selectively operated. That is, the tactile stimulation element located at the intersection of the column and row of the tactile stimulation element corresponding to the spectral component with the comparator output among the low-range spectral component group and the middle-range spectral component group is selected and operated.
このような触覚刺激素子の選択動作のために
は、上記低域及び中域のスペクトル成分群f11〜
f1n及びf21〜f2oについての比較器出力を論理積回
路７に加えて、両スペクトル成分群の各比較器出
力について相互にアンドをとり、その論理積回路
７の出力に基づいて対応する触覚刺激素子５を動
作可能状態に保つ。 For such a selection operation of the tactile stimulation element, the above-mentioned low and middle range spectral component group f 11 ~
Add the comparator outputs for f 1n and f 21 to f 2o to the AND circuit 7, perform an AND operation on each comparator output for both spectral component groups, and take action based on the output of the AND circuit 7. The tactile stimulation element 5 is kept in an operable state.
従つて、例えば低域スペクトル成分のf13及び
中域スペクトル成分のf21，f24について比較器出
力があつたときには、それらの出力相互のアンド
出力によつて図示の・印の触覚刺激素子が動作可
能状態に保たれる。 Therefore, for example, when there is a comparator output for f 13 of the low-band spectral component and f 21 , f 24 of the mid-range spectral component, the tactile stimulation element shown in the figure is generated by the AND output of these outputs. kept in operational condition.
一方、高域のスペクトル帯域F3についても、
それを多数のスペクトル成分群に分割するが、そ
れらを再び一つの出力に合成し、これを強度制御
回路８においてその出力に応じた制御信号とし、
上記動作可能状態にある触覚刺激素子５の駆動の
強度を制御させる。従つて、上述したように・印
の触覚刺激素子が動作可能状態にあつて、そのと
きの高域のスペクトル帯域の出力が大きいときに
は、・印の触覚刺激素子によつて強い電気刺激ま
たは振動子の強い振動等が聴覚障害者に伝達され
る。 On the other hand, regarding the high spectral band F3 ,
It is divided into a large number of spectral component groups, which are again combined into one output, which is used as a control signal in accordance with the output in the intensity control circuit 8,
The driving intensity of the tactile stimulation element 5 in the operable state is controlled. Therefore, as mentioned above, when the tactile stimulation element marked with the mark is in an operable state and the output in the high spectral band is large at that time, the tactile stimulation element marked with the mark produces strong electrical stimulation or a vibrator. strong vibrations, etc. are transmitted to hearing-impaired people.
このような構成を有する音声表示装置によれ
ば、音情報を触覚マトリツクス板上に極めて知覚
し易い状態で２次元表示することができ、聴覚障
害者に音声情報を呈示するために有効に利用でき
るばかりでなく、聴覚障害者らが自分の音声を正
常者のものと比較しながら発声を学習、訓練する
場合などにも有効に利用することができる。 According to the audio display device having such a configuration, audio information can be displayed two-dimensionally on the tactile matrix board in a highly perceptible state, and can be effectively used to present audio information to hearing-impaired people. It can also be effectively used by hearing-impaired people to learn and train their vocalizations by comparing their own voices with those of normal people.
以上に詳述したように、本発明の音声表示装置
によれば、音情報をその特徴に応じて時間的空間
的に変動するパターンとして２次元平面上に極め
て知覚し易い状態で呈示でき、しかも従来の装置
では認識が困難であつた高域成分即ち子音の特徴
を強調的に呈示することができる。 As described in detail above, according to the audio display device of the present invention, it is possible to present sound information on a two-dimensional plane in a state that is extremely easy to perceive as a pattern that varies temporally and spatially according to its characteristics. It is possible to emphasize the high-frequency components, that is, the characteristics of consonants, which were difficult to recognize with conventional devices.
第１図は本発明の実施例のブロツク構成図であ
る。
１……マイクロフオン、３……周波数帯域フイ
ルタ、４……触覚マトリツクス板、５……触覚刺
激素子。
FIG. 1 is a block diagram of an embodiment of the present invention. 1... Microphone, 3... Frequency band filter, 4... Tactile matrix board, 5... Tactile stimulation element.
Claims (1)
オンに、その信号の低域、中域、高域の三つのス
ペクトル帯域のうちの低域及び中域のスペクトル
帯域について多数のスペクトル成分群に分割して
フイルタ出力を得る周波数帯域フイルタを接続
し、縦横にそれぞれ多数の触覚刺激素子をマトリ
ツクス状に配列した触覚マトリツクス板における
縦または横の一方の触覚刺激素子列に、上記低域
のスペクトル帯域における多数のスペクトル成分
群を対応させると共に、他方の触覚刺激素子列
に、中域のスペクトル帯域における多数のスペク
トル成分群を対応させ、上記触覚マトリツクス板
と周波数帯域フイルタとを、低域のスペクトル成
分群と中域のスペクトル成分群中でフイルタ出力
が設定レベル以上であつたスペクトル成分に対応
する縦及び横の触覚刺激素子列の交点に位置する
触覚刺激素子を選択的に動作可能に接続し、高域
のスペクトル帯域の出力を、低域及び中域のスペ
クトル成分の出力によつて選択的に動作せしめら
れる触覚刺激素子の駆動の強度を制御する制御信
号としたことを特徴とする聴覚障害者用音声表示
装置。1 A microphone that converts sound information into an electrical sound signal is divided into a large number of spectral component groups for the low, mid and high spectral bands of the signal. A frequency band filter is connected to obtain a filter output, and a frequency band filter is connected to one of the vertical or horizontal rows of tactile stimulation elements in a tactile matrix board in which a large number of tactile stimulation elements are arranged in a matrix in the vertical and horizontal directions. A large number of spectral component groups are made to correspond to each other, and a large number of spectral component groups in a mid-range spectral band are made to correspond to the other tactile stimulation element array, and the tactile matrix plate and the frequency band filter are made to correspond to a large number of spectral component groups in a low-range spectral band. The tactile stimulation elements located at the intersections of the vertical and horizontal tactile stimulation element rows corresponding to the spectral components whose filter outputs were equal to or higher than the set level among the spectral component group in the middle range are selectively and operably connected to for hearing-impaired persons, characterized in that the output of the spectral band in the range is used as a control signal for controlling the driving intensity of a tactile stimulation element that is selectively operated by the output of the spectral components in the low and middle ranges. Audio display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP4311180A JPS56139747A (en) | 1980-04-02 | 1980-04-02 | Voice annunciator for auditory handicapped person |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP4311180A JPS56139747A (en) | 1980-04-02 | 1980-04-02 | Voice annunciator for auditory handicapped person |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPS56139747A JPS56139747A (en) | 1981-10-31 |
| JPS6333869B2 true JPS6333869B2 (en) | 1988-07-07 |
Family
ID=12654711
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP4311180A Granted JPS56139747A (en) | 1980-04-02 | 1980-04-02 | Voice annunciator for auditory handicapped person |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JPS56139747A (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS56148349A (en) * | 1980-04-21 | 1981-11-17 | Kogyo Gijutsuin | Voice annunciator for auditory physically handicapped person |
| JP2000166962A (en) * | 1998-12-08 | 2000-06-20 | Tatsu Ifukube | Device and method for stimulating tactile sense |
-
1980
- 1980-04-02 JP JP4311180A patent/JPS56139747A/en active Granted
Also Published As
| Publication number | Publication date |
|---|---|
| JPS56139747A (en) | 1981-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US4641343A (en) | Real time speech formant analyzer and display | |
| US4354064A (en) | Vibratory aid for presbycusis | |
| US3800082A (en) | Auditory display for the blind | |
| US4834701A (en) | Apparatus for inducing frequency reduction in brain wave | |
| Rothenberg et al. | Vibrotactile frequency for encoding a speech parameter | |
| US4250637A (en) | Tactile aid to speech reception | |
| Warren | Quantification of loudness | |
| Lakatos | Recognition of complex auditory-spatial patterns | |
| US4802228A (en) | Amplifier filter system for speech therapy | |
| EP0055762B1 (en) | Sound pattern generator | |
| Geldard | Cutaneous coding of optical signals: The optohapt | |
| US10334376B2 (en) | Hearing system with user-specific programming | |
| US4368459A (en) | Educational apparatus and method for control of deaf individuals in a mixed teaching environment | |
| JPS6333869B2 (en) | ||
| US6015224A (en) | Calculator | |
| JPS6364223B2 (en) | ||
| RU2713984C1 (en) | Method of training people with hearing disorders of 1 to 4 degree and speech defects on oral-aural development simulator | |
| Brabyn | Developments in electronic aids for the blind and visually impaired | |
| WO2005087301A1 (en) | Dementia-preventing device and dementia-preventing method | |
| Richardson et al. | Sensory substitution and the design of an artificial ear | |
| Wada et al. | Development and evaluation of a tactile display for a tactile vocoder | |
| Carney | Vibrotactile perception of segmental features of speech: A comparison of single-channel and multichannel instruments | |
| Yoon et al. | Psychophysical experiment of vibrotactile pattern perception by human fingertip | |
| Samara et al. | A color recognition system for the visually impaired people | |
| GB2220089A (en) | Brain-wave-controlled computer interface |