JPS6364223B2 - - Google Patents
Info
- Publication number
- JPS6364223B2 JPS6364223B2 JP55053362A JP5336280A JPS6364223B2 JP S6364223 B2 JPS6364223 B2 JP S6364223B2 JP 55053362 A JP55053362 A JP 55053362A JP 5336280 A JP5336280 A JP 5336280A JP S6364223 B2 JPS6364223 B2 JP S6364223B2
- Authority
- JP
- Japan
- Prior art keywords
- output
- tactile
- converter
- spectral bands
- low
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired
Links
- 230000000638 stimulation Effects 0.000 claims description 16
- 230000003595 spectral effect Effects 0.000 claims description 13
- 208000032041 Hearing impaired Diseases 0.000 claims description 7
- 239000011159 matrix material Substances 0.000 claims description 5
- 230000005236 sound signal Effects 0.000 claims description 3
- 230000035807 sensation Effects 0.000 claims 1
- 238000000034 method Methods 0.000 description 3
- 230000015541 sensory perception of touch Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Description
【発明の詳細な説明】
本発明は、補聴器をもつてしても音情報を得る
ことができない聴覚障害者に触覚によつて音情報
を伝達する音声表示装置に関するものである。DETAILED DESCRIPTION OF THE INVENTION The present invention relates to an audio display device that transmits sound information through the sense of touch to a hearing-impaired person who is unable to obtain sound information even with a hearing aid.
聴覚障害者のために話し言葉や警報を伝達する
方法としては、それらを文字や波形パターンに変
換し、視覚や触覚を利用して代替提示する方法が
考えられる。例えば、音声認識の手法を用いて認
識結果を文字列の信号とすれば、ブラウン管等の
表示装置にそれらの文字列を表示することができ
るが、この場合には装置が高価で聴覚障害者個人
がそれを所有するには無理がある。また、音声の
特徴をパターンとしてブラウン管等に表示した
り、触覚的に呈示することもできるが、このよう
にして聴覚障害者の視覚を表示の読取りのために
占有することは、話者の唇や手の動きにより伝え
られる情報が無視されることになり、そのため障
害者の触覚を利用して音声を呈示する方式が最も
望ましい。 One possible method for transmitting spoken words and warnings for the hearing-impaired is to convert them into letters or waveform patterns and present them alternatively using visual or tactile senses. For example, if the recognition result is converted into a character string signal using a voice recognition method, those character strings can be displayed on a display device such as a cathode ray tube, but in this case, the device is expensive and cannot be used by hearing-impaired people. It is impossible for someone to own it. It is also possible to display the characteristics of the voice as a pattern on a cathode ray tube, etc., or to present it tactilely. Therefore, the most desirable method is to present audio using the tactile sense of the disabled person.
このように音声を触覚を通じて呈示する触覚表
示装置としては、従来、入力された音情報をいく
つかの周波数帯域に分割し、それぞれの周波数帯
域に対応する触振動素子を設け、各周波数帯域の
出力に基づいてその触振動素子を駆動することに
より音声の特徴を表示し、この表示を時間的に左
から右へ流すようにしたものが知られている。 Conventionally, tactile display devices that present sound through the sense of touch divide the input sound information into several frequency bands, provide tactile vibration elements corresponding to each frequency band, and output the output of each frequency band. There is a known system in which the characteristics of the sound are displayed by driving the tactile vibration element based on the tactile vibration element, and the display is displayed temporally from left to right.
しかしながら、この装置では、音声中の母音の
特徴を表示、認識させることができても、子音の
ような高域成分を含む音声を認識させることは困
難とされている。 However, although this device can display and recognize the characteristics of vowels in speech, it is difficult to recognize speech containing high-frequency components such as consonants.
また、触覚の心理物理特性によると、一般に時
間的空間的に変化する情報は知覚され易いという
特徴がある。 Furthermore, according to the psychophysical characteristics of the sense of touch, information that changes temporally and spatially is generally easy to perceive.
叙上に鑑み、本発明においては、聴覚障害者に
対して音情報を触覚情報として与えるに際し、そ
の音情報を三つの周波数帯域に分割し、中、低域
成分を２次元空間内の位置信号として用いると共
に、従来認識が困難であつた高域成分を表示の制
御信号として用い、これによつて２次元平面上に
上記三つの周波数帯域における音声エネルギの特
徴に応じて時間的空間的に変動するパターンを呈
示すると共に、子音の特徴を強調的に呈示できる
ようにした点を特徴とするものである。 In view of the above, in the present invention, when providing sound information as tactile information to a hearing-impaired person, the sound information is divided into three frequency bands, and the middle and low frequency components are converted into position signals in a two-dimensional space. In addition, the high-frequency component, which has been difficult to recognize in the past, is used as a display control signal, and this allows temporal and spatial fluctuations to be displayed on a two-dimensional plane according to the characteristics of the audio energy in the three frequency bands mentioned above. This system is characterized by the fact that it is able to present a pattern that emphasizes consonants, as well as emphatically display the characteristics of consonants.
以下、図面を参照して本発明の実施例について
詳述する。 Embodiments of the present invention will be described in detail below with reference to the drawings.
第１図は本発明に係る音声表示装置の構成を示
すもので、話者の話し言葉や警報等は、まずマイ
クロフオン１によつて電気的音声信号に変換さ
れ、アンプ２を経て周波数帯域フイルタ３に送ら
れる。この周波数帯域フイルタ３は、音信号を低
域、中域、高域の三つのスペクトル帯域F1，F2，
F3に分割し、それぞれのスペクトル帯域ごとに
フイルタ出力を得るものである。 FIG. 1 shows the configuration of an audio display device according to the present invention. Words spoken by a speaker, alarms, etc. are first converted into electrical audio signals by a microphone 1, and then passed through an amplifier 2 to a frequency band filter 3. sent to. This frequency band filter 3 divides the sound signal into three spectral bands F 1 , F 2 ,
The signal is divided into F3 and a filter output is obtained for each spectral band.
そして、上記各スペクトル帯域におけるフイル
タ出力は、それらに接続した変換器４ａ，４ｂ，
４ｃに送られて、上記三つのスペクトル帯域にお
ける出力がそれぞれのエネルギーレベルに対応し
た電圧に変換され、これらの変換器出力が触覚マ
トリツクス板５上に配列されたｍ×ｎ個のマトリ
ツクス状の触覚刺激素子６の選択動作及びその駆
動の制御に用いられる。 Then, the filter output in each of the above spectrum bands is transmitted to the converters 4a, 4b connected to them.
4c, the outputs in the three spectral bands are converted into voltages corresponding to their respective energy levels, and these converter outputs are sent to the m x n matrix of tactile sensors arranged on the tactile matrix plate 5. It is used to control the selection operation and drive of the stimulation element 6.
即ち、低域のスペクトル帯域に対応する変換器
出力Ｘは、ウインドコンパレータやＡ―Ｄ変換器
等からなる選択回路７ａに送られて、変換器４ａ
の出力Ｘの大きさに応じた数段階の出力電圧に変
換されると同時に、その出力電圧の大きさに応じ
て縦方向に配列したｎ行の触覚刺激素子に対応せ
しめられ、また中域のスペクトル帯域に対応する
変換器出力Ｙは、同様の構成を有する選択回路７
ｂに送られて、変換器４ｂの出力Ｙの大きさに応
じた数段階の出力電圧に変換されると同時に、そ
の出力電圧の大きさに応じて横方向に配列したｍ
行の触覚刺激素子に対応せしめられ、而して、こ
れら二つの変換器出力に対応する触覚刺激素子の
行と列との交点に位置する素子が選択されて、動
作可能な状態に保持される。 That is, the converter output X corresponding to the low spectral band is sent to the selection circuit 7a consisting of a window comparator, an AD converter, etc., and is sent to the converter 4a.
At the same time, the output voltage is converted into several levels of output voltage according to the magnitude of the output The converter output Y corresponding to the spectral band is selected by a selection circuit 7 having a similar configuration.
b, and is converted into several levels of output voltage according to the magnitude of the output Y of the converter 4b.
The element corresponding to the row of tactile stimulation elements and thus located at the intersection of the row and column of tactile stimulation elements corresponding to these two transducer outputs is selected and held in an operable state. .
従つて、例えば低域及び中域のスペクトル帯域
の変換器からそれぞれX2及びY4に対応する出力
があつたときには、図示の・印の触覚刺激素子が
動作可能状態に保たれる。この場合、各変換器か
らの出力Ｘ及びＹは同時に複数の列及び行に対応
することがなく、そのため同一時間内において動
作可能状態に保持される触覚刺激素子は必ず一個
となる。 Therefore, for example, when outputs corresponding to X 2 and Y 4 are received from the low and mid spectral band transducers, respectively, the tactile stimulation elements shown are kept in an operable state. In this case, the outputs X and Y from each transducer do not correspond to more than one column and row at the same time, so that only one tactile stimulation element is kept in operation at the same time.
一方、高域のスペクトル帯域F3の変換器出力
Ｚは、これを強度制御回路８においてその出力に
応じた制御信号とし、上記動作可能状態にある触
覚刺激素子６の駆動の強度を制御させる。従つ
て、上述したように・印の触覚刺激素子が動作可
能状態にあつて、そのときの高域スペクトル帯域
の変換器出力が大きいときには、・印の触覚刺激
素子によつて強い電気刺激または振動子の強い振
動等が聴覚障害者に伝達される。 On the other hand, the converter output Z in the high spectral band F 3 is used as a control signal in accordance with the output in the intensity control circuit 8 to control the driving intensity of the tactile stimulation element 6 in the operable state. Therefore, as mentioned above, when the tactile stimulation element marked is in the operable state and the transducer output in the high spectral band is large at that time, strong electrical stimulation or vibration is generated by the tactile stimulation element marked. Strong vibrations from children are transmitted to hearing-impaired people.
このような構成を有する音声表示装置によれ
ば、音声中の三つの周波数帯域のエネルギに基づ
く音情報を常に単一の触覚刺激素子により極めて
知覚し易い状態で２次元表示することができ、聴
覚障害者に音声情報を呈示するために有効に利用
できるばかりでなく、聴覚障害者らが自分の音声
を正常者のものと比較しながら発声を学習、訓練
する場合などにも有効に利用することができる。 According to the audio display device having such a configuration, the sound information based on the energy of the three frequency bands in the audio can be displayed two-dimensionally in a highly perceptible state using a single tactile stimulation element, and the auditory sense Not only can it be used effectively to present audio information to people with disabilities, but it can also be used effectively when hearing-impaired people learn and train their vocalizations by comparing their own voices with those of normal people. I can do it.
以上に詳述したように、本発明の音声表示装置
によれば、触覚刺激素子により音情報をその特徴
に応じて時間的空間的に変動するパターンとして
２次元平面上に極めて知覚し易い状態で呈示でき
るばかりでなく、簡単に構成によつて同一時間内
における上記触覚刺激素子による表示を最も知覚
し易い一点表示とすることができ、しかも従来の
装置は認識が困難であつた高域成分即ち子音の特
徴を強調的に呈示することができる。 As described in detail above, according to the audio display device of the present invention, the tactile stimulation element allows sound information to be extremely easily perceived on a two-dimensional plane as a pattern that varies temporally and spatially according to its characteristics. Not only can the display be easily configured, but the display by the tactile stimulation element within the same time can be made into a single point display that is most easily perceived. It is possible to emphasize the characteristics of consonants.
第１図は本発明の実施例のブロツク構成図であ
る。
１…マイクロフオン、３…周波数帯域フイル
タ、４ａ，４ｂ，４ｃ…変換器、５…触覚マトリ
ツクス板、６…触覚刺激素子。
FIG. 1 is a block diagram of an embodiment of the present invention. DESCRIPTION OF SYMBOLS 1... Microphone, 3... Frequency band filter, 4a, 4b, 4c... Transducer, 5... Tactile matrix board, 6... Tactile stimulation element.
Claims (1)
オンに、その信号を低域、中域、高域の三つのス
ペクトル帯域に分割してフイルタ出力を得る周波
数帯域フイルタを接続すると共に、該フイルタ
に、上記三つのスペクトル帯域における出力をそ
れぞれのエネルギーレベルに対応した電圧に変換
する変換器を接続し、低域及び中域のスペクトル
帯域の変換器に、その出力を段階的な出力電圧と
して、触覚刺激素子がマトリツクス状に配列され
た触覚マトリツクス板における縦横の触覚刺激素
子列にその出力電圧に応じて対応させる選択回路
を、また、高域のスペクトル帯域の変換器に、そ
の出力を制御信号として、上記低域及び中域のス
ペクトル帯域の変換器出力によつて選択された触
覚刺激素子の駆動の強度を制御する強度制御回路
を接続したことを特徴とする聴覚障害者用音声表
示装置。1. A frequency band filter is connected to a microphone that converts sound information into an electrical sound signal, and a frequency band filter is connected to the microphone to obtain a filter output by dividing the signal into three spectral bands: low, middle, and high. , connect a converter that converts the output in the three spectral bands mentioned above into a voltage corresponding to each energy level, and connect the output to the converter in the low and middle spectral bands as a stepwise output voltage to generate a tactile sensation. A selection circuit is provided that corresponds to the vertical and horizontal tactile stimulation element rows in a tactile matrix board in which stimulation elements are arranged in a matrix according to their output voltages, and the output is used as a control signal for a high-frequency spectral band converter. An audio display device for hearing-impaired persons, characterized in that an intensity control circuit is connected thereto for controlling the driving intensity of the tactile stimulation element selected by the output of the converter in the low and middle spectral bands.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP5336280A JPS56148349A (en) | 1980-04-21 | 1980-04-21 | Voice annunciator for auditory physically handicapped person |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP5336280A JPS56148349A (en) | 1980-04-21 | 1980-04-21 | Voice annunciator for auditory physically handicapped person |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPS56148349A JPS56148349A (en) | 1981-11-17 |
| JPS6364223B2 true JPS6364223B2 (en) | 1988-12-09 |
Family
ID=12940689
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP5336280A Granted JPS56148349A (en) | 1980-04-21 | 1980-04-21 | Voice annunciator for auditory physically handicapped person |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JPS56148349A (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS612209U (en) * | 1984-06-07 | 1986-01-08 | 株式会社 モルテン | Dalbo attachment structure of partial denture |
| JPS612210U (en) * | 1984-06-11 | 1986-01-08 | 株式会社 モルテン | Dalbo attachment structure of partial denture |
| JPH0235723U (en) * | 1988-08-31 | 1990-03-08 |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS56139747A (en) * | 1980-04-02 | 1981-10-31 | Kogyo Gijutsuin | Voice annunciator for auditory handicapped person |
-
1980
- 1980-04-21 JP JP5336280A patent/JPS56148349A/en active Granted
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS56139747A (en) * | 1980-04-02 | 1981-10-31 | Kogyo Gijutsuin | Voice annunciator for auditory handicapped person |
Also Published As
| Publication number | Publication date |
|---|---|
| JPS56148349A (en) | 1981-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US4354064A (en) | Vibratory aid for presbycusis | |
| US4250637A (en) | Tactile aid to speech reception | |
| Warren | Quantification of loudness | |
| US20070041600A1 (en) | Electro-mechanical systems for enabling the hearing impaired and the visually impaired | |
| US4802228A (en) | Amplifier filter system for speech therapy | |
| Pickett et al. | Communication of speech sounds by a tactual vocoder | |
| US10334376B2 (en) | Hearing system with user-specific programming | |
| US8638208B2 (en) | Method for generating turn-signal sound of vehicle and device using the same | |
| Kringlebotn | Experiments with some visual and vibrotactile aids for the deaf | |
| JPS6364223B2 (en) | ||
| De Filippo | Laboratory projects in tactile aids to lipreading | |
| US6015224A (en) | Calculator | |
| US7236604B2 (en) | Hearing aid device | |
| JPS6333869B2 (en) | ||
| RU2312646C2 (en) | Apparatus for partial substitution of speaking and hearing functions | |
| EP0054078B1 (en) | Tactile aid to speech reception | |
| Cowan et al. | Speech perception studies using a multichannel electrotactile speech processor, residual hearing, and lipreading | |
| Boothroyd | A wearable tactile intonation display for the deaf | |
| Carney | Vibrotactile perception of segmental features of speech: A comparison of single-channel and multichannel instruments | |
| Samara et al. | A color recognition system for the visually impaired people | |
| JPH07261751A (en) | Conductor's baton operation display device for blind | |
| Wada et al. | Proposal and evaluation of the sweeping display of speech spectrum for a tactile vocoder used by the profoundly hearing impaired | |
| Balakrishnan et al. | Stereo image to stereo sound methods for vision based ETA | |
| US20220036751A1 (en) | A method and a device for providing a performance indication to a hearing and speech impaired person learning speaking skills | |
| CN111354247A (en) | Real-time communication system device for deaf-mute |