JPS58180150A - Tactile perception vocoder - Google Patents
Tactile perception vocoderInfo
- Publication number
- JPS58180150A JPS58180150A JP57063942A JP6394282A JPS58180150A JP S58180150 A JPS58180150 A JP S58180150A JP 57063942 A JP57063942 A JP 57063942A JP 6394282 A JP6394282 A JP 6394282A JP S58180150 A JPS58180150 A JP S58180150A
- Authority
- JP
- Japan
- Prior art keywords
- tactile
- vocoder
- image
- present
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
(57)【要約】本公報は電子出願前の出願データであるた
め要約のデータは記録されません。(57) [Summary] This bulletin contains application data before electronic filing, so abstract data is not recorded.
Description
【発明の詳細な説明】
本発明は触知ボコーダに関する。更に詳しくは、発声に
伴う0厚の動きの如き物の形象を、生体皮膚面に刺激と
して与えることによって、@覚だけでは異聴の大きい音
声の詔識を触覚情報によって補助する触知ボコーダに関
する。DETAILED DESCRIPTION OF THE INVENTION The present invention relates to a tactile vocoder. More specifically, it relates to a tactile vocoder that uses tactile information to assist in the deciphering of voices that would be too audible to the senses alone by applying an image of an object such as zero-thickness movement that accompanies vocalization as a stimulus to the skin surface of a living body. .
従来、難聴者との対話の場合において音声情報と同時に
視覚情報を与えると、異聴の大きい音声の認識を助ける
効果があることが知られており、そのために例えば読屡
術の劇壇が行なわれている。Conventionally, it has been known that giving visual information at the same time as audio information when interacting with a hearing-impaired person has the effect of helping the recognition of sounds with a large degree of abnormal hearing. It is.
本発明者等は、かかる視覚情報の重要性にGみ、後述す
る「日展等の撮影装置」を昭和57年4月16日付で特
許出願し提案した。この装置を用いて口片情報を与える
手段としては、例えば学校の授業において小型テレビに
映しだすことが考えられる。しかし、当該手段で授業中
に小型テレビに鉄される口片情報に関する画像を見てい
ると、ノートをとることができないという間団がある。Recognizing the importance of such visual information, the present inventors filed a patent application on April 16, 1980, and proposed the "Nitten Photography Apparatus," which will be described later. One possible way to provide lip information using this device is to display it on a small television during a school class, for example. However, there are some cases where students are unable to take notes when they are watching images of information displayed on a small TV during class using this method.
そこで、このような問題を解決するものとして、本発明
者らは触知ボコーダを利用することを考えてみた。かか
る触知ボコーダとしては、例えば補聴器で受けた音声信
号を器械処理して触知板に伝達するように構成され、そ
の触知板2ごは圧電素子で作られた1g本の振動子が/
mmおきに/に列、3Iおきに3行配列されており、指
先の第1関節から上の指腹前で触れることができるよう
に構成されたもの等が知られている。この触知板に人差
指をあてて例えば「イJと発音すると指先の先端と約7
cm下の部位に分かれて鋭い振動が伝わってきて、その
音声を理解するものである。しかし、当該ボコーダはそ
の強く振動する成分、すなわちホルマントの位置と音と
の関係を前もって訓練によって覚えておかないと全く利
用できないという欠点があり、また該ボコーダの機種に
よってホルマントの位置と音声との関係が異なるなど、
規格が存在しないために、前記のように訓練をしても当
該提種以外のものには役立たないという欠点がある。Therefore, the present inventors considered using a tactile vocoder to solve such problems. Such a tactile vocoder is configured to process the audio signal received by a hearing aid and transmit it to a tactile plate, and the tactile plate 2 includes 1 g of transducers made of piezoelectric elements.
It is known that the fingers are arranged in columns every mm and three rows every 3I, and are configured so that they can be touched in front of the pads of the fingers above the first joint of the fingertips. For example, if you place your index finger on this tactile plate and pronounce ``I J,''
Sharp vibrations are transmitted to different parts of the body, and the sound can be understood. However, this vocoder has the disadvantage that it cannot be used at all unless the relationship between the position of the strongly vibrating component, that is, the formant, and the sound is memorized through training. Different relationships, etc.
Since there are no standards, training as described above has the disadvantage that it is of no use for anything other than the proposed species.
本発明はかかる欠点を解決するためになされたもので、
従来の触知ボコーダの如き困N性の伴う訓練を必要とせ
ず、簡単なに11練のみによって、聴覚だけでは異聴の
大きい音声のλH識を補助することができる触知ボコー
ダを提供することを目的とする。本発明のその他の目的
は、本明細書の以下の記述によって明らかにされる。The present invention has been made to solve these drawbacks.
To provide a tactile vocoder which does not require difficult training as in conventional tactile vocoders, and can assist the user in recognizing λH of a voice that is highly audible by hearing alone, with only 11 simple exercises. With the goal. Other objects of the invention will become apparent from the following description of the specification.
以下、本発明について図示する実施例に基づき説明する
。The present invention will be described below based on illustrated embodiments.
図は本発明の一実施例を示す使用状態図である。The figure is a usage state diagram showing an embodiment of the present invention.
図において、1は口唇等の撮影装置2に設けられる映像
処理部3から有線又i、を無線によって送られる映像信
号を入力して触知ボコーダ4に所定の刺激信号を送るた
めの操作部である。本発明に傑る触知ボコーダに映像情
報を提供する該口唇等の撮影装置2は、以下のように構
成されている。即ち、5はヘッドアセンブリであり、例
えば半円形の板バネが用いられるが、人の頭部に被冠す
るものであればこれに限定されず、ヘルメットなどを用
いてもよい。6は該ヘッドアセンブリ5に調節部材7を
介して可動可能に取付けられるアームである。該アーム
6信顔面の近傍まで延長され、その先端部には器体8に
収納される撮影レンズ9が取付けられている。該撮影レ
ンズ9は映像伝達素子10に適正映イ9を送るために/
又は2以上のレンズ系からなる。該撮影レンズ9の位置
は、口元を歴影する場合、顔全体の表情を撮影する場合
など種々の要請を満たすために自由に動かすことができ
るように構成トれている。本装置’ti2ではu形の調
節?り6材7が回動可能にヘッドアセンブリ5に固定さ
れており、該部材7にアーム6を装着している。従って
該部材7を回動すればアーム6が回動し撮影レンズ9の
位置を動かすことができる。In the figure, reference numeral 1 denotes an operation unit for inputting a video signal sent by wire or wirelessly from a video processing unit 3 provided in a device 2 for photographing lips, etc., and sending a predetermined stimulation signal to a tactile vocoder 4. be. The device 2 for photographing lips, etc., which provides video information to the tactile vocoder according to the present invention, is configured as follows. That is, 5 is a head assembly, for example, a semicircular leaf spring is used, but the present invention is not limited to this as long as it is worn on a person's head, and a helmet or the like may also be used. Reference numeral 6 denotes an arm movably attached to the head assembly 5 via an adjustment member 7. The arm 6 is extended to the vicinity of the face, and a photographic lens 9 housed in the body 8 is attached to its tip. The photographing lens 9 transmits an appropriate image 9 to the image transmitting element 10.
Or it consists of two or more lens systems. The position of the photographic lens 9 is configured such that it can be moved freely to meet various demands, such as when photographing the mouth or the expression of the entire face. Is this device 'ti2 a U-shaped adjustment? A member 7 is rotatably fixed to the head assembly 5, and an arm 6 is attached to the member 7. Therefore, when the member 7 is rotated, the arm 6 is rotated and the position of the photographing lens 9 can be moved.
またアーム6の長手方向の調節を行なうことによって、
撮影レンズ9と口元との距離を調整することも可能であ
る。該撮影レンズ9の位置を調整するには、本装置2の
手段に限定されず、例えば、アーム6自体を可読性の部
材を弔い、アーム6をヘッドアセンブリ5に固定しても
よい。前記伝達素子10は本装置2では、集束性光グラ
スファイバーが用いられ、前記アーム6に固定されて、
撮影レンズ9から送られる映像を映像処理部3に送る機
能を有する。該集束性光グラスファイバーを用いる場合
には、該ファイバーの両端の断面形跋が同一になるよう
に形成される。該映像処理部3は入力した映像を処理し
て電蛎信号として出力する機能を有するもので、ヘッド
アセンブリ5に設けられる取付部材11によって固定さ
れている。Also, by adjusting the arm 6 in the longitudinal direction,
It is also possible to adjust the distance between the photographic lens 9 and the mouth. To adjust the position of the photographic lens 9, the method is not limited to the means of the present device 2; for example, the arm 6 itself may be provided with a readable member and the arm 6 may be fixed to the head assembly 5. In the present device 2, the transmission element 10 uses a focusing optical glass fiber and is fixed to the arm 6,
It has a function of sending the image sent from the photographing lens 9 to the image processing section 3. When using the focusing optical glass fiber, the fiber is formed so that both ends thereof have the same cross-sectional shape. The video processing section 3 has a function of processing input video and outputting it as an electromagnetic signal, and is fixed by a mounting member 11 provided on the head assembly 5.
しかし、該映像処理部3は必ずしもヘッドアセンブリ5
に固定される必要はなく、衣服のポケットなどに入れて
おいてもよい。なお、本装置2において、撮影レンズ9
の近くに映像ピント調節装置や露出調節装置、反射鏡な
どの付属装置類を付加してもよい。口唇等の撮影装置2
け、以上のような構成を何するものである。However, the video processing section 3 does not necessarily include the head assembly 5.
It does not need to be fixed to the camera, and can be placed in a pocket of clothing. Note that in this device 2, the photographing lens 9
Additional devices such as an image focus adjustment device, an exposure adjustment device, and a reflector may be added near the camera. Photographing device 2 for lips, etc.
So, what is the purpose of the above configuration?
本発明に用いられろ触知ボコーダ4の刺激部位は、手の
平、指先き等であるが、例えば図示のように手の平に取
付けろ場合には、前記操作部1から送られる信号により
手の平の皮膚面の刺激部位に振動による刺激を与えてそ
の刺激された部分が口唇の動きの如き物の形象になるよ
うに構成される。叩ち、n′[記0#等の撮影装置2に
おいで、撮影された口唇σ)形を、触知ボコーダ4によ
ってそのまま振動による刺激として表わしてもよいし、
口唇の形をパターンイヒさせてから振動による刺激とし
て表わしてもよい。かかろ口唇の形のパターン化をする
場合には、所昭のプログラムを組込んだコンピューター
を用いればよい。The stimulation site of the tactile vocoder 4 used in the present invention is the palm of the hand, the fingertips, etc., but when it is attached to the palm as shown in the figure, the skin surface of the palm is stimulated by the signal sent from the operating section 1. The device is configured to apply vibrational stimulation to the stimulated part of the body and make the stimulated part resemble the movement of the lips. The tactile vocoder 4 may express the shape of the lip σ) photographed by the photographing device 2 such as n′ [0#] as it is as a stimulation by vibration, or
The shape of the lips may be patterned and then expressed as stimulation by vibration. When patterning the shape of Kakaro's lips, a computer incorporating Tokoro's program may be used.
本発明によれば、従来の触知ボコーダの如き困難性の伴
う訓練を必要とせず、読唇術程度のrrR単な訓練(ご
よって、聴覚だけでは興精の大きい音声の認識を補助す
る。本発明は上記の曲にも、秘密情報の提供などの前々
の用途に用いることができる。According to the present invention, there is no need for difficult training as with conventional tactile vocoders, and simple rrR training equivalent to lip reading (thereby assisting the recognition of voices that are more exciting than hearing alone). The song above can also be used for other purposes, such as providing confidential information.
本発明は、更に当該触知ボコーダに前記撮影装置ρ2か
ら送られる信号に基づき、口唇等の情報を画像に表わす
ための画像形成部を該触知ボコーダの上面側に形成して
もよい。pl]ち、この場合、触覚情報を手の平などで
受けながら、同時に視覚情師をも手の平の−F等で得ら
れ、難聴者用として適切であるばかりでなく、秘密情報
の提供などの種々の用途にも使用できることとなる。又
該画像形成部を別個に設けてもよい。当該画像形成部と
しては、テレビ画(>、発光ダイオード、液晶などによ
って形成すればよい。このように本発明の触知ボコーダ
に加えて画像形成部を利用するこ七は、触覚情報に視覚
情報を加えることになるので、難聴者が音声認識言”l
諌なとを自分−人で行なえる等という効果を発揮する。The present invention may further include forming an image forming section on the upper surface side of the tactile vocoder for displaying information such as lips on an image based on a signal sent from the photographing device ρ2 to the tactile vocoder. In this case, while receiving tactile information with the palm of the hand, visual information can also be obtained with the -F of the palm, which is not only suitable for people with hearing loss, but also useful for various purposes such as providing confidential information. It can also be used for other purposes. Further, the image forming section may be provided separately. The image forming section may be formed using a television screen, a light emitting diode, a liquid crystal, etc. As described above, the use of an image forming section in addition to the tactile vocoder of the present invention is advantageous in that it combines visual information with tactile information. This allows hearing-impaired people to use speech recognition words.
It has the effect of allowing you to do the Isanato by yourself.
以上、本発明に保る触知ボコーダが撮影’A置などの映
(象に基づいて作動される場合について述べたが、本発
明はこれに限らず、例えば音声(例えばマイクロホンに
よる)に基づいて作動させてもよい。In the above, the tactile vocoder according to the present invention is operated based on the image of the shooting position, etc., but the present invention is not limited to this. It may be activated.
図は本発明の一実施例を示す使用状態図である。 特許出願人 小 野 博 代理人 弁理士 坂口信昭(はが7名) The figure is a usage state diagram showing an embodiment of the present invention. patent applicant Hiroshi Nono agent Patent attorney Nobuaki Sakaguchi (7 people)
Claims (1)
において、発声に伴う口厚の動きの如き物の形象を前記
刺激部位に与えることを特徴とする触知ボコーダ。 (、り発声に伴うl辱の動きの如き物の形象をH激部位
に与える触知ボコーダが、視覚情報を与える画像形成部
を有することを特徴とする触知ボコーダ。(1) A tactile vocoder that uses a living body's skin surface as a stimulation site, the tactile vocoder being characterized in that an image of an object such as the movement of a thick mouth accompanying vocalization is given to the stimulation site. (A tactile vocoder characterized in that the tactile vocoder provides an image of something like the movement of humiliation associated with utterance to an erotic region, and has an image forming section that provides visual information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP57063942A JPS58180150A (en) | 1982-04-19 | 1982-04-19 | Tactile perception vocoder |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP57063942A JPS58180150A (en) | 1982-04-19 | 1982-04-19 | Tactile perception vocoder |
Publications (1)
Publication Number | Publication Date |
---|---|
JPS58180150A true JPS58180150A (en) | 1983-10-21 |
Family
ID=13243904
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP57063942A Pending JPS58180150A (en) | 1982-04-19 | 1982-04-19 | Tactile perception vocoder |
Country Status (1)
Country | Link |
---|---|
JP (1) | JPS58180150A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6128287A (en) * | 1984-07-18 | 1986-02-07 | Hiroshi Ono | Information transmission device utilizing telephone set |
-
1982
- 1982-04-19 JP JP57063942A patent/JPS58180150A/en active Pending
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6128287A (en) * | 1984-07-18 | 1986-02-07 | Hiroshi Ono | Information transmission device utilizing telephone set |
WO1986001060A1 (en) * | 1984-07-18 | 1986-02-13 | Hiroshi Ono | Data transmitting device utilizing a telephone |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10175935B2 (en) | Method of virtual reality system and implementing such method | |
US9424842B2 (en) | Speech recognition system including an image capturing device and oral cavity tongue detecting device, speech recognition device, and method for speech recognition | |
EP1083769B1 (en) | Speech converting device and method | |
JP2016515897A5 (en) | ||
US20200301150A1 (en) | Secure testing device with liquid crystal shutter | |
JP2016224554A (en) | Eye-mount display device | |
Freitas et al. | An introduction to silent speech interfaces | |
Werfel et al. | Empathizing audiovisual sense impairments: Interactive real-time illustration of diminished sense perception | |
Erber et al. | Voice/mouth synthesis and tactual/visual perception of/pa, ba, ma | |
KR20190048144A (en) | Augmented reality system for presentation and interview training | |
KR102334091B1 (en) | Augmented reality device for audio identification and control method thereof | |
KR102122021B1 (en) | Apparatus and method for enhancement of cognition using Virtual Reality | |
JPS58180150A (en) | Tactile perception vocoder | |
KR20190031805A (en) | Coaching system for users participating in virtual reality contents | |
MANN | Technology and human rehabilitation: Prostheses for sensory rehabilitation and/or sensory substitution | |
KR20160028868A (en) | Voice synthetic methods and voice synthetic system using a facial image recognition, and external input devices | |
Zhu et al. | An investigation into the effectiveness of using acoustic touch to assist people who are blind | |
JP3829005B2 (en) | Virtual environment presentation device | |
KR102382734B1 (en) | Presentation Enhancement System using VR | |
Bernard | Perception of audio-haptic textures for new touchscreen interactions | |
Ifukube | A neuroscience-based design of intelligent tools for the elderly and disabled | |
JP5960792B2 (en) | Vocal sound practice aid | |
Jin et al. | Acoustic touch: An auditory sensing paradigmto support close reaching for people who are blind | |
Serena Sukhija et al. | Innovative mobile technology targets low vision | |
Baum et al. | Doctors and magicians: what we can learn from wizards |