JPWO2006088251A1 - Auxiliary device that facilitates blind touch by projecting a keyboard using a photographic tool - Google Patents
Auxiliary device that facilitates blind touch by projecting a keyboard using a photographic tool Download PDFInfo
- Publication number
- JPWO2006088251A1 JPWO2006088251A1 JP2007503805A JP2007503805A JPWO2006088251A1 JP WO2006088251 A1 JPWO2006088251 A1 JP WO2006088251A1 JP 2007503805 A JP2007503805 A JP 2007503805A JP 2007503805 A JP2007503805 A JP 2007503805A JP WO2006088251 A1 JPWO2006088251 A1 JP WO2006088251A1
- Authority
- JP
- Japan
- Prior art keywords
- keyboard
- personal computer
- input
- display
- video camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Input From Keyboards Or The Like (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
パーソナルコンピューターへの文字入力では、キーボード入力に不慣れな人は、ブラインドタッチができない為、毎回キーボードと画面を確認しつつキーを打っている。したがって、入力作業が繁雑で時間もかかり疲労も大きい。キーボードを撮影する撮影装置（例えばビデオカメラ）を上方に設置し、その映像をパーソナルコンピューターディスプレーの脇に撮影装置（例えばビデオカメラ）からの映像が映し出されるディスプレーを新たに設置する事で自分の手指を含めたキーボードの状態とパーソナルコンピューターディスプレー画面に入力された文字とを同時に見ることで上記の問題を解決する。或いは、撮影装置（例えばビデオカメラ）からの映像をパーソナルコンピュータからのディスプレー画面の一部に表示することで上記同様に自分の手指を含めたキーボードの状態と画面に入力された文字とを同時に見ることで上記の問題を解決する。People who are unfamiliar with keyboard input are not able to perform a blind touch when inputting characters into a personal computer, so they are typing keys while checking the keyboard and screen every time. Therefore, the input work is complicated, time consuming, and fatigue is great. A camera device (for example, a video camera) that shoots the keyboard is installed at the top, and a new display is installed next to the personal computer display to display the image from the camera device (for example, a video camera). The above problem is solved by simultaneously viewing the keyboard state including the characters and the characters entered on the personal computer display screen. Alternatively, by displaying the image from the photographing device (for example, a video camera) on a part of the display screen from the personal computer, the state of the keyboard including his / her fingers and the characters input on the screen can be simultaneously viewed as described above. This solves the above problem.
Description
この発明は、コンピューターへの入力の容易化に関している。ブラインドタッチが不慣れな高齢者や障害者等でも入力を容易に行える。情報通信、ビジネス支援さらに福祉、健康の分野である。語学学習等への応用により教育の分野にも活用できる。 The present invention relates to facilitating input to a computer. It can be easily input even by an elderly person or a handicapped person who is not accustomed to blind touch. Information communication, business support, welfare and health. It can also be used in the field of education through application to language learning.
パーソナルコンピューターにはデスクトップ型とノート型がある。デスクトップ型はキーボードとディスプレーが分かれている。ノート型ではキーボードとディスプレーが一体となっている。パーソナルコンピューターへの文字入力はキーボードから行なうのが一般的である。
文字入力に未熟な人は、キーボード上の文字を目で確認し、キーを打つ。この為、ディスプレーの画面に示されるひらがなの文字を確認し、変換キーを叩いて変換された漢字を画面上で確認する。ローマ字入力の場合は、更にローマ字からひらがなへの変換を確認しなければならない。漢字変換の場合は正しい漢字を確認し再びキーを打つ事になる。この様に入力確認が繁雑である。
パーソナルコンピューターへの文字入力では、キーボード入力に習熟している人はキーボードを見ずにパーソナルコンピューターのディスプレーを見ながら入力ができる。しかし、キーボード入力に不慣れな人は、ブラインドタッチができない為、毎回キーボードの文字を確認しながらキーを打つ。したがって、キーボードの文字を見て打ちディスプレー上での入力を確認し、再度キーボードを見てキーを打つ作業を繰り返す。この様に入力作業が繁雑で時間も要し疲労する。キーボード操作の度に、画面から目を離すので何度も入力中の文字の位置を確認し、キーボードとディスプレー上で探すことになる煩わしさがある。キーボード入力が不慣れな人は、キーボードから目を離す事は入力作業の効率を低下させる。入力中の文字とキーボードの状態を目をそらす事なく同一視野内でキーボードを打つ事ができる事は入力作業のスピードと効率を飛躍的に高める。ノート型パーソナルコンピューターの場合は、キーボードとディスプレーが一体となっているが、キーボードは水平におかれ画面は垂直もしくは斜めから見るためにやはり入力の繁雑さを伴う。デスクトップ型のパーソナルコンピューターの場合でも同様に入力に繁雑さを伴う。この様な問題の解決として、キーボードの状態を鏡に映す方法のもの日本特開平８−１６２８９号、日本特開２００５−１９６３２２号が知られている。これらのものでは、鏡を用いているために視野が制限される点やパーソナルコンピューター及びキーボードの機種により補助装置が限定される。しかし本発明は、この様な視野の問題や機種の限定という欠点はない。更に、キーボードに補助画面を設置した日本特開平９−３０５２６６号、日本特開平７−３３４２８４号がある。この場合は、限られた量の入力情報しか、キーボード周辺で見ることが出来ない。本発明は、入力情報を多くすることのみならず、キーボードと入力の状態を画像処理等を用いることでより高度で高効率な機能へ発展させることができる。There are two types of personal computers: desktop and notebook. The desktop type has a separate keyboard and display. The notebook type has an integrated keyboard and display. Character input to a personal computer is generally performed from a keyboard.
A person who is inexperienced in character input confirms the characters on the keyboard and hits a key. For this reason, the hiragana characters shown on the display screen are checked, and the converted kanji is checked on the screen by hitting the conversion key. In the case of romaji input, you must also check the conversion from romaji to hiragana. In the case of Kanji conversion, the correct Kanji is confirmed and the key is hit again. In this way, input confirmation is complicated.
When inputting characters to a personal computer, a person who is proficient in keyboard input can input while looking at the display of the personal computer without looking at the keyboard. However, those who are unfamiliar with keyboard input cannot make a blind touch, so hit the keys while checking the characters on the keyboard every time. Therefore, the operation of confirming the input on the display by looking at the characters on the keyboard and repeating the operation of looking at the keyboard and hitting the key is repeated. In this way, the input work is complicated, time consuming and fatigued. Each time the keyboard is operated, the user keeps an eye on the screen, so that the position of the character being input is confirmed many times, and there is an annoyance that is searched on the keyboard and the display. For those who are not familiar with keyboard input, keeping an eye on the keyboard reduces the efficiency of input work. Being able to hit the keyboard within the same field of view without looking away from the character being input and the state of the keyboard dramatically increases the speed and efficiency of input work. In the case of a notebook personal computer, the keyboard and the display are integrated, but the keyboard is horizontal and the screen is viewed vertically or obliquely, so it is still complicated to input. Even in the case of a desktop personal computer, input is complicated as well. As a solution to such a problem, Japanese Patent Laid-Open Nos. 8-16289 and 2005-196322 are known which reflect the state of the keyboard in a mirror. In these devices, the auxiliary device is limited depending on the point of view being limited due to the use of a mirror and the types of personal computers and keyboards. However, the present invention does not suffer from such a problem of visual field and limitation of models. Further, there are Japanese Patent Laid-Open Nos. 9-305266 and 7-334284 in which an auxiliary screen is installed on the keyboard. In this case, only a limited amount of input information can be seen around the keyboard. The present invention can be developed not only to increase the input information but also to a more advanced and highly efficient function by using image processing or the like for the keyboard and input state.
本発明ではデスクトップ型及びノート型パーソナルコンピューターを対象としている。キーボードの状態を撮影する撮影装置（例えばビデオカメラ）を設置し、その映像を映写する補助ディスプレーを新たに設ける事により、自分の手指を含めたキーボードの状態とパーソナルコンピューターディスプレーに表示された入力中の文字を容易に確認する事ができる様にしたものである。撮影装置（例えばビデオカメラ）からの映像をパーソナルコンピューターディスプレーの一部に表示する事により同様に、自分の手指を含めたキーボードの状態とパーソナルコンピューターディスプレーに表示された入力中の文字を容易に確認する事ができる様にしたものである。 The present invention is intended for desktop and notebook personal computers. By installing a shooting device (such as a video camera) that captures the state of the keyboard and newly providing an auxiliary display that projects the image, the keyboard state including your fingers and the input displayed on the personal computer display It is designed to make it easy to check the characters. By displaying the video from the camera (eg video camera) on a part of the personal computer display, you can easily check the status of the keyboard including your fingers and the characters being entered on the personal computer display. It is something that can be done.
図１は、本発明で撮影装置（例えばビデオカメラ）及びそこからの映像を映し出す補助ディスプレーを示した正面及び上方からの複合図である。
図２は、本発明で撮影装置（例えばビデオカメラ）及びそこからの映像をパーソナルコンピューター（パソコン）からのディスプレーの一部に映し出した場合の正面及び上方からの複合図である。FIG. 1 is a composite view from the front and above showing a photographing apparatus (for example, a video camera) and an auxiliary display for projecting an image therefrom.
FIG. 2 is a composite view from the front and above when a photographing apparatus (for example, a video camera) and images from the photographing apparatus are projected on a part of a display from a personal computer (personal computer) according to the present invention.
１：キーボード
２：撮影装置（例えばビデオカメラ）
３：撮影装置から映像を映し出す補助ディスプレー
４：パーソナルコンピューター（パソコン）本体
５：パーソナルコンピューター（パソコン）からの入力状況を示すディスプレー画面
６：撮影装置からの映像をパーソナルコンピューター（パソコン）からのディスプレーの一部に映し出している様子1: Keyboard 2: Shooting device (eg video camera)
3: Auxiliary display for projecting images from the photographing device 4: Personal computer (PC) body 5: Display screen showing the input status from the personal computer (PC) 6: Display of images from the photographing device from the personal computer (computer) A part of it is projected
この発明の実施の形態を図面を参照して実施例を説明する。図１は、請求項１に記載の補助ディスプレー付の場合の正面及び上方からの複合図である。キーボードを上方から撮影する撮影装置（例えばビデオカメラ）とその映像を映し出すディスプレー（補助画面）が示されている。作業者は実際のキーボードに触れつつ補助画面に写しだされているキーボードの状態とを見ながらパーソナルコンピューターディスプレーに映し出された入力状況を同一視野内に見ながら入力作業を行なう。この為、入力された文字とキーボードとを交互に視線を動かしつつ確認する事が不要となり、キーボードの操作に不慣れな人でも入力作業能率が大幅に向上し疲労もはるかに少ないものとなる。
図２は、後期の請求項２に記載の撮影装置（例えばビデオカメラ）からの映像をパーソナルコンピューターディスプレーに映し出す場合の正面及び上方からの図である。キーボードを上方から撮影する撮影装置（例えばビデオカメラ）とその映像がパーソナルコンピューター画面の一部に映し出されている状態が示されている。作業者は実際のキーボードに触れつつパーソナルコンピューター画面の一部に写しだされているキーボードの状態とパーソナルコンピューター画面の入力文字状況を同一視野内に見ながら入力作業を行なう。この為、入力された文字とキーボードとを交互に視線を動かしつつ確認する事が不要となり、キーボードの操作に不慣れな人でも文字入力作業能率が大幅に向上し疲労も遥かに少ないものとなる。Embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a composite view from the front and above with the auxiliary display according to claim 1. A photographing device (for example, a video camera) that photographs the keyboard from above and a display (auxiliary screen) that displays the image are shown. The operator touches the actual keyboard and looks at the state of the keyboard displayed on the auxiliary screen while viewing the input status displayed on the personal computer display within the same field of view. For this reason, it is not necessary to confirm the input characters and the keyboard while moving the line of sight alternately, and even a person unfamiliar with the operation of the keyboard greatly improves the input work efficiency and much less fatigue.
FIG. 2 is a view from the front and above when an image from a photographing apparatus (for example, a video camera) according to claim 2 of the latter term is displayed on a personal computer display. A photographing apparatus (for example, a video camera) that photographs the keyboard from above and a state in which the image is displayed on a part of the personal computer screen are shown. The operator touches the actual keyboard and performs the input work while viewing the state of the keyboard displayed on a part of the personal computer screen and the state of the input characters on the personal computer screen within the same field of view. For this reason, it is not necessary to check the input characters and the keyboard while alternately moving the line of sight, and even a person unfamiliar with the operation of the keyboard greatly improves the character input work efficiency and the fatigue is much less.
以上説明した様に本発明によれば、キーボードの状態を撮影できる撮影装置（例えばビデオカメラ）を撮影設置とそこからの映像を映し出す補助ディスプレー、又はそこからの映像をパーソナルコンピューター本体からのディスプレーの一部に写し出す機能を設置することで、入力者が視線を大きく転じることなく、入力が正しく実行されたか否かを容易に確認できる。キーボード全体が撮影されるので漢字変換や数字等も含めて所望の変換や入力を行なうことが容易に出来る等の効果がある。
ブラインドタッチが苦手な作業者、或いは、首の回転運動等に支障のある作業者でも効率的にキーボードから容易に入力できる。入力中のキーボードや指の状態を画像処理や入力方式に基づく変換を行うことで、更に高度で高効率な機能へと発展させることができる。本発明は、キーボードによるパーソナルコンピューターへの入力のみならず、ピアノ等の鍵盤楽器の鍵盤上に設置することにより初学者のピアノ等の学習を助ける目的に使用する事も可能である。つまりピアノ等の鍵盤と学習者の手指の状態を楽譜の脇に示す事で鍵盤を見ると同時にその楽譜を確認しつつ演奏する事が可能である。或いは、語学やカラオケ等の歌の発声の学習等の際に学習者の口等の形等を含めた状態を教師の見本の映像、テキストの単語や歌詞の譜面やその注意書き等を同時に見る事による学習効果の向上に用いる事が可能である。As described above, according to the present invention, a photographing apparatus (for example, a video camera) that can photograph the state of the keyboard is installed and an auxiliary display that displays the image from the photographing apparatus, or the image from there is displayed on the display from the personal computer main body. By installing a function to project a part, it is possible to easily confirm whether or not the input is correctly performed without causing the input person to change his gaze. Since the entire keyboard is photographed, there is an effect that it is possible to easily perform desired conversion and input including kanji conversion and numbers.
An operator who is not good at blind touch or an operator who has trouble with the rotational movement of the neck can efficiently input from the keyboard. By converting the state of the keyboard and fingers being input based on image processing and an input method, it is possible to develop further advanced and highly efficient functions. The present invention can be used not only for input to a personal computer by a keyboard but also for the purpose of helping a beginner to learn a piano or the like by installing it on a keyboard of a keyboard instrument such as a piano. In other words, it is possible to perform while checking the score at the same time as viewing the keyboard by showing the state of the keyboard such as a piano and the fingers of the learner beside the score. Or, when learning the utterance of a song such as linguistics or karaoke, see the teacher's sample image, including the shape of the learner's mouth, etc. It can be used to improve the learning effect.
Claims (2)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2005073865 | 2005-02-16 | ||
| JP2005073865 | 2005-02-16 | ||
| PCT/JP2006/303501 WO2006088251A1 (en) | 2005-02-16 | 2006-02-16 | Auxiliary device for facilitating blind touch by imaging keyboard state and displaying it |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| JPWO2006088251A1 true JPWO2006088251A1 (en) | 2008-07-17 |
Family
ID=36916634
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2007503805A Withdrawn JPWO2006088251A1 (en) | 2005-02-16 | 2006-02-16 | Auxiliary device that facilitates blind touch by projecting a keyboard using a photographic tool |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JPWO2006088251A1 (en) |
| WO (1) | WO2006088251A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB201206121D0 (en) * | 2012-04-05 | 2012-05-16 | Bryant Jacklyn | Apparatus and method for aiding the learning of a skill |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0554492B1 (en) * | 1992-02-07 | 1995-08-09 | International Business Machines Corporation | Method and device for optical input of commands or data |
-
2006
- 2006-02-16 WO PCT/JP2006/303501 patent/WO2006088251A1/en active Application Filing
- 2006-02-16 JP JP2007503805A patent/JPWO2006088251A1/en not_active Withdrawn
Also Published As
| Publication number | Publication date |
|---|---|
| WO2006088251A1 (en) | 2006-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Brodwin et al. | Computer assistive technology for people who have disabilities: Computer adaptations and modifications. | |
| Fusco et al. | The tactile graphics helper: providing audio clarification for tactile graphics using machine vision | |
| KR20080106265A (en) | A system and method of inputting data into a computing system | |
| US10971025B2 (en) | Information display apparatus, information display terminal, method of controlling information display apparatus, method of controlling information display terminal, and computer readable recording medium | |
| US20180277006A1 (en) | Information display apparatus, information display method, and computer-readable recording medium | |
| ATE313832T1 (en) | DATA PROCESSING DEVICE AND METHOD | |
| JP6195608B2 (en) | Learning aids and shields | |
| JP2012156607A (en) | Mobile terminal device for visually-challenged person | |
| JPWO2006088251A1 (en) | Auxiliary device that facilitates blind touch by projecting a keyboard using a photographic tool | |
| Go et al. | Eyes-free text entry with EdgeWrite alphabets for round-face smartwatches | |
| Choudhury et al. | Visual gesture-based character recognition systems for design of assistive technologies for people with special necessities | |
| Reid et al. | A collaborative multimodal handwriting training environment for visually impaired students | |
| TWM579369U (en) | Nursing on-the-job education and training system | |
| KR20020040697A (en) | Method for learning characters and therefor machinery for learning characters | |
| MacKay | Dasher–an efficient keyboard alternative | |
| KR200246138Y1 (en) | A reflex device for education | |
| Grussenmeyer | Making Spatial Information Accessible on Touchscreens for Users who are Blind and Visually Impaired | |
| JP2014155215A (en) | Kana character input method and keyboard employing the same | |
| JP2006338124A (en) | Chinese character retrieval method, its system and its server | |
| RU2816047C1 (en) | Method and device for marking sign language gestures | |
| Veena et al. | Multi model interaction techniques for universal design and its applications | |
| KR100762200B1 (en) | Self learning device for talking with the hands | |
| Rojanasaroch et al. | Communication aid device for illness deaf-mute | |
| JP2003162215A (en) | Display system for personal computer input operation | |
| Kryvonos et al. | Information technologies applications for sign languages investigations |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A300 | Application deemed to be withdrawn because no request for examination was validly filed |
Free format text: JAPANESE INTERMEDIATE CODE: A300 Effective date: 20090512 |