JP2007052385A - Audio user interface - Google Patents

Audio user interface Download PDF

Info

Publication number
JP2007052385A
JP2007052385A JP2005262907A JP2005262907A JP2007052385A JP 2007052385 A JP2007052385 A JP 2007052385A JP 2005262907 A JP2005262907 A JP 2005262907A JP 2005262907 A JP2005262907 A JP 2005262907A JP 2007052385 A JP2007052385 A JP 2007052385A
Authority
JP
Japan
Prior art keywords
pitch
icons
cursors
menus
personal computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2005262907A
Other languages
Japanese (ja)
Inventor
Kohei Katagiri
公平 片桐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to JP2005262907A priority Critical patent/JP2007052385A/en
Publication of JP2007052385A publication Critical patent/JP2007052385A/en
Pending legal-status Critical Current

Links

Images

Abstract

<P>PROBLEM TO BE SOLVED: To provide a personal computer system which is easily usable even by a sight handicapped person. <P>SOLUTION: The four corners, the top and bottom, right and left, of a monitor display are provided with speakers and where on the two-dimensional planes there are an icon, cursor, menu, etc., is expressed by sound images. Further, the positions and the kinds of arbitrary points on the two-dimensional planes are expressed by the kinds of sounds and the pitches of the sounds. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

本発明はコンピュータに関するものであり、現在広く普及しているモニターディスプレイを用いる機器、特にパーソナルコンピュータの視覚障害者にとっての使いにくさを改善するものである。    The present invention relates to a computer, and is intended to improve the difficulty of using a device using a monitor display, which is widely used at present, particularly a visually impaired person.

現在広く普及しているパーソナルコンピュータのインターフェースはグラフィック・ユーザー・インターフェースであり、これはユーザーに対しアイコン等のグラフィックをインターフェースとすることで従来のコンピュータにおける文字の入力によるコマンド操作を用いたコンピュータの使いづらさを解消したものである。この例として非特許文献1がある。
A History Of The GUI http://arstechnica.com/articles/paedia/gui.ars
The personal computer interface that is widely used at present is a graphic user interface, which uses a graphic operation such as an icon for the user as an interface, and uses a computer using a command operation by inputting characters in a conventional computer. It eliminates the difficulty. Non-patent document 1 is an example of this.
A History Of The GUI http: // artechnica. com / articles / paedia / gui. ars

しかし、グラフィック・ユーザー・インターフェースは多くの項目を同時に把握出来る為、視覚の障害のない人には非常に便利だが、視覚障害者(特に全盲者)にとってはモニターディスプレイの2次元平面上のあらゆる場所にアイコンやメニュー、ファイルといったものが散らばっているためどこに何があるか判らず非常に使いづらいのでこれを解決することを課題とする。    However, the graphic user interface can grasp many items at the same time, so it is very convenient for people without visual impairments, but for visually impaired people (especially blind people) anywhere on the 2D plane of the monitor display. it is an object of the present invention to solve this problem because the icons and menus, difficult very easy to use not know where what is there for is scattered things like file to.

この課題を解決するための請求項1の発明は、コンピュータのモニターディスプレイの四隅にスピーカーを設け(図1参照)2次元平面上の任意の位置に音像を結びモニターディスプレイ上にグリッド上に配置され表現されたアイコンやカーソル、メニュー等の位置を聴覚を使用して認識させることで解決出来る。    In order to solve this problem, the invention of claim 1 is provided with speakers at four corners of a monitor display of a computer (see FIG. 1), and a sound image is formed at an arbitrary position on a two-dimensional plane and arranged on a grid on the monitor display. This can be solved by recognizing the position of the represented icon, cursor, menu, etc. using auditory sense.

また請求項2の発明は請求項1の発明を補完するものである。より正確にアイコンやカーソル、メニュー等の位置と種類を認識させるために音色(音の種類)、音高(音の高さ)をもちいてアイコン、カーソル、メニュー等を判別したり、その位置をより正確に脳内にイメージ出来る。    The invention of claim 2 complements the invention of claim 1. In order to recognize the position and type of icons, cursors, menus, etc. more accurately, it uses the tone (sound type) and pitch (pitch) to distinguish icons, cursors, menus, etc. It can be imaged in the brain more accurately.

本発明により全盲の視覚障害者でもアイコンやカーソル、メニュー等の位置を正確に認識することが出来るので、グラフィック・ユーザー・インターフェースベースの機器(主にパーソナルコンピュータ)を使用者が自由に取り扱うことが出来る。According to the present invention, a blind blind person can accurately recognize the positions of icons, cursors, menus, etc., so that the user can freely handle graphic user interface-based devices (mainly personal computers). I can do it.

図1は、コンピュータのモニターディスプレイの四隅四ヶ所にスピーカーを設けたものである。ステレオスピーカーのように2つだけでなく上下左右に分けて4つ配置することで2次元上の平面に任意の音像を結び、その音像の点の位置を認識させる事が出来る。    In FIG. 1, speakers are provided at four corners of a computer monitor display. Arranging not only two but also four in the top, bottom, left and right positions as in a stereo speaker, an arbitrary sound image can be connected to a two-dimensional plane and the position of the point of the sound image can be recognized.

図2は請求項2の具体的な適用例である。コンピュータのモニターディスプレイの2次元平面上のグリッド状に縦横にアイコンが配置されている。Y軸上にアイコンの平面上の高さに比例して音高(音の高さ)が割り当てられている。使用する音の高さはグランドピアノの白鍵に準ずるなら52種類まで割り当てられる。X軸上には音の種類(楽器音や、シンセサイザーの音色、各種サウンドライブラリ)を割り当てる。    FIG. 2 shows a specific application example of claim 2. Icons are arranged vertically and horizontally in a grid on a two-dimensional plane of a computer monitor display. A pitch (pitch) is assigned to the Y axis in proportion to the height of the icon on the plane. Up to 52 pitches can be assigned as long as the white key of the grand piano is used. Sound types (instrument sounds, synthesizer sounds, various sound libraries) are assigned on the X axis.

産業上の利用の可能性Industrial applicability

本発明に係わるスピーカーやモニターディスプレイ、ディジタルサウンドソースは工業的に量産することが可能であるため、産業上の利用可能性を有する。  Since the speaker, the monitor display, and the digital sound source according to the present invention can be industrially mass-produced, they have industrial applicability.

モニターディスプレイの上下左右の四隅にそれぞれ1つずつスピーカーを設けてある。One speaker is provided at each of the four corners of the monitor display. グリッド上に配置されたアイコンの位置を音色(音の種類)、音高(音の高さ)で表現してある。The position of the icon arranged on the grid is expressed by tone (sound type) and pitch (sound pitch).

符号の説明Explanation of symbols

1 上下左右の四隅に配置されたモニタースピーカー
2 4チャンネルモニタースピーカー付きパーソナルコンピュータ用ディスプレイ
3 X軸方向に音色(音の種類)の割り当て
4 Y軸方向に音高(音の高さ)の割り当て
5 グリッド状に配置されたアイコン群
1 Monitor speakers arranged at the four corners of the top, bottom, left and right 2 Display for personal computer with 4-channel monitor speakers 3 Assignment of tone (sound type) in the X-axis direction 4 Assignment of pitch (sound pitch) in the Y-axis direction 5 Icons arranged in a grid

Claims (2)

パーソナルコンピュータのディスプレイの四隅にスピーカーを設けることで、パーソナルコンピュータのグリッド状に配置されたアイコンやカーソル、メニュー等の位置等を音声で2次元平面上に表すことのできる、視覚障害者でもパーソナルコンピュータのアイコンやカーソル等の位置を把握し確認することが出来るシステム。By providing speakers at the four corners of the display of a personal computer, the positions of icons, cursors, menus, etc. arranged in a grid shape of the personal computer can be expressed on a two-dimensional plane by voice. A system that can grasp and confirm the position of icons and cursors. 請求項1で表されたパーソナルコンピュータのモニターディスプレイの2次元平面上のグリッド状に配置されたアイコンやカーソル、メニュー等の位置を、四隅に設けてあるスピーカーで鳴らす場合に音色の種類と音色の音高(音の高さ)でより確実にカーソルやアイコン、メニュー等の位置や種類を2次元平面上に表すシステム。音色の種類とその音高の配置の仕方は、例えばY軸上に音高(音の高さ)をアイコン等の位置の高さに比例して配置し、X軸上には、段階に応じて音色の種類を割り当てることで、視覚障害者に確実に認識させるシステム。When the positions of icons, cursors, menus, etc. arranged in a grid on the two-dimensional plane of the monitor display of the personal computer represented in claim 1 are played by the speakers provided at the four corners, A system that more reliably represents the position and type of cursors, icons, menus, etc. on a two-dimensional plane by pitch The type of timbre and the way to arrange the pitch are arranged, for example, by placing the pitch (pitch) on the Y axis in proportion to the height of the position of the icon, etc. A system that allows visually impaired people to be surely recognized by assigning sound types.
JP2005262907A 2005-08-15 2005-08-15 Audio user interface Pending JP2007052385A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005262907A JP2007052385A (en) 2005-08-15 2005-08-15 Audio user interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005262907A JP2007052385A (en) 2005-08-15 2005-08-15 Audio user interface

Publications (1)

Publication Number Publication Date
JP2007052385A true JP2007052385A (en) 2007-03-01

Family

ID=37916866

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005262907A Pending JP2007052385A (en) 2005-08-15 2005-08-15 Audio user interface

Country Status (1)

Country Link
JP (1) JP2007052385A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9170709B2 (en) 2010-02-17 2015-10-27 Samsung Electronics Co., Ltd. Apparatus and method for providing user interface
US9965246B2 (en) 2014-09-16 2018-05-08 Samsung Electronics Co., Ltd. Method for outputting screen information through sound and electronic device for supporting the same
WO2018147143A1 (en) * 2017-02-09 2018-08-16 ソニー株式会社 Information processing device and information processing method

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9170709B2 (en) 2010-02-17 2015-10-27 Samsung Electronics Co., Ltd. Apparatus and method for providing user interface
US9965246B2 (en) 2014-09-16 2018-05-08 Samsung Electronics Co., Ltd. Method for outputting screen information through sound and electronic device for supporting the same
WO2018147143A1 (en) * 2017-02-09 2018-08-16 ソニー株式会社 Information processing device and information processing method
CN110249297A (en) * 2017-02-09 2019-09-17 索尼公司 Information processing equipment and information processing method
JPWO2018147143A1 (en) * 2017-02-09 2019-11-21 ソニー株式会社 Information processing apparatus and information processing method
US10809870B2 (en) 2017-02-09 2020-10-20 Sony Corporation Information processing apparatus and information processing method
JP7231412B2 (en) 2017-02-09 2023-03-01 ソニーグループ株式会社 Information processing device and information processing method
CN110249297B (en) * 2017-02-09 2023-07-21 索尼公司 Information processing apparatus and information processing method

Similar Documents

Publication Publication Date Title
EP2891955B1 (en) In-vehicle gesture interactive spatial audio system
TWI307854B (en) Apparatus and method for controlling a cursor
US8626324B2 (en) Altering sound output on a virtual music keyboard
TW201013512A (en) Method for generating multiple windows frames, electronic device thereof, and computer program product using the method
WO2013024526A1 (en) Mobile electronic device and key display program
JP2010211401A (en) Information processor, information processing method, and information processing program
US10200805B2 (en) Changing spatial audio fields
US9779710B2 (en) Electronic apparatus and control method thereof
WO2013024530A1 (en) Mobile electronic device and key display program
JP2007052385A (en) Audio user interface
JP5992976B2 (en) Method, computer and computer program for processing pointing stick input
WO2023241106A1 (en) Vibration signal coding method and apparatus, computer device and storage medium
WO2018147143A1 (en) Information processing device and information processing method
JP2019101739A (en) Information processor, information processing system and program
JP4185019B2 (en) Display device with audio output
US20090225033A1 (en) Electronic Apparatus
JP2005301827A (en) Acoustic information processor and acoustic information provision method
JP6391064B2 (en) Audio output processing apparatus, audio output processing program, and audio output processing method
JP6220035B1 (en) INPUT DEVICE, INFORMATION PROCESSING DEVICE, AND OPERATION METHOD
JP2008292664A (en) Graph learning support device and graph learning support program
JP2008165098A (en) Electronic musical instrument
KR20180033738A (en) Detachable Touch Panel Device Equipped with Diplay Device
JP2016119030A (en) Electronic apparatus and control method of electronic apparatus
JP6477096B2 (en) Input device and sound synthesizer
KR101702066B1 (en) Apparatus and Rendering Method for Haptic Button Click