JPH1069218A - Graphical user interface system for visually handicapped person - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a graphical user interface system for a visually handi capped person capable of using software dealing with Windows with simple operation even by the visually handicapped person. SOLUTION: By making respective tactile cells 1 of a tactile display device 5 respectively correspond to respective windows, control software 6a of a computer 6 outputs the voice data to a voice synthesizer 7, and provides information by voice from a speaker 8, and transmits the data corresponding to the operation of the tactile display device 5 to application software 6c.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a graphical user interface system for visually impaired persons, which enables visually impaired persons or the like to easily recognize the window configuration and component names of software having a graphical user interface.

[0002]

2. Description of the Related Art There have been various computer interface softwares for visually impaired persons. Most of them are screen readers for DOS, and input / output-related interrupts performed by DOS and BIOS. And provides the input and output information to the visually impaired as audio or Braille output.

[0003]

Therefore, in the window-compatible software that has been widely used recently, the operation is performed while looking at the screen of the computer, so that the visually impaired cannot operate. In addition, since a conventional screen reader for DOS cannot be used, it is impossible for visually impaired persons to operate window-compatible software alone.

[0004]

SUMMARY OF THE INVENTION The present invention has been proposed in view of the above, and has a display mode of a tactile pin array in which a plurality of windows and structures of software having a graphical user interface are provided on a tactile display. And by touching the tactile pin array of the tactile display to transmit the window name or part name of the corresponding graphical user interface by voice, thereby providing the structure of the graphical user interface to a visually impaired person. The present invention provides a graphical user interface system for the visually impaired, which allows the user to recognize the user.

Further, the present invention provides a graphical user interface system for the visually impaired in which the structure and function of the software window are expressed by the positions and numbers of tactile pins in the tactile pin array of the tactile display. Things.

[0006]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The basic principle of the present invention will be described below. FIG. 1 shows a configuration of a window according to the present invention. FIG. 1A is a conceptual diagram showing a screen configuration of a window.
(b) is a conceptual diagram showing a tree structure of a window, and (c) is a conceptual diagram showing the display of tactile pins corresponding to each window or component.

That is, the window structure shown in FIG. 1A has a state in which the button row window B and the text input component E are connected to the background window A, and the button components C and D are connected to the window B. ((B)
reference).

If this is expressed by contact pins corresponding to each window and parts A to E, as shown in FIG.
Is indicated by one point provided in the lower left column, and the window B is indicated by one point in the next column. On the other hand, the button components C and D are represented by two points in the next row, and the text input component E is represented by two points in the same row as the window B and one point in the next row. It is. Using the above-described principle, in the present invention, the hierarchy of windows, the types of components, and the like can be represented by simple display of contact pins.

A specific configuration of an embodiment of the present invention will be described below with reference to the drawings. FIG. 2 is a schematic view showing a configuration of a tactile cell of a tactile display device according to an embodiment of the present invention. In the figure, reference numeral 1 denotes a tactile cell, and a plurality of tactile cells 1 constitute a tactile display device. 2
Denotes a tactile sensor, which is provided for detecting contact of a hand or a finger with a plurality of window structure display pins (hereinafter referred to as tactile pins) 3.

The tactile pin 3 has a built-in drive mechanism (not shown) for controlling the state of unevenness by an external control signal in the tactile cell 1, and expresses the structure and function of the window in the form of the unevenness. ing. For example, one haptic cell 1 corresponds to one window, and the position of the haptic pin 3 in the haptic cell 1 represents the structure of the window, and the number of the haptic pins 3 protruding represents the function of the window. .

The tactile cell 1 is provided with a window state inquiry button 4a for reading out detailed information on a window and a window selection button 4b for selecting a window corresponding to the tactile cell 1.

FIG. 3 is a block diagram showing the configuration of a tactile-sensing type graphical user interface device for the visually impaired according to an embodiment of the present invention. In the figure, reference numeral 5 denotes a tactile display device, which is composed of a plurality of tactile cells 1, and as described above, one tactile cell 1 is configured to correspond to one window.

The tactile display device 5 transmits and receives data to and from the computer 6, and the control software 6a of the computer 6 transmits pin array data to the tactile display device 5 and transmits data to the tactile display device 5. The input data of the window state inquiry button 4a and the window selection button 4b is received from the side.

The control software 6a receives window structure data and the like from the graphical user interface software 6b, and transmits input data of the window selection button 4b. Further, the control software 6a transmits data to application software 6c used by a visually impaired person.

The control software 6a outputs voice data to a voice synthesizer 7 provided outside the computer 6, and the voice synthesizer 7 outputs a voice signal from a speaker 8 based on the voice data.

Next, the operation of the tactile sensation type graphical user interface device for the visually impaired in one embodiment of the present invention will be described with reference to the block diagram shown in FIG.

First, in step S1, a window structure corresponding to the application software 6c is obtained.
In step S2, the component name of each window acquired in step S1 is acquired, and in step S3, the structure and function of each window are reflected on each tactile cell 1 of the tactile display device 5.

Then, in step S4, input data from the tactile display device is determined. That is, if the input is from the tactile sensor 2 of the tactile cell 1 in step S4-1, the corresponding window name is set to the speaker 8 in step S5.
, And returns to step S3.

If the input is from the window state inquiry button 4a in step S4-2, the process proceeds to step S4-2.
In step S6, detailed information on the window to which the tactile cell 1 corresponds is output from the speaker 8 by voice.
Return to 3.

If the input is from the window selection button 4b in step S4-3, the window operation data corresponding to the tactile cell 1 is transmitted to the application software 6c in step S7.
Return to 3.

On the other hand, if there is no input in step S4, the process returns to step S3 in step S4-4.

As described above, in the present embodiment, it is possible to easily operate window-compatible application software without looking at the screen.

As described above, the present invention has been described based on the embodiments. However, the present invention is not limited to the above-described embodiments, and may be implemented in any manner unless the configuration described in the claims is changed. it can. For example, in the present embodiment, the application software is configured to operate on a computer corresponding to the tactile display device, but the present invention is not limited to this configuration.
It is also possible to easily operate application software on a computer connected to the computer via a network.

[0024]

As described above, in the graphical user interface system for the visually impaired according to the present invention, the visually impaired can operate window-compatible application software and the like, and can use the software. And the latest software for windows can be easily used.

Further, in the present invention, since parts on the screen can be directly searched for using the tactile sense, the search can be carried out at a high speed. Further, when a visually impaired person touches the tactile display device, the part names and the like are expressed by voice. Therefore, even a visually impaired person who cannot read Braille can easily operate, and has a great effect such as easy operation method learning.

[Brief description of the drawings]

FIG. 1A is a conceptual diagram showing a window screen configuration;
(b) is a conceptual diagram showing a tree structure of windows, and (c) is a conceptual diagram showing each window or component in the form of a contact pin.

FIG. 2 is a schematic view showing a configuration of a tactile cell of a tactile display device according to an embodiment of the present invention.

FIG. 3 is a block diagram illustrating an operation of the tactile-based graphical user interface device for the visually impaired according to an embodiment of the present invention.

FIG. 4 is a flowchart illustrating an operation of the tactile-based graphical user interface device for the visually impaired according to an embodiment of the present invention.

[Explanation of symbols]

REFERENCE SIGNS LIST 1 tactile cell 2 tactile sensor 3 window structure display pin (tactile pin) 4 a window state inquiry button 4 b window selection button 5 tactile display device 6 computer 6 a control software 6 b graphical user interface software 6 c application software 7 voice synthesizer 8 Speaker

Claims (2)

[Claims] 1. A structure and a function of a window of software having a graphical user interface are represented by a display mode of a plurality of tactile pin arrays provided on a tactile display, and by touching the tactile pin array of the tactile display. A graphical user interface system for the visually impaired, characterized in that a visually impaired person can recognize the structure of the graphical user interface by transmitting a window name or a component name of the corresponding graphical user interface by voice. 2. The visually impaired person according to claim 1, wherein the structure and function of the software window are represented by the positions and numbers of tactile pins in the tactile pin array of the tactile display. Graphical user interface method.