JP2757828B2 - I / O interface device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input / output interface of a computer system, and more particularly to an input / output interface having a function of easily changing the input / output interface based on various user characteristics and usable devices. It relates to an interface device.

[0002]

2. Description of the Related Art Conventionally, in information processing apparatuses, persons with disabilities,
Interfaces that correspond to users with various characteristics, such as the elderly, used only those that were created according to the characteristics of the individual user. Can be easily diverted to other users, and can respond to users whose characteristics change over time, such as the elderly, or when users with different characteristics collaborate using the same terminal. It was difficult to change that setting every time it changed. At present, opportunities to use information devices in various situations are increasing, and it is necessary to develop a new interface that can cope with a plurality of characteristics of various users.

In view of the above, Japanese Patent Application Laid-Open No. 6-51970 discloses an "interface device" as a conventional technology in which an input / output method is changed according to a device desired by a user. JP-A-6-5
Japanese Patent Application Laid-Open No. 1970 "Interface device" realizes an input / output interface corresponding to an application and a user interface suitable for information on a user's input / output usage status.

[0004]

However, the above-mentioned Japanese Patent Application Laid-Open Publication No. Hei 6-51970, entitled "Interface Device", is designed for users with various characteristics, such as persons with disabilities and the elderly.
Since information is presented by making the best use of available devices, the method of selecting and presenting information is different even when the same device is used, and each interface function needs to operate in cooperation.

Furthermore, in the prior art, interface devices corresponding to users having various characteristics, such as a disabled person and an elderly person, have been produced only with functions corresponding to the characteristics of individual users. For the user having the above characteristics, it is necessary to develop a new interface device. These interface devices do not have a connection mechanism for cooperating with other interface functions, and do not have a control mechanism for maintaining consistency of connection of a plurality of interfaces.

In view of the above, it is an object of the present invention to provide a user interface function for adjusting the operation of each device, a user interface function for a selection operation, and an input operation for an input operation based on information on user characteristics and usable devices. It is an object of the present invention to provide a consistent interface adapted to a user having a plurality of characteristics by cooperating a user interface function for outputting information and a user interface function for outputting information while maintaining consistency.

[0007]

Means for Solving the Problems The present invention, the first invention,
An application, an operating system controlling the application, one or more input devices such as a keyboard, a mouse, a touch panel, a pen, a push switch, a sensor switch, a joystick, and a single device such as a display, a Braille display, a tactile pin display, and a speaker. Or an input / output interface device including a plurality of output devices and changing an interface between the input device and the output device adapted to a user and the application and the operating system, and a connection relationship and use of the input device and the output device. A device information storage unit that holds information on the possible status, a user information storage unit that holds user information such as the characteristics of the user and the usage status of the system, An input interface library, which is a set of functions for performing corresponding input; an output interface library, which is a set of functions for performing output adapted to the user; a combination of the functions of the input interface library and the output interface library; and each of the functions A library control information storage unit for holding library control information, which is a default parameter of the device, and selecting a function to be activated from the input interface library and the output interface library from the device information, the user information, and the library control information. An interface control unit for determining parameters to be transferred to and from the information control unit; an information structure extraction unit for extracting information on states and screens of the application and the operating system; Depending on the selected activation functions, characterized in that it is composed of said information structure extracting information structure converting unit for performing a structural transformation of the extracted information unit.

A second invention of the present invention provides an application, an operating system for controlling the application, a keyboard, a mouse, a touch panel,
Comprising one or more input devices such as pens, push switches, sensor switches, joysticks, and one or more output devices such as displays, braille displays, tactile pin displays, speakers, etc.
In an input / output interface device for changing an interface between the input device and the output device, the application, and the operating system adapted to a user, device information holding information on a connection relationship between the input device and the output device and a usable state. A storage unit, a user information storage unit that holds user information such as user characteristics and system usage status, an input interface library which is a set of functions for performing input adapted to the user, and a function for performing output adapted to the user An output interface library, which is a set of the above, a combination of functions of the input interface library and the output interface library, and a library control which holds library control information which is a default parameter of each function The information storage unit and the set of functions of the input interface library provide an input adjustment library having an adjustment function and a setting function for the user to use the input device, and a method for the user to select and designate an object. And a library group comprising an input mode library for providing an input method for inputting content information of a document such as a user's text, and a set of functions of the output interface library is used by the user to use the output device. It consists of a library group consisting of an output adjustment library having an adjustment function and a setting function for performing, and an output mode library providing an output method based on visual, auditory, and tactile sensations according to a user.
An interface control unit that selects a library to be activated from the input interface library and the output interface library and determines a parameter to be transferred from the device information, the user information, and the library control information; and Each library of the output interface library includes a program comprising one or more activatable programs for providing respective functions, and a selector for receiving an output from the interface control unit, giving a parameter to an appropriate program, and selectively activating the program. An information structure extraction unit for extracting information on the status and screen of the application and the operating system, and a library to be started selected by the interface control unit. Characterized in that it is composed of an information structure converting unit for performing a structural transformation of the information extracted by the structure extraction unit.

Further, according to a third aspect of the present invention, in the second aspect, when the interface control means selects a library to be activated by acquiring the device information, the user information, and the library control information, Determine whether the device to be used is usable or unusable. If the device to be used is not usable, determine whether or not there is a device to be replaced. Control for using a possible device is performed.

[0010]

Next, an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing one embodiment of the configuration of the input / output interface device of the present invention.

In FIG. 1, 101 is an operating system, 102 is an application, 103 is an output device including a display, a Braille display, a tactile pin display, a speaker, etc., 104 is a keyboard, mouse, touch panel, pen, push switch,
An input device 110 including a sensor switch, a joystick, and the like; an input interface library 110, which is a set of functions for performing input adapted to a user;
Is an input adjustment library having an adjustment function and a setting function for a user to use a device included in the input interface library. 112 is an input adjustment library included in the input interface library for a user to select and designate an object. A selection mode library 113 for providing a method suitable for the user, an input mode library 113 for providing an input method for inputting content information of a document such as a user's text included in the input interface library, and 114 an output adapted to the user Interface library 115, which is a set of functions for performing
Is an output adjustment library included in the output interface library and having an adjustment function for a user using a certain device; 116 is a user-adapted visual, auditory,
An output mode library that provides an output method by tactile sense or the like; 120, a device information storage unit that stores information on device connection and availability; 121, a user information storage unit that stores user characteristic parameters and customization information; Is the input interface library,
A library control information storage unit for storing information for controlling the output interface library; a library 123 that is activated from the device information, the user information, and the library control information from the input interface library and the output interface library; An interface control unit for selecting and exchanging parameters, and performing exclusive control; 124, a selector for giving a parameter to an appropriate library from the output adjustment library and selecting and starting it; and 125, a parameter for an appropriate library from the output mode library A selector 126 for giving and selecting and starting, a selector 126 for giving a parameter to an appropriate library from the selection mode library and selectively starting it, 12
Reference numeral 7 denotes a selector for giving a parameter to an appropriate library from the input mode library and selecting and starting it; 128, a selector for giving a parameter to an appropriate library from the input adjustment library and selecting and starting it; The information structure extraction unit 131 to be extracted is an information structure conversion unit that converts the structure of the information extracted by the information structure extraction unit according to the startup library determined by the interface control unit.

The output interface library 114 includes:
Output adjustment library 115, output mode library 11
Consists of six.

The output adjustment library 115 can use each device of the output device 103 based on the output mode information and parameters sent from the selector 125 in accordance with the output method to the user determined by the output mode library 116. And a group of libraries for adjusting output information. An example is shown in FIG. The selector 124 activates the libraries as shown in FIG. 2 and transfers data between these libraries, and the output mode library 116
Control for receiving data from.

The output mode library 116 changes the output method to the user, and outputs to the output device 103 through the output adjustment library 114. Therefore, the selector 125 is selectively activated by the output mode information sent from the interface control unit 123. Consists of libraries. An example is shown in FIG. The selector 125 controls the activation of libraries as shown in FIG. 3, the transfer of data between these libraries, and the transfer of data to the output adjustment library 115.

The input interface library 110 includes:
Input adjustment library 111, selection mode library 11
2. It consists of an input mode library 113.

The input adjustment library 111 includes a selector 1
26, selection mode library 1 via selector 127
12. The selector 128 adjusts the device driver and input information to be activated to enable input from each device of the input device 104 according to the user's selection operation or input operation method determined by the input mode library 113. Libraries. An example is shown in FIG. The selector 128 starts the libraries as shown in FIG. 4 and transfers data between these libraries, the selection mode library 112 and the input mode library 113.
Control for data transfer to

The selection mode library 112 changes the method of selecting a menu or a document presented by the application 102 or the operating system 101, which is activated by the selector 126 based on the selection mode information from the interface control unit 123.
Through the input device 104 to the operating system 101 and the application 102, and a library group for passing selection information for inputting text and the like to the input mode library 113. An example is shown in FIG. The selector 126 is shown in FIG.
Control of starting libraries and transferring data between these libraries, receiving data from the input adjustment library 111, transferring data to the input mode library 113, and transferring data to the output mode library 116 as shown in FIG. Do.

The input mode library 113 changes the input method of the user's text and graphics, etc., which is activated by the selector 127 based on the input mode information from the interface control unit 123. It is composed of a library group for obtaining input information from the 104 and passing it to the operating system 101 and the application 102. An example is shown in FIG. The selector 127 performs control for activating libraries as shown in FIG. 6, transferring data between these libraries, receiving data from the input adjustment library 111, and transferring data to and from the selection mode library 112.

FIG. 7 shows an example of the relationship of each library in the screen reading interface for the visually impaired, and FIG. 8 shows an example of the relationship of each library in the scanning input interface for the upper limb disabled. The selector of each library activates an appropriate library group and controls data transfer between the libraries.

FIGS. 9, 10 and 11 show flowcharts in the processing of this embodiment.

There are three phases: an adaptation phase for determining an adaptive interface from user information and device information, a setting phase for changing and customizing the current adaptive interface, and an operation phase for performing an operation using the determined adaptive interface. .

FIG. 9 is a flowchart in the adaptation phase.

In the adaptation phase, the user information storage unit 12
Using the user information of No. 1 and the device information of the device information storage unit 120, the interface control unit 123 selects the selection mode library 112, the input mode library 113 in the input interface library 110, and the output mode library 116 in the output interface library 114. Determine the startup library from.

First, device information is obtained from the device information storage unit 120 (600). The device information has information on the usable / impossible state of the currently connected device.

Next, an interface set name adapted to the user is obtained from the user information in the user information storage unit 121 (601). The user information includes an interface set, a user characteristic parameter, and a user customization parameter. The interface set is a combination of interfaces used by the user, and the user characteristic parameters include media usable by the user and the number of switches (keys) usable. The user customization parameter holds a parameter customized by the user among adaptive interfaces used by the user so far.

Next, library control information is obtained from the library control information storage unit 122 (602). The library control information includes a combination of an activation library for an interface set name and a default parameter set. FIG. 12 shows an example of library control information when the interface set name is read out for the screen for the visually impaired.
Shown in

Whether the device necessary for using the interface set acquired in 601 is connected and usable, the device information acquired in 600, 60
It is determined from the library control information acquired in step 2 (60
3). FIG. 13 shows an example of the device information.

When a device necessary for using the interface set is not available, a user characteristic parameter is obtained from the user information in the user information storage unit 121. From the user characteristic parameters and the current interface set and library control information, other devices,
If the library can be replaced, a replacement device and a replacement library are selected (611). If you want to substitute
After acquiring the user customization parameters from the user information in the user information storage unit 121 (612) and modifying them according to the alternative device (613), the library is started from the interface control unit 123 via the selectors 124 to 128. (604). An example is shown in FIG. In this example, since the speaker cannot be used in the device information of FIG. 13, a braille display is used as an alternative device.

If a device necessary for using the interface set is available, a user customization parameter is obtained from the user information in the user information storage unit 121 (620), and the interface control unit 1
23, each library is activated via each of the selectors 124 to 128 (604).

Next, an embodiment of the operation of the setting phase will be described. FIG. 10 is a flowchart in the setting phase.

In the setting phase, the user can change the interface set, library and its parameters currently used.

The information of the activated library is obtained (6
40) Then, device information of the device information storage unit 120,
User characteristic parameters are obtained from the user information in the user information storage unit 121 (641, 642). Also, setting panel information is obtained from each library (643), and a setting panel is generated (644). The setting panel information includes items to be set for the library function, current values, value ranges, options, and the like. Further, library control information is acquired from the library control information storage unit 122.

When Changing the Interface Set (6
In 50), an interface set that can be changed by the interface control unit 123 is presented based on the device information acquired in 641, the user characteristic parameter acquired in 642, and the library control information acquired in 645 (655).
When an interface set to be changed is input (656), a user customization parameter is obtained from the user information in the user information storage unit 121 (657), and 656 is obtained.
After modifying the user customization parameters corresponding to the interface set changed in (658), the interface control unit 123 activates each library via each of the selectors 124 to 128 (646).

When the setting is completed (647), the changed setting is registered, and a new interface set in the user information storage unit 121 is stored (648).

When the library is to be changed (650), the library that can be changed by the interface control unit is presented based on the device information obtained in 641, the user characteristic parameter obtained in 642, and the library control information obtained in 645. (653). When a library to be changed is input (654), a user customization parameter is obtained from the user information in the user information storage unit 121 (6).
57) After modifying the user customization parameters corresponding to the library changed in 656 (658), the interface control unit 123 sends the selectors 124 to 12
Then, each library is started via the program 8 (646).

When the setting is completed (647), the changed setting is registered, and the new interface set in the user information storage unit 121 is stored (648).

When the parameters are to be changed (650), the parameters that can be changed by the interface control unit 123 are presented based on the device information obtained in 641, the user characteristic parameters obtained in 642, and the library control information obtained in 645. (651). When a parameter to be changed is input (652), the interface control unit 12
3 starts each library via each of the selectors 124 to 128 (646).

When the setting is completed (647), the changed setting is registered, and a new interface set in the user information storage unit 121 is stored (648).

FIGS. 15 and 16 show examples of changing the library. In the scan input method interface set for the upper limb disabled person in FIG. 15, a panel scan library, a filtering library, and a screen scan library can be selected from the selection mode libraries. FIG. 16 shows the interface when the screen scan library is selected from the state of the scan input interface for the upper limb disabled person in FIG.
It is.

Next, an embodiment of the operation in the operation phase will be described. FIG. 11 is a flowchart in the operation phase.

In the operation phase, the state and screen information of the application and the operating system which change according to the operation of the user are extracted, and the structure of the extracted information is converted according to the interface set adapted to the user.
This enables the user to easily perform information search and operation.

When the user makes an input or selection from the input device 104, the input interface library 110
, The operating system 101 and the application 102 receive information and perform corresponding operations.
At this time, the information extraction unit 130 determines whether the application 102 or the operating system 1
01, screen information, etc. are extracted (671). The interface control unit 123 gives the information of the currently activated library to the information structure conversion unit 131, and the information structure conversion unit 131 matches the extracted information extracted by the information extraction unit 130 with the currently activated library. Structural conversion (6
72) Then, the library is passed to each library of the selection mode library 112 or the output mode library 116, and each library performs each operation (673).

As described above, an input / output interface using an information format and a medium suitable for various characteristics of the user is provided, and the change can be easily performed.

[0045]

As described above, according to the present invention, not only individual characteristics of a user but also a plurality of characteristics can be handled.
To provide the user with an optimal interface that combines various media and input / output methods of input / output devices according to the situation at the time, and to provide an interface that enables efficient and effective acquisition and creation of information. Can be. Therefore, by using an interface adapted to a plurality of characteristics of the user of the present invention, the input / output method and the media can be optimally selected according to the situation, so that the user can effectively and efficiently obtain information. Can be acquired and created.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an input / output interface device according to an embodiment of the present invention.

FIG. 2 is an example of an output adjustment library of the input / output interface device according to an embodiment of the present invention.

FIG. 3 is an example of an output mode library of the input / output interface device according to an embodiment of the present invention.

FIG. 4 is an example of an input adjustment library of the input / output interface device according to an embodiment of the present invention.

FIG. 5 is an example of a selection mode library of the input / output interface device according to an embodiment of the present invention.

FIG. 6 is an example of an input mode library of the input / output interface device according to an embodiment of the present invention.

FIG. 7 is an example of the association of each library in the screen reading interface for the visually impaired in the present invention.

FIG. 8 is an example of the relation of each library in the scan input interface for the upper limb disabled person according to the present invention.

FIG. 9 is a flowchart illustrating an adaptation phase in processing of the input / output interface device according to an embodiment of the present invention.

FIG. 10 is a flowchart illustrating a setting phase in processing of the input / output interface device according to an embodiment of the present invention.

FIG. 11 is a flowchart illustrating an operation phase in processing of the input / output interface device according to an embodiment of the present invention.

FIG. 12 is an example of library control information according to the present invention.

FIG. 13 is an example of device information according to the present invention.

FIG. 14 is an example of selection of an alternative device in the present invention.

FIG. 15 is an example of a scan input method interface set for an upper limb disabled person according to the present invention.

FIG. 16 is a diagram illustrating a modified example of a library according to the present invention.

[Description of Signs] 101 Operating system 102 Application 103 Output device 104 Input device 110 Input interface library 111 Input adjustment library 112 Selection mode library 113 Input mode library 114 Output interface library 115 Output adjustment library 116 Output mode library 120 Device information storage unit 121 User information storage unit 122 library control information storage unit 123 interface control unit 124 selector 125 selector 126 selector 127 selector 128 selector 130 information structure extraction unit 131 information structure conversion unit

Claims (3)

(57) [Claims] An application, an operating system for controlling the application, a keyboard, a mouse, a touch panel, a pen, a push switch,
A sensor switch, one or more input devices such as a joystick, and a display, a braille display, a tactile pin display, one or more output devices such as speakers, the input device and the output device adapted to the user, the application and the application and In an input / output interface device for changing an interface between the operating systems, a device information storage unit for holding information on a connection relationship and an availability state of the input device and the output device, and a user information and a system usage status. A user information storage unit that holds user information, an input interface library that is a set of functions for performing input adapted to the user, and an output interface library that is a set of functions for performing output adapted to the user A library control information storage unit for holding a combination of functions of the input interface library and the output interface library and library control information that is a default parameter of each function; and the device information, the user information, and the library control information. And an interface control unit for selecting a function to be activated from the input interface library and the output interface library and determining parameters to be transferred, and an information structure extraction for extracting information on states and screens of the application and the operating system. And an information structure conversion unit that performs a structure conversion of the information extracted by the information structure extraction unit in accordance with the activation function selected by the interface control unit. Interface devices. 2. An application, an operating system for controlling the application, a keyboard, a mouse, a touch panel, a pen, a push switch,
A sensor switch, one or more input devices such as a joystick, and a display, a braille display, a tactile pin display, one or more output devices such as speakers, the input device and the output device adapted to the user, the application and the application and In an input / output interface device for changing an interface between the operating systems, a device information storage unit for holding information on a connection relationship and an availability state of the input device and the output device, and a user information and a system usage status. A user information storage unit that holds user information, an input interface library that is a set of functions for performing input adapted to the user, and an output interface library that is a set of functions for performing output adapted to the user A library control information storage unit that holds a combination of the functions of the input interface library and the output interface library and library control information that is a default parameter of each function, and a set of functions of the input interface library. An input adjustment library having an adjustment function and a setting function for using the input device, a selection mode library for providing a method for a user to select and specify an object, and a user for inputting content information of a document such as a text. A set of functions of the output interface library is configured by an input mode library that provides an input method, and a set of functions of the output interface library includes an adjustment function for a user to use the output device, an output adjustment library having a setting function, and According to It comprises a library group consisting of an output mode library that provides an output method based on sensation, hearing, and touch, and starts up from the input interface library and the output interface library based on the device information, the user information, and the library control information. An interface control unit for selecting a library and determining parameters to be transferred;
Each library of the input interface library and the output interface library receives a program consisting of one or more activatable programs for providing respective functions and an output from the interface control unit, and gives parameters to an appropriate program. An information structure extraction unit that includes a selector for selectively starting the information, and extracts information on the state and screen of the application and the operating system, and the information structure extraction unit according to a library to be started selected by the interface control unit. An input / output interface device comprising: an information structure conversion unit that performs a structure conversion of the extracted information. 3. When the interface control means selects a library to be activated upon acquiring the device information, the user information and the library control information, it determines whether a device to be used is usable or unusable. If the device to be used is unavailable, it is determined whether or not there is a device to be replaced, and if replacement is possible, control to use the device that can be replaced is performed. The input / output interface device according to claim 2, wherein: