JP7047401B2 - Information processing equipment, information processing methods and programs - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method and a program.

Conventionally, there is known a technique of a screen reader that assists a visually impaired person such as a person with low vision, a person with color vision deficiency, or a blind person to operate a device by reading out the operation information of the device by voice. The operation information of the device is information necessary for a visually impaired person to operate the device by voice, and the operation information includes information explaining how to use the device or text information displayed on the display screen of the device. Etc. are included. By enabling the screen reader setting of the device by the device administrator, the operation information of the device is read aloud, and even a visually impaired person can operate the device.

Some image processing devices execute processing in a dedicated display mode according to the degree of disability such as a healthy person, a moderately disabled person, and a severely visually impaired person. The image processing device first displays a password input screen with good visibility for a person with a moderate degree of disability during the authentication process, and omits the password input process for a person with a severe visual disability. After the authentication process, the image processing device is activated in a dedicated display mode for visually impaired persons such as people with low vision or color vision deficiency, and executes processing under the restriction of predetermined security-related functions (Patent Document 1). reference).

However, for functions that are not compatible with conventional screen readers, the transition to the function is prevented by hiding the function button or application icon corresponding to the function from the operation screen, so that the user can support the surroundings. There is a problem that the function that is not compatible with the screen reader cannot be operated even in the case where the screen reader can be obtained or the visual acuity can be corrected.

The present invention has been made in view of the above, and an object of the present invention is to operate a function that is not compatible with a screen reader if the user intends, even if the user is a visually impaired person who requires a screen reader. do.

In order to solve the above-mentioned problems, the information processing apparatus has a voice output control unit that controls the voice to be operated on the operation screen related to the program to be output by the voice output means, and supports voice explanations associated with each program. The voice explanation correspondence information acquisition unit for acquiring information and the operation screen control unit for controlling the display of the program on the operation screen according to the voice explanation correspondence information acquired by the voice explanation correspondence information acquisition unit . The voice explanation correspondence information includes information indicating whether or not the voice for operation on the operation screen related to the program can be output, and the voice output control unit operates based on the voice explanation correspondence information. When the voice for prompting the operation is output on the screen and the voice explanation correspondence information does not correspond to the voice for operation on the operation screen related to the first program, the voice output control unit is described by the first program. It is characterized in that it outputs a voice indicating that it does not correspond to the above and a voice prompting to start a recovery process transitioning to another program corresponding to the voice explanation .

Even visually impaired people who require a screen reader can operate functions that are not compatible with screen readers if the user intends to do so.

It is a figure which shows the system configuration example of the MFP1 in embodiment of this invention. It is a figure which shows the hardware configuration example of the MFP1 in embodiment of this invention. It is a figure which shows the functional structure example of the operation device 20 in embodiment of this invention. It is a figure which shows an example of the application information table in embodiment of this invention. It is a sequence diagram for demonstrating the process which transitions to the function which is not compatible with a screen reader in embodiment of this invention. It is a sequence diagram for demonstrating the process which concerns on the accessibility level guidance in embodiment of this invention. It is a figure which shows an example of the display of the function which is not compatible with a screen reader in embodiment of this invention. It is a sequence diagram for demonstrating the process of recovering from the function which is not compatible with a screen reader in embodiment of this invention.

Hereinafter, embodiments of the information processing apparatus, information processing method, and program according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a diagram showing an example of a system configuration of the MFP 1 according to the embodiment of the present invention. The MFP1 (Multifunction Peripheral) is a device having two or more different functions among a plurality of functions such as a copy function, a scanner function, a printer function, and a fax function. The MFP1 is not limited to a device having two or more functions, but may be a printer device having a single function or the like. Further, the MFP 1 may be a device or system such as an electronic blackboard or an electronic conference system.

As shown in FIG. 1, the MFP 1 has a main body 10 and an operation device 20. The main body 10 is an example of an "image processing device", and has an image processing unit for copying or scanning, an image forming unit for forming an image, and the like. The main body 10 receives an operation command from the outside and controls an image processing unit, an image forming unit, or the like in response to the operation command.

The operation device 20 is shown as an example of the "information processing device" according to the embodiment of the present invention. The operation device 20 provides a user interface for the user to set or operate the main body 10. The main body 10 and the operation device 20 are communicated and connected by wire or wirelessly, and an operation command or data or the like is transmitted / received via the communication path 30 (see FIG. 2). The user transmits an operation command to the main body 10 by the operation device 20, and the main body 10 receives the operation command and executes image processing or image formation processing.

FIG. 2 is a diagram showing a hardware configuration example of the MFP 1 according to the embodiment of the present invention. As shown in FIG. 2, the main body 10 has a CPU (Central Processing Unit) 100, a ROM (Read Only Memory) 101, a RAM (Random Access Memory) 102, an HDD (Hard Disk Drive) 103, a communication I / F 104, and a connection. It has an I / F 105 and an engine 106. The hardware is connected to each other via the system bus 107.

The CPU 100 is a central processing unit that executes arithmetic processing or control processing. The CPU 100 reads various programs stored in the ROM 101, the HDD 103, or the like into the RAM 102, executes arithmetic processing or control processing, and controls the main body 10 in an integrated manner.

The ROM 101 is a non-volatile memory for storing a fixed program (for example, BIOS (Basic Input / Output System) or the like). The RAM 102 is a volatile memory used by the CPU 100 as a work area or the like during various processes. The HDD 103 is an auxiliary storage device that stores an OS (Operating System), an application program, a large amount of data, and the like. In addition, in this specification, "application" refers to "application".

The communication I / F 104 is an interface for the main body 10 to connect to a communication network such as a LAN (Local Area Network) or a VPN (Virtual Private Network).

The connection I / F 105 is an interface such as a USB (Universal Serial Bus) standard for communicating with the operating device 20 via a communication path 30. The connection between the main body 10 and the operation device 20 is not limited to USB, and may be another bus or LAN. Further, the communication path 30 is not limited to wired and may be wireless.

The engine 106 includes an image processing controller, a scanner that scans and reads a document, a plotter that prints on a recording medium such as paper, and the like.

The operation device 20 shown in FIG. 2 includes a CPU 200, a ROM 201, a RAM 202, a flash memory 203, a communication I / F 204, a connection I / F 205, a touch panel 206, an LCD (Liquid Crystal Display) 207, an audio output unit 208, and a card reading unit 209. Has. The hardware is connected to each other via the system bus 210.

The CPU 200 is a central processing unit that executes arithmetic processing and control processing. The CPU 200 reads various programs stored in the ROM 201, the flash memory 203, or the like into the RAM 202, executes arithmetic processing or control processing, and controls the entire operating device 20 in an integrated manner.

The ROM 201 is a non-volatile memory for storing a fixed program (for example, BIOS or the like). The RAM 202 is a volatile memory used by the CPU 200 as a work area or the like during various processes. The flash memory 203 is an auxiliary storage device for storing an OS, an application program, a large amount of data, and the like.

The communication I / F 204 is an interface for the operating device 20 to connect to a communication network such as a LAN or VPN.

The connection I / F 205 is an interface such as a USB standard for communicating with the main body 10 via a communication path 30. The connection between the main body 10 and the operation device 20 is not limited to USB, and may be another bus or LAN. Further, the communication path 30 is not limited to wired and may be wireless.

The touch panel 206 is an input device that detects a touch position by an operator on the screen of the LCD 207 and notifies the CPU 200 of the detected touch position information. In addition to the touch panel 206, a hardware key or the like may be provided as the input device.

The LCD 207 is, for example, an example of a display means having a liquid crystal display device and displaying screen information output to the LCD 207 by the CPU 200. In addition to the liquid crystal display, an organic EL (Electro Luminescence), an LED (Light Emitting Diode), a lamp, or the like may be used as the display means.

The audio output unit 208 includes a D / A conversion circuit, an amplifier, a speaker, and the like. The audio output unit 208 converts the digital audio signal output by the CPU 200 into an analog audio signal, amplifies the converted analog audio signal, and propagates the converted analog audio signal from the speaker into the air as audio.

The card reading unit 209 is a card reading device that reads authentication information from a personal identification card that stores authentication information. The personal identification card is, for example, a magnetic card or an IC card.

FIG. 3 is a diagram showing a functional configuration example of the operation device 20 according to the embodiment of the present invention. The operation device 20 realizes the function of the display device, which is directly operated by the user and provides an interface that enables the function of the device to be used via the application, by the touch panel 206, the LCD 207, or the like shown in FIG. The applications A1 to A4 are application software, which are installed on the operation device 20 and realize an interface that provides a plurality of functions to the user. As an example, four apps A1 to A4 are illustrated, but a larger number of apps may be installed on the operation device 20. Portal apps PA1 and PA2 are application software that provides a gateway to transitions to other apps or functions. For example, a home application such as a launcher is a portal application. The portal application acquires accessibility information of the transition destination application from the application information management unit 308, and performs processing according to the accessibility information. Although two apps PA1 and PA2 are illustrated as an example, a larger number of portal apps may be installed on the operation device 20.

The setting control unit 302 changes the setting of the screen reader function according to the authentication status of the user, associates the setting for each user by using the personal information management unit 303, and notifies the application of the screen reader setting change change.

The authentication control unit 301 notifies the setting control unit 302 of the authentication status including the login status of the user.

The personal information management unit 303 writes and calls the screen reader setting information for each user in the personal information DB 304. The personal information DB 304 stores the setting information for each user.

The text-to-speech control unit 305 controls the detection of the focus position in the user interface and the text-to-speech using the text-to-speech engine 306 in order to realize the screen reader function. The text-to-speech engine 306 converts text information into voice data and reads it out. The voice output unit 307 is realized by the voice output unit 208 shown in FIG. 2, and outputs the voice information generated by the text-to-speech engine 306 as voice.

The application information management unit 308 writes and calls the information of each application installed in the operation device 20 into the application information DB 309. The application information can include metadata for each application, and the metadata includes accessibility information, that is, information such as screen reader full compatibility, screen reader non-compliance, or accessibility unknown.

The application information DB 309 stores accessibility and the like of each application or each function installed in the operation device 20.

The personal information DB 304 or the application information DB 309 may not be included in the operation device 20, and may be arranged, for example, in a server or the like via a network.

FIG. 4 is a diagram showing an example of an application information table according to the embodiment of the present invention. As shown in FIG. 4, the application installed in the operation device 20 is managed by generating an application information table including accessibility information from the metadata registered for each application. Also, if accessibility level information does not exist in the metadata of the app, it is treated as unknown accessibility.

In the example of the metadata of the application shown in FIG. 4, the accessibility level of "application A" whose ID is "1" is "all screen reader compatible". The accessibility level of "App B" whose ID is "2" is "Not compatible with screen readers". The accessibility level of "App C" whose ID is "3" is "Unknown".

When an operation is performed for each function via the portal application, the portal application acquires the accessibility level of the operation target application acquired from the application information management unit 308, and performs control set according to the level.

FIG. 5 is a sequence diagram for explaining a process of transitioning to a function not compatible with a screen reader in the embodiment of the present invention.

In step S101, the user performs an application start operation for the portal application PA1. Subsequently, the portal application PA1 acquires the accessibility level of the application started and operated from the application information management unit 308 (S102).

In step S103, the portal application PA1 determines the acquired accessibility level. Since the launched application is a function that does not support screen readers, the accessibility level is determined to be "not compatible with screen readers", and the portal application PA1 sends a voice guidance command to the text-to-speech engine 306 (S104). .. Subsequently, the text-to-speech engine 306 performs the function transition confirmation voice guidance to the user (S105). For example, the function transition confirmation voice guidance is a message such as "I am trying to transition to a function that is not compatible with screen readers. Is it really transitioning?"

If the transition is intended by the user, the process proceeds to step S106a, and the user inputs the transition permission to the portal application PA1. For example, the intention is that the user does not transition to a function that the screen reader does not support because of low vision, but the eyesight is corrected with glasses or the like, or the support of surrounding people can be obtained. Then, it is conceivable that the function shifts to a function that is not compatible with the screen reader. Subsequently, the portal application PA1 transitions to the transition-permitted function (S107).

On the other hand, if the transition is unintended by the user, the process proceeds to step S107a, and the user inputs the transition cancellation to the portal application PA1. For example, there may be a case where an operation error or the like unintentionally attempts to shift to a function that is not compatible with a screen reader.

FIG. 6 is a sequence diagram for explaining a process related to accessibility level guidance in the embodiment of the present invention. A process of guiding how much the function of the sensor device of the functional item corresponds to the screen reader when the functional item displayed on the operation device 20 is selected when the screen reader is enabled will be described.

In step S201, the user selects a functional item on the portal application PA1. Subsequently, the portal application PA1 subsequently acquires the accessibility level of the application corresponding to the functional item selected from the application information management unit 308 (S202). In step S203, the portal application PA1 determines the acquired accessibility level. The portal application PA1 transmits a voice guidance command to the text-to-speech engine 306 according to the acquired accessibility level "screen reader not supported", "screen reader fully supported", "unknown", or the like (S204). Subsequently, the text-to-speech engine 306 provides accessibility level voice guidance to the user (S205). For example, the accessibility level voice guidance is a message such as "function name (app name, this function is fully supported / partially supported / not supported / unknown".

FIG. 7 is a diagram showing an example of display of a screen reader non-compatible function according to the embodiment of the present invention. An example of changes in the user interface when limiting functions that are not compatible with screen readers when the screen reader is enabled will be described.

FIG. 7A is an example of a screen display on the operating device 20 in a normal state. All function buttons, function items, etc. are displayed.

FIG. 7B is an example of screen display on the operating device 20 when the screen reader is enabled. Function buttons, app icons or function items for functions that are not compatible with screen readers are grayed out and displayed. The grayout may be hidden. In FIG. 7B, a function button, an application icon, or a function item of a function that is not compatible with a screen reader is a grayed out example, but may be shown by other display changes. For example, the operation device 20 may display a function button, an application icon, or a function item of a function that is not compatible with a screen reader, such as changing the color from normal or making it high contrast. Since the user interface that is easy to distinguish differs depending on the visual impairment, a plurality of patterns of user interface changes may be prepared.

FIG. 8 is a sequence diagram for explaining a process of recovering from a screen reader non-compliant function according to the embodiment of the present invention.

In step S301, in which the screen reader non-compatible function application is not started, the user performs an operation to start the screen reader non-compatible function application from the portal application PA1. Subsequently, the portal application PA1 acquires the accessibility level of the application started and operated from the application information management unit 308 (S302).

In step S303, the portal application PA1 determines the recovery method according to the acquired accessibility level. Since the launched application is a function that does not support screen readers, the accessibility level is determined to be "not compatible with screen readers", and the portal application PA1 sends a voice guidance command to the text-to-speech engine 306 (S304). .. Subsequently, the text-to-speech engine 306 provides the user with voice guidance on the recovery method (S305). For example, the recovery method voice guidance is a message such as "This function is not compatible with screen readers. Please do to return to the previous function. If you want to play this voice again, please do". .. Here, the recovery method is a method that can be executed without relying on vision such as pressing a physical key or voice recognition. The user can perform an operation to start recovery based on the recovery method voice guidance.

As another case, in step S401 in which the screen reader non-compatible function application is activated, the user performs a recovery method voice guidance playback operation on the screen reader non-compatible application A1. The reproduction operation is a method that can be executed without relying on the visual sense such as pressing a physical key or voice recognition. Subsequently, the screen reader non-compatible application A1 transmits a recovery method voice guidance playback request to the portal application PA1 (S402).

In step S403, the portal application PA1 determines a recovery method from the screen reader non-compatible application A1. The portal application PA1 transmits a voice guidance command to the text-to-speech engine 306 (S404). Subsequently, the text-to-speech engine 306 provides the user with voice guidance on the recovery method (S405). The voice message output in step S405 may be the same as that of S305.

As described above, by outputting the recovery method as a voice message when the function that is not compatible with the screen reader is activated or has already been activated, it is possible to transition to the function or application that is compatible with the screen reader.

As described above, according to the embodiment of the present invention, when the user tries to transition to a function that does not support the screen reader while the user has the screen reader enabled, the operation device 20 is a voice for confirming the function transition. Output a message to confirm the user's intention. If the transition is intended by the user, the transition can be permitted, and if the transition is not intended by the user, the transition can be canceled. Also, by determining the accessibility level of the application to be started and outputting a voice message of the accessibility level, the user can confirm whether the application to be started is compatible with a screen reader. In addition, by outputting the recovery method as a voice message when the function that is not compatible with the screen reader is activated or has already been activated, it is possible to transition to the function or application that is compatible with the screen reader.

That is, even a visually impaired person who requires a screen reader can operate a function that is not compatible with the screen reader if the user intends to do so.

The program executed by the information processing system of the present embodiment is a file in an installable format or an executable format, and is a CD-ROM (Compact Disk --Read Only Memory), a flexible disk (Flexible Disk), or a CD-R (CD-R). Compact Disk --Recordable), DVD (Digital Versatile Disk), etc. are recorded and provided on a computer-readable recording medium.

Further, the program executed by the information processing system of the present embodiment may be stored on a computer connected to a network such as the Internet and provided by downloading via the network. Further, the program executed by the information processing system of the present embodiment may be configured to be provided or distributed via a network such as the Internet. Further, the program of the present embodiment may be configured to be provided by incorporating it into a ROM or the like in advance.

Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" as used herein is a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

In the embodiment of the present invention, the application or function is an example of a program. The accessibility level is an example of voice explanation correspondence information. The portal application PA1 is an example of a voice output control unit, a voice explanation correspondence information acquisition unit, an operation screen control unit, or a voice output control unit. An icon or a functional item is an example of an item.

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to such a specific embodiment, and various modifications are made within the scope of the gist of the present invention described in the claims.・ Can be changed.

1 MFP
10 Main unit 20 Operation panel 100 CPU
101 ROM
102 RAM
103 HDD
104 Communication I / F
105 Connection I / F
106 engine 200 CPU
201 ROM
202 RAM
203 Flash memory 204 Communication I / F
205 Connection I / F
206 touch panel 207 LCD
208 Voice output unit 209 Card reading unit 301 Authentication control unit 302 Setting control unit 303 Personal information management unit 304 Personal information DB
305 Text-to-speech control unit 306 Text-to-speech engine 307 Voice output unit 308 App information management unit 309 App information DB
A1-A4 App PA1, PA2 Portal App

Japanese Unexamined Patent Publication No. 2007-28202

Claims (4)

A voice output control unit that controls voice output by voice output means for operation on the operation screen related to the program, and a voice output control unit.
The voice explanation correspondence information acquisition unit that acquires the voice explanation correspondence information associated with each program, and
It has an operation screen control unit that controls the display of a program on the operation screen according to the voice explanation correspondence information acquired by the voice explanation correspondence information acquisition unit .
The voice explanation correspondence information includes information indicating whether or not voice for operation can be output on the operation screen related to the program.
The voice output control unit outputs a voice prompting an operation on the operation screen based on the voice explanation correspondence information.
When the voice explanation correspondence information does not correspond to the voice for operating on the operation screen related to the first program, the voice output control unit indicates the voice and the voice explanation indicating that the first program does not correspond to the voice explanation. An information processing device characterized in that it outputs a voice prompting the start of recovery processing that transitions to another program corresponding to . When the voice explanation correspondence information does not correspond to the voice for operating on the operation screen related to the program, the operation screen control unit displays an item on the operation screen for activating the program associated with the voice explanation correspondence information. The information processing apparatus according to claim 1 , wherein the information processing apparatus is hidden or grayed out. A voice output control procedure for controlling the voice to be operated on the operation screen of the program by the voice output means, and a voice output control procedure.
Voice explanation correspondence information acquisition procedure to acquire voice explanation correspondence information associated with each program, and
An operation screen control procedure for controlling the display of the program on the operation screen according to the voice explanation correspondence information acquired by the voice explanation correspondence information acquisition procedure, and
And run
The voice explanation correspondence information includes information indicating whether or not voice for operation can be output on the operation screen related to the program.
A procedure for outputting a voice prompting an operation on the operation screen based on the voice explanation correspondence information, and
When the voice explanation correspondence information does not correspond to the voice for operating on the operation screen related to the first program, the voice indicating that the first program does not correspond to the voice explanation and another program corresponding to the voice explanation are used. A procedure to output a voice prompting the start of the transitional recovery process, and
An information processing method characterized by executing. A program that can be executed by an information processing device
A voice output control procedure for controlling the voice to be operated on the operation screen of the program by the voice output means, and a voice output control procedure.
Voice explanation correspondence information acquisition procedure to acquire voice explanation correspondence information associated with each program, and
An operation screen control procedure for controlling the display of the program on the operation screen according to the voice explanation correspondence information acquired by the voice explanation correspondence information acquisition procedure, and
Is executed by the information processing apparatus.
The voice explanation correspondence information includes information indicating whether or not voice for operation can be output on the operation screen related to the program.
A procedure for outputting a voice prompting an operation on the operation screen based on the voice explanation correspondence information, and
When the voice explanation correspondence information does not correspond to the voice for operating on the operation screen related to the first program, the voice indicating that the first program does not correspond to the voice explanation and another program corresponding to the voice explanation are used. A procedure to output a voice prompting the start of the transitional recovery process, and
Is executed by the information processing apparatus .

Images