JP2010198408A - Interface device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an interface device which is high in operability, and a program therefor. <P>SOLUTION: A CPU 14 stores, in a work area 31, item-position information which represents the display positions on a screen of multiple kinds of items to be displayed on a monitor 6, and displays the items on the display positions on the monitor 6 in accordance with the item-position information. The CPU 14 receives, from a mouse 8, pointer-position information which represents the moving direction and movement amount of a pointer and displays a movable pointer P1 on the monitor 6. The CPU 14 correlates item-intermittent sounds, which have peculiar item-intermittent frequencies 305 or peculiar item-intermittent sound volumes 307 for each item, with the items, respectively, and then stores the sounds concerned in an item table 301. The CPU 14 outputs the item-intermittent sounds correlated with the items. When a plurality of the items are displayed on the monitor 6, a plurality of the item-intermittent sounds are outputted in the same period. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a program and an interface device that cause a computer to function as interface means.

  In recent computers, GUI (Graphical User Interface) is often used. In addition, a technique for improving the availability of a GUI when a visually impaired user uses the GUI is disclosed. For example, a composite audible signal is generated according to the position of the pointer displayed on the display device of the computer. The user searches for the selected object displayed on the display device using the composite audible signal.

JP-A-5-233188

  However, when the target is a visually impaired person, even the above-described technology does not provide sufficient operability to the visually impaired person. In particular, even in the above technology, when a plurality of items are displayed on the display device, and one item needs to be selected from them, a technology for listening to each single tone from the composite audible signal is required, and skill is required. Cost. In addition, even when the subject is a healthy person, the same problem occurs in a usage pattern in which it is difficult to always see the screen. The present specification provides a technique capable of providing an interface unit having higher operability.

  The computer and the interface device according to the present invention include item display means and pointer display means. The item display means stores, in the storage means, item position information representing display positions on the screen of a plurality of types of items displayed on the screen. Examples of items include an OK button and a CANCEL button. Moreover, as an example of the display position of an item, the coordinate on the screen of an item is mentioned. The item display means displays an item having a display position corresponding to the item position information on the screen. The pointer display means receives pointer position information indicating the movement direction and movement amount of the pointer from the pointing device. Examples of pointing devices include a mouse and a pen tablet. An example of the pointer is an arrow displayed on the screen. The pointer display means displays a movable pointer on the screen according to the pointer position information.

  The program according to the present invention causes a computer to function as a storage control unit and a sound output unit. The interface device according to the present invention includes storage control means and sound output means. The storage control means stores an intermittent sound having a unique frequency or unique volume for each item in association with each item. The intermittent sound is a sound that has a silent part and is generated intermittently. The pitch of the sound is determined by the frequency of the intermittent sound. The pitch of the sound increases as the frequency increases. In addition, by associating an intermittent sound having a specific frequency (pitch) with each item, it is possible to recognize the item type by identifying the pitch of the intermittent sound. Further, by associating an intermittent sound having a specific volume with each item, it is possible to recognize the item type by identifying the magnitude of the intermittent sound. Needless to say, an intermittent sound having both a specific frequency and a specific volume may be associated with each item. The sound output means outputs an intermittent sound associated with the item. When a plurality of items are displayed on the screen, a plurality of intermittent sounds are output at the same time.

  As a result, a sound having a specific frequency (pitch) or a specific volume for each item is generated as an intermittent sound. Even in the case where a plurality of intermittent sounds are generated, the intermittent sound has a silent portion, so that it is possible to reduce a situation in which the intermittent sounds are overlapped with each other. Then, since multiple sounds overlap and occur, it is less likely that the sound will be undulating or distorted, so the frequency (pitch) and volume of each of the multiple intermittent sounds should be clearly defined. I can tell you. Therefore, the discriminability of items can be improved, and the convenience for the user can be improved.

  Further, the storage control means may store an intermittent sound having a specific intermittent period for each item in association with each item. An intermittent sound having an intermittent period is a sound that is generated intermittently with periodicity. The intermittent period is a time interval between sounds. Thereby, in addition to a frequency and a volume, an item can be identified by an intermittent period. Therefore, since item identification standards increase, it becomes possible to further improve the item identification.

  Further, the computer may function as a distance calculation unit and a first item selection unit. The distance calculation means may calculate the mutual distance between the item and the pointer based on the item position information and the pointer position information. Further, the first item selection means may select the first predetermined number of items in order from the item having the smallest mutual distance when a plurality of items are displayed on the screen. The first predetermined number may be determined in advance by a user or the like. Thereby, for example, even when a large number of items are displayed on the screen, it is possible to generate an intermittent sound only for the first predetermined number of items near the pointer. Therefore, it is possible to prevent a situation in which the identification of an item is deteriorated because a large number of intermittent sounds are generated at the same time.

  Further, the computer may function as a distance calculation unit and a second item selection unit. The distance calculation means may calculate the mutual distance between the item and the pointer based on the item position information and the pointer position information. The second item selection means may select items within a predetermined distance in which the mutual distance is predetermined when a plurality of items are displayed on the screen. The predetermined distance may be determined in advance by a user or the like. Thereby, for example, even when a large number of items are displayed on the screen, it is possible to generate intermittent sound only for items existing within a predetermined radius centered on the pointer. Therefore, it is possible to prevent a situation in which the identification of an item is deteriorated because a large number of intermittent sounds are generated at the same time.

  Further, the computer may function as window display means and window selection means. The window display means stores window position information representing the display position of the window in the storage means. A window is an area on a screen activated by an application, and various items are arranged on the surface thereof. Examples of applications include word processing software, spreadsheet software, and photo processing software. Examples of window display position information include the coordinates of the window on the screen and the size of the window. The window display means displays a window having a display position corresponding to the window position information on the screen. The window selection means receives an input from the pointing device and selects an operation target window. As an example of an input from the pointing device, there is an input operation in which a pointer is moved on a window displayed on the screen and then a button of the pointing device is clicked. Further, the storage control means may store continuous sounds having a specific frequency or a specific volume for each window in association with each window. A continuous sound is a sound which does not have a silence part and does not have a discontinuity. The sound output means may output a continuous sound associated with the window selected as the operation target by the window selection means together with the intermittent sound.

  As a result, an intermittent sound having a unique frequency (pitch) or unique volume for each item and a continuous sound having a unique frequency (pitch) or unique volume for each window are simultaneously generated. Generated. Even when the intermittent sound and the continuous sound are generated at the same time, since the intermittent sound has a silent portion, the continuous sound can be heard in the silent portion. Then, the window can be identified by the continuous sound, and at the same time, the item can be identified by the intermittent sound. Therefore, since the identification of the window and the identification of the item can be performed at the same time, it is possible to further improve the convenience for the user.

  Further, the sound output means may shorten the intermittent period of the intermittent sound in response to the mutual distance becoming small. Thereby, the intermittent period of an intermittent sound becomes short, so that a pointer approaches an item (the space | interval of a sound and a sound becomes narrow). Therefore, since the user can recognize the mutual distance between the pointer and the item based on the intermittent period of the intermittent sound, the convenience for the user can be further enhanced.

  The sound output means may increase the intermittent period of the intermittent sound for each item by a predetermined ratio in response to the first instruction being input from the input means. The predetermined ratio may be determined in advance by a user or the like.

  Thereby, when distinguishing a plurality of intermittent sounds, if the intermittent period is small and difficult to distinguish, the intermittent period can be widened by giving the first instruction. Therefore, it becomes possible to further improve the identification of items by the intermittent period. In addition, since the intermittent period is expanded at a predetermined rate, the magnitude relationship of the intermittent periods among a plurality of intermittent sounds is maintained. Therefore, it is possible to maintain the item identifiability due to the intermittent period.

In addition, the first item selection means selects a second predetermined number of items smaller than the first predetermined number in order from the item having the smaller mutual distance in response to the input of the first instruction from the input means. Also good.
The sound output means may increase the intermittent period of the intermittent sound for each of the second predetermined number of items by a predetermined ratio. The predetermined ratio may be determined in advance by a user or the like.

  As a result, even when a large number of intermittent sounds are generated at the same time and it is difficult to distinguish them, the number of generated intermittent sounds is reduced to a second predetermined number smaller than the first predetermined number by performing the first instruction. Can be reduced. Therefore, since the items to be identified can be further narrowed down, it becomes possible to further improve the item identification.

  Further, the sound output means may increase the volume of the intermittent sound in accordance with a decrease in the mutual distance. Thereby, the volume of the intermittent sound increases as the pointer approaches the item. Therefore, since the user can recognize the mutual distance between the pointer and the item based on the volume of the intermittent sound, the user's convenience can be further improved.

  The sound output means may output the sound in association with the intermittent sound associated with the item and the identification information representing the content of the item in response to the second instruction being input from the input means. . As an example of the second instruction, there is an instruction performed by pressing a key on the keyboard assigned for inputting the second instruction. Examples of the identification information include item names and item content descriptions. Further, as a method of outputting a sound by associating the intermittent sound with the identification information, for example, a method of outputting the identification information as a sound immediately after the sound of the intermittent sound is output may be mentioned. Thereby, since the user can confirm the correspondence between the intermittent sound and the content of the item by inputting the second instruction, the convenience of the user can be further enhanced.

2 is a diagram illustrating a configuration of an input device 1. FIG. It is the monitoring flow figure (the 1) of a pointer position. It is the monitoring flow figure (the 2) of a pointer position. It is a confirmation flowchart of a response | compatibility with an item and an item intermittent sound. It is a confirmation flow figure of correspondence with a window and window continuous sound. It is an example of a display of the item and pointer on a monitor. It is a figure which shows the table example of a window table and an item table.

  Embodiments will be described with reference to the drawings. As shown in FIG. 1, the input device 1 includes a control unit 10, a keyboard 2, a speaker 4, a monitor 6, and a mouse 8. An example of the input device 1 is a personal computer (PC). The keyboard 2 includes a space key, a return key, a function key (F1 key, F3 key, etc.), a numeric key, and the like. The speaker 4 outputs audio information generated by the audio output program 26. The monitor 6 displays items, pointers, and the like which will be described later. The mouse 8 includes an input button. The mouse 8 transmits pointer position information, which will be described later, and information related to the pressing operation of the input button to the control unit 10.

  The control unit 10 is connected to the CPU 14, the storage device 20, the RAM 30, and the interface 13 via the bus 12. The storage device 20 is a nonvolatile storage device such as a hard disk or NVRAM. The storage device 20 stores a control program 21, an audio output program 26, a parameter storage area 27, and the like. The control program 21 is a program for controlling the entire input device 1 such as power management, input / output management, and control of each program. The voice output program 26 is a program that converts an item name or the like into voice information and reads it out. Examples of the audio output program 26 include well-known software such as a voice over function provided in an OS (Operating System). The parameter storage area 27 is a storage area for storing various parameters used when the CPU 14 executes processing according to the control program 21. In the parameter storage area 27, a window table 201 and an item table 301 are stored.

  FIG. 7A shows a table example of the window table 201. In the window table 201, various settings for windows are registered. The window is displayed by an application such as drawing software, word processing software, or spreadsheet software. The application has a function of displaying one or more windows on the monitor 6. In the window table 201, a window identification number 202, a window name 203, a window continuous sound frequency 204, and a window continuous sound volume 205 are registered. The window identification number 202 is a number for distinguishing windows. A window name 203 is a name of the window. In this embodiment, as an example, a case where the name of an application displaying a window is used as the window name 203 will be described. The window continuous sound frequency 204 is a frequency of the window continuous sound. A window continuous sound is a sound associated with each window at a frequency unique to each window. Moreover, a continuous sound is a sound which does not have a silence part and does not have a discontinuity. As the window continuous sound frequency 204 increases, the height of the window continuous sound increases. The user can identify the type of window by recognizing the pitch of the window continuous sound. The window continuous sound volume 205 is the volume of the window continuous sound. The user can also identify the type of window by listening to the volume of the window continuous sound. Each time a new window is displayed, the window is added to the window table 201, and is deleted each time the window is deleted. This processing is performed by a service incorporated as part of the OS.

  FIG. 7B shows a table example of the item table 301 related to the window W1. The item table 301 is created for each window. Various settings for items are registered in the item table 301. An item is an object that can be selected by a pointer represented by a small picture or symbol on the monitor 6. Examples of items include various buttons such as an OK button, a text box used for character input, and the like. In the item table 301, an item identification number 302, an item type 303, an item name 304, an item intermittent sound frequency 305, an intermittent period 306, and an item intermittent sound volume 307 are registered. The item identification number 302 is a number for distinguishing items. The item type 303 is information representing an item type such as a button or a text box. The item name 304 is an item name. The item intermittent sound frequency 305 is an initial value of the frequency of the item intermittent sound. The item intermittent sound is a sound associated with each item at a frequency unique to each item. The intermittent sound is a sound that has a silent part and is generated intermittently. As the item intermittent sound frequency 305 increases, the height of the item intermittent sound increases. The intermittent period 306 is an initial value of the interval time between intermittent sounds. The item intermittent sound volume 307 is an intermittent sound volume. Note that the values of the item intermittent sound frequency 305, the intermittent period 306, and the item intermittent sound volume 307 assigned to the item may be arbitrary values.

  The user can identify the item type by hearing the difference between items for at least one of the item intermittent sound frequency 305 (pitch) of the item intermittent sound, the intermittent period 306, and the item intermittent sound volume 307. Become. Thereby, since the three identification criteria of the item intermittent sound frequency 305, the intermittent period 306, and the item intermittent sound volume 307 can be used for identification of an item kind, it becomes possible to further improve the item identification. .

  The RAM 30 is a volatile readable / writable memory, and is an area for temporarily storing various information in the selective input process. The work area 31 is a storage area for storing item position information, pointer position information, and the like.

  A display form such as an item or a pointer on the monitor 6 will be described with reference to a display example of FIG. The CPU 14 executes the selected application. For example, by double-clicking the input button of the mouse 8 with the pointer positioned on the icon representing the application, the application is selected as an execution target, and the execution of the program is started. A plurality of applications can be executed simultaneously, and one application displays one or more windows on the monitor 6. Further, the CPU displays a window on the monitor 6 according to the application program. In the example of FIG. 6, the application 1 corresponding to the window identification number 202 = 1001 is executed and the window W1 is displayed. Further, the application 2 corresponding to the window identification number 202 = 1002 is executed, and the window W2 is displayed.

  Further, the CPU 14 stores item position information representing the display positions of various items on the monitor 6 in the work area 31. The item position information is information including the coordinates of the item on the monitor 6. And CPU14 displays an item in the display position on the monitor 6 according to item position information. In the example of FIG. 6, items 101 to 106 of the item identification number 302 are displayed in the window W1. Also, items with item identification numbers 111 and 112 are displayed in the window W2.

  Further, the CPU 14 receives pointer position information indicating the moving direction and moving amount of the pointer from the mouse 8 and stores it in the work area 31. Further, the CPU 14 displays the pointer on the monitor 6 so as to be movable according to the pointer position information. In the example of FIG. 6, an arrow-shaped pointer P <b> 1 is displayed on the monitor 6.

  Further, the CPU 14 highlights a window (window having an input focus) selected as an operation target. An example of a method for selecting a window as an operation target is a method of clicking an input button of the mouse 8 when a pointer is positioned on the window. In the example of FIG. 6, a case where the application 1 is selected as an operation target and the window W1 is an active window will be described. The activated window W1 is highlighted by being placed in the foreground. Further, the frame (solid line) of the activated window W1 is highlighted by being displayed darker than the frame (dotted line) of the inactive window W2.

  Operation | movement of the input device 1 which concerns on this embodiment is demonstrated. A pointer position monitoring flow according to the present embodiment will be described with reference to FIGS. 2 and 3. In S1, the CPU 14 determines whether or not there is a window selected as an operation target. If it is determined that it does not exist (S1: NO), the process proceeds to S3, and the CPU 14 turns off the window continuous sound. And it progresses to S7 and CPU14 returns to S1, in the state which turned off the item intermittent sound.

  On the other hand, when it is determined that the window selected as the operation target exists (S1: YES), the process proceeds to S4. In S4, the CPU 14 searches the window table 201 for the window continuous sound frequency 204 and the window continuous sound volume 205 associated with the window selected as the operation target. Then, a window continuous sound having the searched window continuous sound frequency 204 and window continuous sound volume 205 is output from the speaker 4. In the example of FIG. 6, the window continuous sound is output from the speaker 4 at the window continuous sound frequency 204 = 1.0 (KHz) and the window continuous sound volume 205 = level 8 corresponding to the window W1.

  In S5, the CPU 14 determines whether or not a pointer exists on the active window selected as the operation target. When the pointer does not exist (S5: NO), the process proceeds to S7, and the item intermittent sound is turned off. On the other hand, when the pointer exists (S5: YES), the process proceeds to S9.

  In S9, the CPU 14 calculates the pointer moving speed. The pointer movement speed is determined by calculating the amount of movement of the pointer input from the mouse 8 per unit time.

  In S11, the CPU 14 determines whether or not the calculated pointer movement speed is equal to or higher than a predetermined speed value. The predetermined speed value may be determined in advance by a user or the like. When the pointer moving speed is equal to or higher than the predetermined speed value (S11: YES), this corresponds to the case where the pointer is moving at high speed, and it is determined that the user is not searching for an item. Therefore, the process returns to S1 and the subsequent process of outputting the intermittent sound of the item is cancelled. Thereby, when the item is not searched, the convenience of the input device 1 can be improved by stopping the output of the item intermittent sound. On the other hand, when the pointer moving speed is smaller than the predetermined speed value (S11: NO), it is determined that the pointer is moving at a low speed, and the process proceeds to S13.

  In S13, the CPU 14 determines whether or not the F1 key is pressed twice in succession. When the button is pressed twice (S13: YES), the CPU 14 determines that an instruction to move the pointer to the home position in the operation target window has been input. Therefore, the process proceeds to S15, and the CPU 14 moves the pointer to the center of the operation target window. As a result, the user can move the pointer to the home position by operating the F1 key, so that the operability of the pointer can be improved. This process is performed so that the visually impaired person moves the pointer to a predetermined position in the window when the current pointer position is unknown. The position of the home position may be on the upper left of the window or on a specific item (for example, an “OK” button).

  On the other hand, if it is determined that the F1 key has not been pressed twice (S13: NO), the process proceeds to S17. In S17, the CPU 14 determines whether or not the F5 key is being pressed. As will be described later, the F5 key is a key for inputting a command for narrowing down items that generate intermittent sound. If it is determined that the F5 key is not being pressed (S17: NO), the process proceeds to S21 (FIG. 3), and processing for searching for a desired item from a wide range is performed.

  In S21, the CPU 14 determines whether or not the item table 301 of the window in which the pointer exists has been set. When it is determined that the setting has been completed (S21: YES), the process proceeds to S25. On the other hand, if it is determined that it has not been set (S21: NO), the process proceeds to S23. In S23, the CPU 14 sets the item table 301 of the window where the pointer exists. Examples of setting contents include addition and deletion of items, change of values of the item intermittent sound frequency 305, the intermittent period 306, and the item intermittent sound volume 307. Here, it is assumed that the set value is automatically set to a unique value that does not overlap with other items and can be identified. However, you may comprise so that it may set to a user's desired value using a user interface. When the setting is completed, the process proceeds to S25.

  In S <b> 25, the CPU 14 calculates the mutual distance between each item displayed in the window where the pointer exists and the pointer. Specifically, the CPU 14 calculates the mutual distance between the item and the pointer based on the coordinates of the item included in the item position information and the coordinates of the pointer calculated using the pointer position information. In the example of FIG. 6, the mutual distance between an item having an item identification number 101 to 106 displayed in the window W1 where the pointer P1 exists and the pointer P1 is calculated (arrows Y1 to Y6). In addition, calculation is not performed about the mutual distance of the item with the item identification numbers 111 and 112 displayed in the window W2 where the pointer P1 does not exist and the pointer P1.

  In S27, the CPU 14 selects four items existing near the pointer. Specifically, when a plurality of items are displayed in the window, the CPU 14 selects four items in order from the item having the smallest mutual distance. Note that the number of items to be selected may be determined in advance by a user or the like. In the example of FIG. 6, four items with item identification numbers 302 = 101, 102, 103, and 104 are selected in order from items with a smaller mutual distance (arrows Y1 to Y4).

  Thereby, for example, even when a large number of items are displayed in the window W1, it is possible to generate an intermittent sound for only the four items in the vicinity of the pointer P1. Therefore, it is possible to prevent a situation in which the identification of an item is deteriorated because a large number of item intermittent sounds are generated at the same time.

  In S29, the CPU 14 determines the change amount of the intermittent period 306 from the mutual distance. Specifically, the value of the intermittent period 306 is changed to be smaller in accordance with the decrease in the mutual distance. Thereby, the intermittent period of an item intermittent sound becomes short, so that a pointer approaches an item (the space | interval of a sound and a sound becomes narrow). Therefore, the user can also recognize the mutual distance between the pointer and the item by the change of the intermittent period 306, so that the convenience of the user can be further improved. When the distance is zero, that is, when the function related to the item is activated by clicking or double-clicking in that state, the continuous sound of the same frequency may be used and the volume may be further increased. . As a result, a user who knows the item position on the window can easily determine which item intermittent sound corresponds to which item by moving the mouse 8 and listening to the periodic fluctuation of the item intermittent sound. Judgment can be made. In this embodiment, as will be described later, it is possible to provide a mechanism for notifying the user of the correspondence list between item intermittent sounds and items, but it is possible to quickly select an item without using the mechanism. Can do.

  In S31, the CPU 14 turns on the item intermittent sound associated with the four neighboring items. In the example of FIG. 6, item intermittent sounds for four items with item identification numbers 302 of 101 to 104 are output at the same time. The user can determine the direction in which the mouse should be moved by distinguishing the difference in the level of the intermittent tone of the intermittent tone, the difference in volume, and the period change. Further, since the sound is heard as a continuous sound when the distance is zero, the user can recognize that the pointer is positioned on a predetermined item.

  In S33, the CPU 14 determines whether or not to end the pointer position monitoring flow. If it is determined to end (S33: YES), the flow ends. If it is determined not to end (S33: NO), the process returns to S1 (FIG. 2).

  If it is determined in S17 (FIG. 2) that the F5 key is being pressed (S17: YES), the process proceeds to S41, and a process for searching for a desired item from the narrowed range is performed. In S41 (FIG. 3), the CPU 14 calculates the mutual distance between each item displayed in the window where the pointer exists and the pointer. In S43, the CPU 14 selects two items existing near the pointer. The number of items to be searched can be narrowed down by making the number of items selected in S43 (2) smaller than the number of items selected in S27 (4).

  In S <b> 45, the CPU 14 increases the item intermittent sound intermittent period 306 for two items near the pointer at a predetermined rate. The predetermined ratio may be determined in advance by a user or the like.

  In S47, the CPU 14 turns on the item intermittent sound associated with the two nearby items. In the example of FIG. 6, item intermittent sounds for two items having item identification numbers 302 of 101 and 102 are output at the same time.

  Thereby, even when four item intermittent sounds are generated at the same time and it is difficult to distinguish them, the number of item intermittent sounds can be reduced to two by pressing the F5 key. Therefore, since the items to be searched can be further narrowed down, it becomes possible to further improve the item identification. Further, when the four item intermittent sounds are recognized, even when the intermittent cycle 306 is small and difficult to distinguish, the intermittent cycle 306 can be expanded by pressing the F5 key. Therefore, it becomes possible to further improve the item identification by the intermittent period 306. Further, since the intermittent period is expanded at a predetermined rate, the magnitude relationship of the intermittent period 306 between the two item intermittent sounds is maintained. Therefore, it is possible to maintain the item identifiability due to the intermittent period 306. Furthermore, since the items are densely populated, the intermittent sound cycles become close to each other, and even when identification is difficult, the intermittent cycle 306 is expanded by this processing, so that the identification is facilitated.

  Next, a confirmation flow of correspondence between items and item intermittent sounds will be described with reference to FIG. The confirmation flow shown in FIG. 4 is a flow that is started when the user presses the F3 key as necessary, for example, when it is desired to confirm an item intermittent sound. In response to pressing of the F3 key, the process proceeds to S51. In S51, the CPU 14 performs item selection. In the item selection, for example, among the items displayed in the window where the pointer exists, the items may be selected in order from the item having a smaller mutual distance from the pointer.

  In S53, the CPU 14 outputs the item name of the item selected in S51 by voice. Specifically, the CPU 14 performs a process of reading out the item name 304 registered in the item table 301 by executing the voice output program 26. Note that the information output in S53 is not limited to the item name 304, but may be the item type 303 or the like, as long as the information enables identification of the item.

  In S55, the CPU 14 searches the item table 301 for the item intermittent sound frequency 305, the intermittent period 306 at that time, and the item intermittent sound volume 307 associated with the item selected in S51. And the process which sounds the item intermittent sound which has the searched item intermittent sound frequency 305, the intermittent period 306, and the item intermittent sound volume 307 3 times is performed. At this time, the item intermittent sound is output immediately after the sound of the item name 304 is output, so that the user can hear the item content and the item intermittent sound in association with each other. Needless to say, the number of ringing of the item intermittent sound is not limited to three.

  In S57, the CPU 14 determines whether or not the item intermittent sound confirmation operation has been completed for all items (in the window where the pointer is located) that is the target. If it is determined that the process has not been completed (S57: NO), the process returns to S51. If it is determined that the process has been completed (S57: YES), the flow ends.

  Thereby, since the user can confirm the correspondence between the item intermittent sound and the content of the item by pressing the F3 key, the user's convenience can be further improved.

  Next, a confirmation flow of correspondence between windows and window continuous sounds will be described with reference to FIG. The confirmation flow shown in FIG. 5 is a flow that is started when the user presses the F1 key as necessary, for example, when it is desired to confirm the window continuous sound. In response to pressing of the F1 key, the process proceeds to S61. In S61, the CPU 14 performs window selection. In the window selection, a window that is currently an operation target may be selected first. Then, after the operation target window is selected, other windows may be selected in a predetermined order.

  In S63, the CPU 14 outputs the window name of the window selected in S61 and the created application name by voice. Specifically, the CPU 14 performs a process of reading out the window name 203 registered in the window table 201 by voice by executing the voice output program 26.

  In S65, the CPU 14 searches the window table 201 for the window continuous sound frequency 204 and the window continuous sound volume 205 associated with the window selected in S61. Then, processing is performed for generating a window continuous sound having the searched window continuous sound frequency 204 and window continuous sound volume 205 for one second. Needless to say, the duration of the continuous window sound is not limited to one second.

  In S67, the CPU 14 determines whether or not the window continuous sound confirmation operation has been completed for all windows. If it is determined that the process has not been completed (S67: NO), the process returns to S61. If it is determined that the process has been completed (S67: YES), the flow ends.

  Thus, the user can confirm the correspondence between the window continuous sound and the contents of the window by pressing the F1 key, so that the convenience of the user can be further enhanced.

  That is, the user first hears the correspondence between the scale of the window and the window continuous sound by pressing the F1 key, and knows the window continuous sound corresponding to the desired window. Next, it is determined whether or not the window continuous sound corresponds to a desired application. If they are different, the application and window are switched using the window switching function provided by the OS. Next, the user presses the F3 key to hear and store the correspondence between each item in the window and the item intermittent sound. Thereafter, the user can know the outline of the direction and distance of the desired item by moving the mouse 8 appropriately and moving the pointer on the monitor 6. Thereafter, the user uses the function of the desired item by moving the mouse 8 in a direction that shortens the intermittent period of the item intermittent sound corresponding to the desired item, and clicking at a position where the intermittent sound has transitioned to the continuous sound. be able to.

  The effects of the invention according to this embodiment will be described below. In the input device 1 of the present embodiment, an intermittent sound having a unique item intermittent sound frequency 305 (pitch), a specific intermittent period 306, and a unique item intermittent sound volume 307 is generated as an item intermittent sound for each item. Is done. Therefore, the user can identify the item type by listening to at least one of the height, intermittent period, and volume of the item intermittent sound. And even when the several item intermittent sound has generate | occur | produced, since the item intermittent sound has a silence part, the situation where item intermittent sounds overlap and generate | occur | produce can be decreased. Then, since a plurality of sounds are generated in an overlapping manner, it is less likely that the sound is swelled or distorted, so that each of the plurality of item intermittent sounds can be clearly identified. Therefore, the discriminability of items can be improved, and the convenience for the user can be improved.

  In addition, an item intermittent sound having an item intermittent sound frequency 305 (pitch) and an item intermittent sound volume 307 unique to each item, a window continuous sound frequency 204 (pitch) unique to each window, and a window continuous. A window continuous sound having a sound volume 205 is generated at the same time. And even when the item intermittent sound and the window continuous sound are generated at the same time, the item intermittent sound has a silent part, so that the window continuous sound can be heard in the silent part. Then, the window can be identified by the continuous window sound, and at the same time, the item can be identified by the item intermittent sound. Therefore, since the identification of the window and the identification of the item can be performed at the same time, it is possible to further improve the convenience for the user.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. The modifications of the above embodiment are listed below.

  In the present embodiment, the case where three identification criteria of the item intermittent sound frequency 305, the intermittent period 306, and the item intermittent sound volume 307 are used for identifying the item type has been described, but the present invention is not limited to this form. Needless to say, the item type can be identified when any two of the three identification criteria are used in combination or when only one of them is used. For example, a unique item intermittent sound frequency 305 and item intermittent sound volume 307 may be assigned to each item, and a common intermittent cycle 306 may be used for each item. At this time, the sounding timing of the item intermittent sound may be different between the item intermittent sounds so that the item intermittent sounds do not overlap each other.

  Moreover, in this embodiment, when selecting an item near the pointer, the items are selected in order from the item having the smallest mutual distance to the pointer. However, the present invention is not limited to this mode. It is good also as a form which selects the item in the mutual distance with a pointer within the predetermined distance defined beforehand. The predetermined distance may be determined in advance by a user or the like. Further, an item that is highly likely to be used, such as an “OK” button, may be always selected.

  Thereby, for example, even when a large number of items are displayed in the window, it is possible to generate an intermittent sound only for items existing within a predetermined radius centered on the pointer. Therefore, it is possible to prevent a situation in which the identification of an item is deteriorated because a large number of item intermittent sounds are generated at the same time.

  Moreover, in this embodiment, you may employ | adopt the form which makes the volume of an item intermittent sound large according to the mutual distance with a pointer becoming small. Thereby, the volume of the item intermittent sound increases as the pointer approaches the item. Therefore, since the user can recognize the mutual distance between the pointer and the item based on the volume of the item intermittent sound, it is possible to further improve the convenience for the user.

  Further, the duty ratio of the item intermittent sound may be changed according to the mutual distance from the pointer. The duty ratio is the ratio between the sound period and silent period of the intermittent sound. Thus, the user can recognize the mutual distance between the pointer and the item based on the duty ratio of the item intermittent sound, so that the convenience for the user can be further enhanced.

  In the present embodiment, the correspondence between the item intermittent sound frequency 305, the intermittent cycle 306, the item intermittent sound volume 307 and the item type may be arbitrary. However, the present invention is not limited to this configuration, and the correspondence may be fixed. For example, for an item whose frequently used item name is “OK”, item intermittent sound frequency 305 = 2.1 (KHz), intermittent period 306 = 0.7 (s), item intermittent sound volume 307 = level 7 It may be fixed and assigned. As a result, for frequently used items, the item type can be recognized by listening to the fixed item intermittent sound frequency 305 and the like, so that the convenience of the user can be improved.

  In the present embodiment, when the pointer moves beyond the window frame into the window, a form in which the window name 203 related to the window is read aloud may be adopted. As a result, the user can recognize the type of the window where the pointer is currently located by the window name 203, so that the user's convenience can be further improved.

  In this embodiment, the case where the F1 key, the F3 key, and the F5 key are used when inputting various instructions has been described. However, the present invention is not limited to these keys. Needless to say, which key on the keyboard 2 is arbitrarily assigned to input various instructions and can be set as appropriate by the user.

  The technical elements described in this specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

  The work area 31 is an example of a storage unit, the mouse 8 is an example of a pointing device, pressing the F5 key is an example of a first instruction, and pressing the F3 key is an example of a second instruction.

  Moreover, the control part which performs S31, S4, S45, S53, and S55 is an example of a sound output means. The control unit that executes S25 is an example of a distance calculation unit. The control unit that executes S27 and S43 is an example of a first item selection unit. The control unit that executes S1 is an example of a window selection unit.

1 Input device 6 Monitor 8 Mouse 14 CPU
31 Work area P1 Pointer W1, W2 Window 201 Window table 204 Window continuous sound frequency 205 Window continuous sound volume 301 Item table 305 Item intermittent sound frequency 306 Intermittent period 307 Item intermittent sound volume

Claims (11)

Item position information indicating the display position on the screen of a plurality of types of items displayed on the screen is stored in a storage means, and the item is displayed at the display position on the screen according to the item position information Display means;
Pointer display means for receiving pointer position information representing the movement direction and amount of movement of the pointer from a pointing device and displaying the pointer movable on the screen;
A computer comprising
Storage control means for storing an intermittent sound having a specific frequency or a specific volume for each item in association with each of the items;
Sound output means for outputting the intermittent sound associated with the item;
Program to make it function. The storage control means
The program according to claim 1, wherein the intermittent sound having a specific intermittent period for each item is stored in association with each of the items. Based on the item position information and the pointer position information, distance calculation means for calculating a mutual distance between the item and the pointer;
When a plurality of the items are displayed on the screen, the computer functions as first item selection means for selecting a first predetermined number of the items in order from the items having the smallest mutual distance. The program according to claim 1 or 2. Based on the item position information and the pointer position information, distance calculation means for calculating a mutual distance between the item and the pointer;
The computer is caused to function as second item selection means for selecting the items within a predetermined distance in which the mutual distance is predetermined when a plurality of the items are displayed on the screen. Item 3. The program according to item 1 or 2. Window position information representing display positions on the screen of a plurality of types of windows displayed on the screen is stored in a storage means, and the windows are displayed at the display positions on the screen according to the window position information. Window display means;
Window selection means for receiving an input from the pointing device and selecting the window to be operated;
The computer to function,
The storage control means stores a continuous sound having a specific frequency or a specific volume for each window in association with each of the windows,
5. The sound output means outputs the continuous sound associated with the window selected as an operation target by the window selection means together with the intermittent sound. 6. The program described in. The sound output means is
The program according to any one of claims 3 to 5, wherein the intermittent period of the intermittent sound is shortened according to a decrease in the mutual distance. The sound output means is
4. The program according to claim 3, wherein the intermittent period of the intermittent sound for each of the items is increased by a predetermined ratio in response to the input of the first instruction from the input unit. The first item selection means, in response to the input of the first instruction from the input means, in order from the items having the smallest mutual distance, the second predetermined number of items smaller than the first predetermined number. Elected,
The program according to claim 7, wherein the sound output unit increases the intermittent period of the intermittent sound for each of the second predetermined number of items at a predetermined rate. The sound output means is
The program according to any one of claims 3 to 8, wherein the volume of the intermittent sound is increased in accordance with a decrease in the mutual distance. The sound output means is
2. The voice output in association with the intermittent sound associated with the item and identification information representing the content of the item in response to the input of the second instruction from the input means. The program according to claim 9. Item position information indicating the display position on the screen of a plurality of types of items displayed on the screen is stored in a storage means, and the item is displayed at the display position on the screen according to the item position information Display means;
Pointer display means for receiving pointer position information representing the movement direction and amount of movement of the pointer from a pointing device and displaying the pointer movable on the screen;
Storage control means for storing an intermittent sound having a specific frequency or a specific volume for each item in association with each of the items;
Sound output means for outputting the intermittent sound associated with the item;
An interface device comprising:

Images