JPS6237734A - Instruction selector - Google Patents

Abstract

PURPOSE:To improve the operability and also to prevent the mis-selection of instructions by combining a mouse and the recognition of voiced for confirmation of the selected instruction. CONSTITUTION:When a mouse 1 is moved to a desired instruction of the menu displayed on a CRT 4, this instruction is recognized by a voice recognizing part 7 via an instruction switching part 3 and delivered in voices through a mike 6. Thus the selected instruction in confirmed and the mouse 1 is clicked. Then a click detecting part 8 controls an instruction confirming part 9 and the selected instruction is outputted from an instruction output part 10. In such a constitution, the operability of an instruction selector is improved with no output of an instruction recognized wrong. This prevents the mis-selection of instructions.

Description

DETAILED DESCRIPTION OF THE INVENTION Field of the Invention The present invention relates to an instruction selection device for selecting operating instructions for personal computers, word processors, and the like.

BACKGROUND OF THE INVENTION In recent years, information devices such as personal computers and word processors have become widespread. Most of these computers are operated by keyboard input, but recently an increasing number of personal computers, such as Apple's products, are operated using a pointing device called a mouse.

Mouse operations are mainly done by "pointing", which is when you move the mouse to specify a position, and "point", which is when you press and immediately release the mouse button.
This is done in two steps: ``Click''.

An example of operation using a mouse is shown in FIG. This is a CRT
This shows what is displayed on the display screen. The arrow indicates the position indicated by the mouse. The types of commands that can be executed now are displayed (Figure 4). When the arrow is moved to the "file" area by operating the mouse, a window opens and a menu of file-related commands is displayed (FIG. 4B). Also, if you move the arrow to the "edit" area, a menu of editing-related commands will be displayed (
Figure 4C). After specifying the type of instruction in this way, move the arrow to the desired instruction area and click to select that instruction. For example, "cut and paste" among editing commands
To select , first move the arrow to the ``Edit'' area, then move the arrow to ``Cut and Paste'' and click (Figure 4D).

By using the mouse in this manner, the command to be executed can be efficiently selected.

Problems to be Solved by the Invention However, it is difficult to accurately move an arrow to a desired position by operating a mouse. In the above column, when selecting the type of instruction, each instruction has a wide permissible range, so moving the arrow is easy, but when there are many instructions and the permissible range is narrow, such as editing-related commands, Pointing to commands is not easy.

In view of this, an object of the present invention is to provide a command selection device with good operability by combining a mouse and voice recognition.

Means for Solving the Problems The present invention provides a mouse, a command switching section that switches the type of commands that can be selected depending on the position indicated by the mouse, and a command switching unit that changes the type of commands that can be selected depending on the position indicated by the mouse, and the position indicated by the mouse, selectable commands, voice recognition results, etc. This command selection device includes a display unit that displays a display, a voice recognition unit that recognizes selectable commands, and a command confirmation unit that confirms the voice recognition result by clicking a mouse.

According to the present invention, with the above-described configuration, items with few options are selected by the mouse, and items with many options are selected by voice, so there is no need to move the mouse minutely, and the operation is easy. ! Additionally, the combined use of manual input using a mouse and voice input enables efficient and efficient operations, which improves operation speed compared to operations using a mouse alone. Additionally, voice recognition results can be confirmed with simple operations, and even if recognition is incorrect, the wrong command will not be selected.

Embodiment FIG. 1 shows a schematic diagram of an instruction selection device according to an embodiment of the present invention. In Fig. 1, 1 is a mouse, 2 is a position detection unit that detects the position the mouse is pointing at, 3 is a command switching unit that switches the types of commands that can be selected depending on the position the mouse is pointing at, and 4 is a point at which the mouse is pointing. A CRT display that displays the position, command menu, voice recognition results, etc., 5 is a screen side leg that controls the screen output to the CRT display 4, 6 is a microphone, and R is a voice that recognizes selectable commands. 8 is a click detection unit that detects mouse clicks; 9 is a command confirmation unit that confirms the recognition result of the voice recognition unit 7; and 1o is a command output unit that outputs the confirmed command.

FIG. 2 is a block diagram showing the overall configuration of the speech recognition section 7. As shown in FIG. In FIG. 2, reference 1 is a feature extraction unit that extracts the features of the audio input from the micro, and is realized by, for example, a group of band-pass filters. Reference numeral 72 denotes a standard button storage section that stores in advance the characteristics of a word orchid to be recognized as a standard button. Standard buttons are stored in groups corresponding to the types of commands. 73 is a standard button switching unit that switches the group of standard buttons to be compared according to instructions from the command switching unit 3, and 74 is a standard button that compares the characteristics of the human voice with the standard button 4. This is a comparison unit that outputs the word usage corresponding to bang as a recognition result.

The operation of the instruction selection device of this embodiment constructed as described above will be described below.

An example of the operation is shown in FIG. This represents the display on the CRT display screen. The arrow indicates the position indicated by the mouse. Types of commands that can be executed now: 1 - File, Edit, Display, and Others are displayed (Figure 3). The standard button storage section 72 stores standard buttons for each command divided into these four groups. Use the mouse to move the arrow to "File"
When the arrow is moved to the "File" area, the position detection unit 2 detects that the arrow has moved to the "File" area. Open a window on the CRT disk/board 4 and display a menu of file-related commands (see Figure 3B).
). On the other hand, the standard button switching unit 3 contains file-related commands, ie, l-, t-bun'', [゛ri1~z], and
``Furiyuito'', ``-copy'', [Print J is the recognition target word soft. When you speak the desired command from the micro,
The feature extraction unit 1 extracts the features of the voice, and the comparison unit 74 compares the features of the input voice with the standard pattern of the file-related command, and selects the word orchid corresponding to the standard pattern with the highest degree of similarity as the recognition result. Output. The command confirmation unit 9 is the voice recognition unit 7
The screen control unit 5 is instructed to display the recognition result. For example, if the recognition result is 1-copy, the screen control unit 6
The recognition result is displayed on the CRT display 4 as shown in FIG. 3C. If the recognition result is correct and the mouse is clicked, the click detection unit 8 detects the click. When a click is detected, the command confirmation unit 9 considers the voice recognition result to be correct and transfers the recognition result to the command output unit 10. If the recognition result is incorrect, the desired command is uttered again. Alternatively, the command may be selected by moving the arrow to the desired command area using the mouse, as in the conventional row. The command output unit 10 outputs the confirmed command.

Furthermore, when the mouse is operated to move the arrow to the "edit 1" area, the command switching unit 3 allows editing-related commands to be selected, and the screen control unit 5 opens a window on the CRT display 4 and commands editing-related commands. Display the menu (3rd
On the other hand, the mark pattern switching unit 73 provides editing-related commands, such as 1 insert, delete, copy, move, replace, search, cut and paste, and delete. , “
"Cancel" is the recognition target word. When a desired command is uttered by the micro, the feature extracting unit 71 extracts the percentage characteristics of the voice, and the comparing unit 74 compares the characteristics of the input voice with the standard button of the editing-related command, and selects the standard pattern with the highest degree of similarity. The word number corresponding to is output as a recognition result. Screen control unit 5
displays the recognition result on the CRT display 4. When a click is detected, the command confirmation section 9 transfers the recognition result to the command output section 1o, and the command output section 10 outputs this command.

For example, if you want to select "Cut and Paste" from among the editing commands, operate as follows. First, use the mouse to move the arrow to the ``1 Edit'' area.

In the menu displayed on CRT display 4, "
Since there is "cut and paste," say "cut and paste." When the recognition result is displayed indicating that it is "cut and pasted", click to confirm. As described above, command selection is efficiently performed through three steps: moving the mouse, uttering the command, and clicking.

Currently, the recognition rate of the speech recognition unit is about 95% even when the recognition target word is soft or 1Q word. If an incorrect command is selected due to misrecognition, many operations and time are required to correct it. Therefore, when using voice recognition,
It is important to have a confirmation section. In this embodiment, the recognition result can be confirmed with an extremely simple operation of pressing a mouse button, and the confirmation operation is less troublesome.

Book implementation # as above? According to ilJ, items with fewer options are selected using the mouse, and items with many options are selected using voice, so there is no need to move the mouse minutely, making the operation easier. In addition, the combination of manual input using a mouse and voice input enables efficient and efficient operations, which improves operation speed compared to operations using only a mouse. Furthermore, by changing the target word ψ for speech recognition as the type of command is switched, the number of words to be recognized at one time is reduced, and the recognition rate is improved. Furthermore, since the recognition result is confirmed by clicking the mouse, even if the recognition is incorrect, the wrong command will not be selected, and this confirmation operation is extremely simple. Furthermore, since a menu of commands to be recognized is displayed on the CRT display, there is also the advantage that there is no need to memorize the words to be recognized.

As described in detail, the present invention is an easy-to-operate command selection device that effectively uses a mouse and voice recognition, and has great practical effects.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing the configuration of an instruction selection device according to an embodiment of the present invention, FIG. 2 is a block diagram showing the configuration of a voice recognition section of the instruction selection device according to the same embodiment, and FIG. FIG. 4 is an explanatory diagram of the operation of a conventional command selection device using a mouse. 1. Mouse, 2. Position detection. Part, 3...
...Instruction switching unit, 4...CRT display,
5-,,,. Screen control section, 6. ... Microphone, 7 ... Voice recognition section, 8 ... Click detection section, 9 ... Command confirmation section, 1゜ ... Command output section. Name of agent: Patent attorney Toshio Nakao and 1 other person33
figure

Claims (1)

[Claims] A command switching section that switches the types of selectable commands depending on the mouse and the position indicated by the mouse, a display section that displays the position of the mouse, selectable commands, voice recognition results, etc., and recognizes selectable commands. An instruction selection device that includes a target speech recognition section and an instruction confirmation section that confirms the speech recognition result by clicking a mouse.