JP2006018780A - Item selection device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a user interface which is provided with a voice guidance function and enables a user accustomed to use it to quickly select an item. <P>SOLUTION: An item selection device comprising a first input device for indicating and selecting an item focused on a picture, a second input device for voice input, a voice output device, and a storage device is provided with; a selection item storage part wherein a plurality of selectable item groups and voice data associated with each selectable item are stored; a reading-out processing part for successively reading out selectable items; a first selection and settlement processing part for executing processing of selecting and settling an item being read out, in response to an operation of the first input device; and a second selection and settlement processing part which performs voice recognition processing of an input voice in response to the voice input from the second input device and executes processing of selecting and settling an item suiting a result of voice recognition processing. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an item selection device and a program, and more particularly to an item selection device and a program that facilitates quick item selection by using voice input means together.

  In various terminal devices and the like, it is desired to design a user interface in consideration of being able to use a normal person and a disabled person without distinction. FIG. 4 is a diagram showing a barrier-free type terminal device that can select items without distinguishing between a normal person and a disabled person using a speech synthesis technique, and a menu screen thereof. Referring to the terminal screen of FIG. 4, the menu is composed of four items: route guidance, departure place selection, destination selection, and end. FIG. 5 is a flowchart showing the operation of such a terminal device, in which the focus of an item is moved one by one at a predetermined time, and the operation of reading out the focused item by a display speech synthesis technique is performed. (Steps S201, S202, S205). In addition, when the focus is reached up to the last menu item, the first item returns to the first item, and the terminal device repeats the focus movement and the sequential reading of the items again. Then, the menu item selection is confirmed by pressing the button when the target item is focused by the user (steps S203 and S204).

  Further, as a device developed for the same purpose, there is a multifunction device described in JP-A-2003-140880. However, the method described in this publication is suitable for simplifying complex operations, but it can be used immediately for users who are unfamiliar with the operation of the device or who do not know each selectable item. It is thought not to be.

JP 2003-140880 A

  On the other hand, when viewing the terminal device as illustrated in FIG. 4, it is possible to select a menu with only a simple button operation without looking at the menu. Even a user who does not know each item has an advantage that it can be used immediately. For example, in the example of FIG. 4, the destination selection is focused and a voice “Destination selection” is output. Here, when the user presses the enter button, the focused destination selection can be selected.

  However, on the other hand, when the user knows the item to be selected, the user has to keep waiting until the target menu item is focused. In addition, when there are many items, especially when it takes time to read out the target item, the attention is distracted because it waits for a long time, often the press of the decision button is delayed and I want to make a selection There was also a situation where you had to wait until the item was focused again.

  The present invention has been made in view of the above-described circumstances, and provides an item selection device and a program that have a voice guidance function and can quickly select an item for a user who is accustomed to use. is there.

  According to a first aspect of the present invention that provides means for solving the above-mentioned problems, a display device, a first input device for selecting an item indicated on the screen of the display device, a first by voice input An item selection device including two input devices, a voice output device, and a storage device, comprising a selection item storage unit, a reading processing unit, a switching display unit, and first and second selection confirmation processing units; An item selection device characterized by the above is provided. The selection item storage unit stores a plurality of selectable item groups constituting menu items of the item selection device, and sound data associated with each selectable item. The reading processing unit is a processing unit for sequentially reading the selectable items via the voice output device, and the switching display unit switches the item to be instructed in synchronization with the reading processing, and displays the display Processing means for displaying on the screen of the apparatus. The first selection confirmation processing unit is configured to display an item (even an item being read out) instructed on the screen of the display device when an operation of the first input device, for example, a determination button is operated. The second selection / confirmation processing unit performs speech recognition processing on the input speech when speech input is performed from the second input device, and performs speech recognition processing. A process for selecting and confirming an item that matches the result of is executed.

  According to a second aspect of the present invention, there is provided a program that is executed by a computer constituting the item selection device.

  According to the present invention, it is possible to realize an operation environment that is simple and easy to use for both a normal person and a handicapped person and is less likely to wait. The reason is that a voice guidance function is provided and a configuration that allows quick selection of items is adopted.

  Subsequently, as the best mode for carrying out the present invention, a first embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing a schematic configuration of an item selection device according to an embodiment of the present invention. Referring to FIG. 1, the present invention includes an item selection device 10 that operates under program control, a display device 20 that displays a menu for displaying selectable items, and a decision button for indicating and selecting an item focused on the screen. 31, a voice input button 32 for starting voice input by the microphone 51, a speaker 50 for outputting a menu reading voice, and a microphone 51 for voice input.

  The item selection device 10 is, for example, an information terminal installed in a public place, and the display device 20 includes a route guidance 41, a departure place selection 42, and a destination selection 43, which are personal navigation menus. And four items of end 44 are displayed. Further, voice data corresponding to these items 41 to 44 and dictionary data for voice recognition are stored in the storage device of the item selection device 10.

  Next, the selection receiving operation for the above four items performed by a program installed in the item selection device 10 will be described with reference to the drawings. FIG. 2 is a flowchart for explaining the operation of the present embodiment. Referring to FIG. 2, first, the item selection device 10 moves the focus to the (n + 1) th item (initial value n is 0) on the display device 20 (step S001), and the focus is placed on the display device 20. The voice data corresponding to the selected item is read out and output through the speaker 50 by voice synthesis means (not shown) (step S002).

  Here, when the determination button 31 is pressed (Yes in Step S003), the item selection device 10 executes a process of selecting and confirming the item focused at that time (Step S004). For example, as shown in FIG. 1, when “Destination selection” is focused and the decision button 31 is pressed, the next screen for destination selection processing is displayed.

  Alternatively, when the voice input button 32 is pressed instead of the decision button 31 and voice is input to the microphone 51 and the item selection device 10 performs voice recognition processing (Yes in step S005), the voice recognition result and If there is a matching item (Yes in step S006), processing for selecting and confirming the item is executed (step S004). In the case of this voice recognition, it is not necessary that the “destination selection” is focused as shown in FIG. 1, and the uttered item can be selected and confirmed promptly.

  When neither the pressing of the determination button 31 nor the voice input of the item is performed, the item selection device 10 moves the focus to the next item every time a predetermined time elapses (Yes in step S007). The voice data corresponding to the item is read out, and the reading process through the speaker 50 is repeated. In this embodiment, when the last item is reached, control is performed so as to recurse to the first item.

  As described above, the item selection device according to the present embodiment is a kind reading method for a user who does not know the menu item, but does not need to wait until the target item is focused. ing. The reason for this is that it has both an input function by voice recognition and a conventional sequential reading type menu selection method, and associates and associates words registered in voice recognition dictionary data with each item constituting the menu. It is possible to select by voice.

  Note that the word to be registered in the dictionary data for speech recognition does not need to be an item to be read out, but registers various abbreviations, similar words, synonyms, corresponding foreign languages, etc., and further improves the convenience. Can be improved.

  Subsequently, a second embodiment obtained by improving the first embodiment of the present invention will be described. The second embodiment of the present invention is different from the first embodiment only in that the information mounted on the storage device and the additional selection assisting means are provided, and the configuration and operation are substantially the same as those of the first embodiment. Only the different parts will be described, and the common parts will be omitted.

  In addition to the first embodiment, the item selection device 10 according to the present exemplary embodiment, when the result of the speech recognition processing matches the instruction word (command; voice command) related to item selection, the instruction word (Command; voice command) is executed.

  For example, in the dictionary data for speech recognition in the storage device of the item selection device 10, instruction words (commands: voice commands) such as “one name”, “this”, “return to the beginning”, etc. are registered in the dictionary data for speech recognition. In addition, the item selection processing operations corresponding to these, such as “select previous item for selection confirmation processing”, “selection confirmation processing for focused item”, “return focus to first item”, and the like are associated respectively. Thus, it is possible to quickly select an item and move the focus.

  FIG. 3 is a flowchart for explaining the operation of the present embodiment. Referring to FIG. 3, the processes up to step S106 are the same as those in the first embodiment. However, even when the input speech does not match the item name as a result of the speech recognition (No in step S106), for example, when the result of the speech recognition processing matches the instruction word (command) “this” (step S107). Yes), a process for selecting and confirming the currently focused menu item, which is a process corresponding to the instruction word, is executed (step S108). Similarly, when the result of the speech recognition process matches the instruction word (command) “one name”, the selection confirmation process for the item focused immediately before is executed.

  As described above, according to the present embodiment, in addition to the operational effects of the first embodiment, it is possible to input a voice with a daily instruction word such as “one name” or “this”. Yes. Thus, according to the present invention in which each command is defined and can be instructed by voice recognition, for example, when the currently focused item is “menu B” and the menu item focused immediately before is “menu A” When “this” is uttered, “menu B” is input, and when “same” is uttered, menu A is input.

  Note that the instruction words (commands; voice commands) to be registered in the dictionary data for speech recognition are various abbreviations, similar commands, synonyms, corresponding foreign languages, etc., like the words in the first embodiment described above. Can be registered together to further improve the convenience.

  It should be noted that the determination button in each of the above-described embodiments is merely an example of the application and is not particularly limited. For example, instead of buttons, other mechanical keys that can be activated by the user's limbs, touch panel devices, switches using pressure sensors, and the like can be used.

  Further, the order of the determination of the button press and the determination of the result of the speech recognition in each of the above-described embodiments is merely an example, and it is clear that the order is not particularly limited.

  The present invention can be applied not only to public terminals used by many human beings mentioned in the above embodiment, but also to applications such as hand-free and quick selection in familiar portable terminals and the like. Further, the present invention can also be applied to an operation of operating an information home appliance such as a multi-function TV, a personal computer, or a nursing care system with a microphone and a speaker. Furthermore, the present invention can be applied to uses such as controlling an in-vehicle computer, a car navigation system, a security system, and the like using a microphone and a speaker.

It is a figure showing the schematic structure of the item selection apparatus which concerns on one embodiment of this invention. It is a flowchart showing operation | movement of the item selection apparatus which concerns on one embodiment of this invention. It is a flowchart showing operation | movement of the item selection apparatus which concerns on another embodiment of this invention. It is a figure showing schematic structure of the conventional item selection apparatus. It is a flowchart showing operation | movement of the conventional item selection apparatus.

Explanation of symbols

10 Item Selection Device 20 Display Device 31 Enter Button 32 Audio Input Buttons 41 to 44 Menu Item 50 Speaker 51 Microphone

Claims (8)

In an item selection device comprising: a display device; a first input device for selecting an instructed item on the screen of the display device; a second input device by voice input; a voice output device; and a storage device.
A selection item storage unit that stores a plurality of selectable item groups and audio data associated with each selectable item;
A reading processing unit that sequentially reads the selectable items through the voice output device;
A switching display unit that switches items to be instructed in synchronization with the reading process and displays them on the screen of the display device;
A first selection confirmation processing unit that executes a process of selecting and confirming an item instructed on the screen of the display device when the operation of the first input device is performed;
A second selection confirmation processing unit that performs a speech recognition process on the input speech and executes a process of selecting and confirming an item that matches the result of the speech recognition process when speech input is performed from the second input device And comprising
Item selection device characterized by. The item selection device according to claim 1, further comprising:
As a result of the voice recognition process, when a command related to item selection is input by voice, a command processing unit is provided to execute the command;
Item selection device characterized by. In the item selection device according to claim 2,
The command is a predetermined voice command instructing to select and confirm an item being read out,
Item selection device characterized by. In the item selection device according to claim 2,
The command is a predetermined voice command instructing to select and confirm an item immediately before the item being read out;
Item selection device characterized by. A display device, a first input device for selecting an instructed item on the screen of the display device, a second input device by voice input, a voice output device, a storage device, and a plurality of selectable items A program to be executed by a computer constituting an item selection device for selecting an arbitrary item,
A process of reading out voice data stored in association with items stored in the storage device, and sequentially reading out by voice via the voice output device;
A process of switching an item to be instructed in synchronization with the reading process and displaying on the screen of the display device;
(A) When the operation of the first input device is performed, the item indicated on the screen of the display device is
(B) When voice input is performed from the second input device, voice recognition processing is performed on the input voice, and an item that matches the item name uttered by the user is
A process of selecting and confirming an item by either (A) or (B),
A program to be executed by the computer. The program according to claim 5, further comprising:
A program for causing the computer to execute a process of executing a command when a command related to item selection is input as a result of the voice recognition process. The program according to claim 6,
The command is a predetermined voice command instructing to select and confirm an item being read out,
A program characterized by The program according to claim 6,
The instruction is a predetermined voice command instructing to select and confirm the item immediately before the item being read out,
A program characterized by

Images