JP7010585B2 - Sound command input device - Google Patents

Description

INDUSTRIAL APPLICABILITY The present invention relates to a sound command input system capable of exerting the same function as a special key in a personal computer by sound input, and a user can set an operation sequence command and an arbitrary sound in advance in association with each other. Regarding the sound command input system.

Currently, shortcut keys (also called keyboard shortcuts) that are pressed to activate specific functions of a computer are used. It is widely used as a convenient function that can easily perform a specific function of a computer by simplifying mouse and keyboard input.
That is, a shortcut key is a combination of keys when key input is performed instead of an operation such as selecting a command from a menu. Key input using this is called shortcut input or keyboard shortcut. By using this function, procedures such as menu display and selection can be omitted, and work can be performed efficiently.
For example, in Windows (registered trademark) of OS, a document or the like can be copied by pressing "Ctrl" and "C" at the same time. Also, by pressing "Ctrl" and "Alt", the copied document or the like can be pasted. Such shortcut key functions are used in document creation software on personal computers, smartphones, etc., and in many cases, the functions can be executed in a shorter time than clicking with a mouse, and the keyboard can be used. It has the advantage that it is not necessary to move the hand to the pointing device while inputting.

On the other hand, at present, a voice recognition system having a function of converting a spoken word into a character string by making a computer recognize a human voice or the like or capturing a voice characteristic to identify a person who is making a voice has become widespread. I'm starting. For example, such a voice recognition system is used in a car navigation system, an application for a mobile terminal, a cooking appliance, and the like. In the future, it will be used in a wide range of technical fields such as robots with built-in voice recognition, game machines that progress while talking, searching for the desired video from a large amount of archives, and efficiently checking for prohibited words. Is expected.
Hereinafter, the technology related to automobiles, which is generally used, will be described as an example. Currently, in the automobile industry, a voice recognition system and a communication system are combined with a moving object such as an automobile to provide real-time information such as traffic information, map information, navigation, contact in case of failure, and automatic notification in case of theft. The systems that can be provided are general-purpose. In such an information system, an in-vehicle information terminal, a so-called car navigation system, is arranged at the center of the system.
In such an in-vehicle information terminal, it is general that a user inputs data to the in-vehicle information terminal to display necessary information on a monitor and sometimes outputs it by a voice guide.

A user who uses such a voice recognition system generally performs other operations at the same time as voice input. For example, in the case of a music download service for pedestrians realized by a mobile terminal or the like, the user may be walking, holding it in his hand, running, or traveling by bicycle. Further, if it is a car navigation system mounted on a car, it is assumed that the user is driving.
Therefore, in a voice recognition system using a computer, it is desirable to operate the keyboard as simply as possible. Several techniques created from such a viewpoint are known (for example, Patent Documents 1 to 4).
However, the techniques disclosed in these patent documents are excellent in that they can perform certain functions by voice input. However, these patent documents do not disclose a technique for utilizing or not utilizing an existing keyboard and executing a certain function by a shortcut key arbitrarily set by a user in advance.

Currently, various methods are known as methods for solving such problems. For example, Patent Document 1 discloses a technique in which a recognition vocabulary processed by speech recognition is set to correlate for each field of input sentences, and an appropriate vocabulary corresponding to the input sentences is prioritized. There is. Further, Patent Document 2 discloses a voice recognition system that accumulates change information of voice information input from the outside and responds flexibly to changes in voice.
However, in the current speech recognition system, since there is no disclosure or suggestion about the shortcut key, the desired application can be started only by the conventional general-purpose procedure or the general-purpose shortcut key input.

Japanese Unexamined Patent Publication No. 2007-279637 Japanese Unexamined Patent Publication No. 2010-276501 JP-A-2015-21878 Japanese Patent Application Laid-Open No. 2003-241790

It is an object of the present invention to provide a sound command input device using a special key capable of performing a specific function of a computer by sound input without using a mouse or complicated key input.
Another object of the present invention is to provide a sound command input device capable of executing a desired command by sound input by a user using a shortcut key arbitrarily set in advance.

(1) A registration command storage unit that records a plurality of predetermined operation sequences from a plurality of types of operations on a computer by matching and recording a command by sound input, and an input command that recognizes the input command by sound input. It is recorded in the analysis unit, the input command adaptation unit that searches for and matches the command by sound input analyzed by the input command analysis unit, and the command recorded in the registration command storage unit, and the searched registration command storage unit. It is a sound command input device capable of executing a specific function of a computer, characterized in that it has an operation execution unit that executes a corresponding operation sequence based on a command.

Here, sound input refers to inputting voice or sound from a device that converts sound into an electric signal, for example, a microphone. For example, in the present invention, it is necessary to input in advance sounds such as utterances by human voices, various sounds (noise and musical instrument sounds) other than words and sentences, and tapping sounds in the registration command storage unit. The registered command storage unit stores the sound input and the command name according to the operation sequence in association with each other.
Next, a person who uses a device having a built-in voice command input device inputs a voice or sound corresponding to the function to be used from the microphone. The voice command device then searches for the input command and performs the function based on the associated command.

(2) When inputting voice to the input command analysis unit, the electric signal input by one or more keys for shortcut commands is associated with the command by the voice input and stored in the registration command storage unit. The sound command input device according to (1) above, characterized in that it is stored.
Here, the key means a numeric keypad or the like on a touch panel displayed on a monitor in a device such as a liquid crystal panel, a keyboard which is an input device of a computer, or other mechanical switches. Other mechanical switches are electric circuits that switch the current on and off, such as input buttons for automobile accessories such as audio equipment installed on the dashboard of automobiles, and button switches for crushing. , A switch having contacts in two directions, left and right or up and down, for a direction indicator and the like. In addition, it is also possible to give the button or switch installed in the home electric appliance such as a cooking utensil the role of the key in the present invention.

(3) The sound command described in (2) above, wherein one or more keys for the shortcut command are icons displayed on the screen keyboard displayed on the monitor by software. It is an input device.
(4) The sound command according to (2) above, wherein one or more keys for the shortcut command are switches installed in a steering column, a shift lever, or an automobile accessory of an automobile. It is an input device.

The automobile in the present invention includes not only a four-wheeled vehicle but also a motorcycle and a three-wheeled vehicle. Further, the automobile accessory in the present invention is an audio device, an ETC, and the steering column in the present invention is a term representing the entire steering device of an automobile, such as a steering wheel, lights, wipers, and turn signals. Operation switches, levers, etc. The shift lever in the present invention is a transmission mainly mounted on a floor, an indoor dashboard, or the like. In the present invention, the concept includes not only a manual transmission but also an automatic transmission and a continuously variable transmission.
Further, it is possible to give the role of the present invention to an automobile accessory, for example, a volume button of a music playing device or the like.

By using the sound command input device according to the present invention, there is an excellent effect that a specific function of the computer can be executed by sound input without using a mouse or complicated key input.

It is a block diagram which shows the structure of Embodiment 1 which concerns on the sound command input device of this invention. It is a flow diagram for demonstrating the usage method of Embodiment 1 which concerns on the sound command input device of this invention. It is a flow diagram which shows the structure of Embodiment 2 which concerns on the sound command input device of this invention. It is a conceptual diagram for demonstrating one or two keys for the shortcut command of Embodiment 2 which concerns on a sound command input device of this invention. It is a conceptual diagram for demonstrating one or more keys for other shortcut commands of Embodiment 2 which concerns on a sound command input device of this invention. It is a conceptual diagram for demonstrating the usage of the keyboard partially displayed on the monitor of the smart phone which concerns on Embodiment 3 which concerns on the sound command input device of this invention. It is a conceptual diagram for demonstrating the use method of the keyboard in the automobile accessory which concerns on Embodiment 4 which concerns on the sound command input device of this invention. It is a conceptual diagram for demonstrating the use method of the keyboard for the car navigation system which concerns on Embodiment 5 which concerns on the sound command input device of this invention.

An example of the embodiment according to the sound command input device of the present invention will be described below with reference to the drawings. The embodiments shown below are examples of the present invention and do not limit the technical scope of the present invention.
Embodiment 1
FIG. 1 is a block diagram showing a configuration of the first embodiment according to the sound command input device of the present invention. As shown in FIG. 1, the sound command input device 1 of the present invention has, as main hardware configurations, a sound input device 10, an input command analysis unit 11, a registration command storage unit 14, an input command adaptation unit 15, and the like. It is composed of an operation execution unit 16.
In advance, the user records in the registration command storage unit 14 a plurality of predetermined operation sequences from among a plurality of types of operations on the computer and commands by sound input. As a procedure, the setting button for storing the sound in the registration command storage unit 14 displayed on the display device (for example, the display) 17 in the sound command input device is pressed.

After that, the associated sound is input via the sound input device 10. Here, the sound input device 10 may be a microphone or the like. As the associated sound, for example, "adult" or the like is input.
The user then selects the command function to be executed by the associated operation sequence. For example, the case of starting the music distribution application software will be described as an example. The user selects the program for starting the music distribution application software by associating the sound input in the above procedure. After selection, the sound command input device 1 stores the command function (starting the music distribution application software) associated with the specific sound in the registration command storage unit 14. Here, the work of matching and recording a plurality of operation sequences and commands by sound input can be performed as long as the user desires.
Next, the user utters "Oto" to the sound input device 10 of the sound command input device 1 and inputs the voice. The sound input device converts the input analog voice into a digital signal. Then, the input "adult" is analyzed by the input command analysis unit 11. Here, the input command analysis unit 11 may have a technique for digitizing an audio signal and extracting acoustic parameters. For example, it may have a technique for removing noise and frequency distortion in a real environment, and a technique for detecting a voice generation section.

The result analyzed by the input command analysis unit 11 is displayed on a display device 17 such as a monitor. Next, the input command adaptation unit 15 searches for the command recorded in the registered command storage unit 14 associated with "adult", and extracts the command recorded in the matched searched registered command storage unit. .. Then, a signal is transmitted to the operation execution unit 16 that executes the operation sequence corresponding to the extracted command. Further, the operation execution unit 16 may display the search result and the fact that the operation is being executed on the display device 17.
Further, the operation display unit 16 transmits the signal of the command execution 18 in order to execute the extracted command. As a result, the music distribution application software is started. In this way, by using the sound command input device according to the first embodiment, a specific function of the computer (here) can be input by voice while pressing a special key on the monitor with one hand without performing a mouse or complicated key input. You can run a music distribution application).

FIG. 2 is a flow chart for explaining how to use the sound command input device according to the first embodiment.
For example, a case where a map search is performed using the sound command input device according to the first embodiment will be described. As shown in FIG. 2, the sound command input device according to the first embodiment inputs a voice command name in STEP1. Here, "chizu" is uttered.
Next, in STEP 2, the input analog signal is converted into a digital signal. Next, in STEP 3, the converted digital signal is matched with a plurality of predetermined operation sequences from a plurality of types of operations in the computer recorded in advance in the registration command storage unit and commands by sound input. Here, it is also possible to grasp an error or the like by displaying the search result on the monitor (failure display). That is, in STEP 4, the sound data can be analyzed from the digital signal, and the corresponding function stored in the registration command storage unit, which is a database, can be called.
In STEP 5, the operation sequence searched by matching in STEP 4 is executed. This makes it possible to display a map on a monitor (not shown).

Embodiment 2
FIG. 6 is a flow chart showing the configuration of the second embodiment according to the sound command input device of the present invention.
In advance, the user records in the registration command storage unit a plurality of predetermined operation sequences from among a plurality of types of operations on the computer and commands by sound input.
As a procedure, after pressing the setting button for storing the sound in the registration command storage unit displayed on the display device (for example, the display) in the sound command input device, one key (special key) to be associated is selected. Here, the special key is a button or switch having a function as a shortcut key such as a "Shift" key, a "Ctrl" key, an "Alt" key, or the like on a computer keyboard.

In the second embodiment, while pressing the "Shift" key and the "Ctrl" key, the associated sound is input via the sound input device 10. Here, the sound input device 10 may be a microphone or the like. As the associated sound, for example, "adult" or the like is input.
For example, a case where a map search is performed using the sound command input device according to the second embodiment will be described. As shown in FIG. 3, the sound command input device according to the second embodiment inputs a voice command name in STEP1. Here, "chizu" is uttered. At this time, in order to switch to the shortcut function, it is necessary to input one key for the shortcut command displayed on the monitor while selecting it with a finger (STEP2). For example, the "Ctrl" key is selected as the key and the numeric keypad is selected, and the signal is transmitted to the command analysis unit at the same time as the voice input as the electric signal.

Next, in STEP 3, the input analog signal is converted into a digital signal. Next, in STEP4, the converted digital signal and the electronic signal from STEP2 are received, and a plurality of predetermined operation sequences and sounds are selected from among a plurality of types of operations in the computer recorded in advance in the registration command storage unit. Match commands by input. That is, in STEP 5, sound data can be analyzed from the digital signal, and the corresponding function stored in the registration command storage unit, which is a database, can be called. Here, it is also possible to grasp an error or the like by displaying the search result on the monitor (failure display).
In STEP 6, the operation sequence searched by matching in STEP 5 is executed. This makes it possible to display a map on a monitor (not shown).

FIG. 4 is a conceptual diagram for explaining one or more keys for the shortcut command of the second embodiment according to the sound command input device of the present invention.
As shown in FIG. 4, the keys used in the second embodiment are 6 of "Shift" key, "Ctrl" key, "Fn" key, "Shift / Ctrl" key, "Shift / Alt" key, and "Alt". Kind. By using these six types of keys (special keys), it is possible to record a plurality of operation sequences and commands by sound input in advance. A desired command can be executed by making a sound while pressing one or two of the keys set at the time of use.

FIG. 5 is a conceptual diagram for explaining one or more keys for other shortcut commands of the second embodiment according to the sound command input device of the present invention.
As shown in FIG. 5, there are two types of keys used in the second embodiment, the "Shift" key and the "Ctrl" key. By using these two types of keys (special keys), it is possible to record a plurality of operation sequences and commands by sound input in a matching manner in advance. A desired command can be executed by making a sound while pressing one or two of the keys set at the time of use.

Embodiment 3
FIG. 6 is a conceptual diagram for explaining how to use the keyboard partially displayed on the monitor of the smart phone according to the third embodiment of the sound command input device of the present invention. The sound command input device according to the fourth embodiment is used for a mobile phone of a smart phone.
One or more keys for the shortcut command are characterized by being an icon displayed on the screen keyboard for the smart phone 18 displayed on the monitor by software.
As shown in FIG. 6, the key used in the third embodiment is a special key displayed by another mode on the icon 19 displayed on the monitor of the smart phone. By pressing the icon 19 for the sound command input device, it is displayed on the monitor of the smart phone. There are two types of keys used in the third embodiment, the "Shift" key 20 and the "normal input" key 21. By using these two types of keys (special keys), it is possible to record a plurality of operation sequences and commands by sound input in a matching manner in advance. A desired command can be executed by making a sound while pressing one or two of the keys set at the time of use.

In the third embodiment, while pressing the "Shift" key 20, the associated sound is input via the sound input device. Here, the sound input device includes a microphone (not shown) and the like. As the associated sound, for example, "music" is input by voice.
For example, a case of listening to music by using the sound command input device according to the third embodiment will be described. The sound command input device according to the third embodiment presses the icon 19 and displays the "Shift" key 20 and the "normal input" key 21 on the monitor of the smart phone. Then, while pressing the "Shift" key 20, "music" is generated. Then, the input command adaptation unit that searches for and matches the commands stored in the registered command storage unit in advance operates, and the operation sequence is executed correspondingly based on the commands recorded in the searched registration command storage unit. The execution unit operates. As a result, the function for listening to music is activated, and it becomes possible to select any music.

Embodiment 4
FIG. 7 is a conceptual diagram for explaining how to use the keyboard in the automobile accessory according to the fourth embodiment of the sound command input device of the present invention.
One or more keys for shortcut commands used in the present invention are characterized by being a switch button attached to an automobile accessory. As shown in FIG. 7, the Shift key 24 and the normal input key 27 are installed on the switch panel of the audio device. That is, there are two types of keys used in the fourth embodiment, the "Shift" key 24 and the "normal input" 27 key. By using these two types of keys (special keys), it is possible to record a plurality of operation sequences and commands by sound input in a matching manner in advance. A desired command can be executed by making a sound while pressing one of the keys set at the time of use.

Embodiment 5
FIG. 8 is a conceptual diagram for explaining one or more keys for the shortcut command of the fifth embodiment according to the sound command input device of the present invention. This embodiment is particularly used for car navigation systems.
As shown in FIG. 8, the key used in the second embodiment is installed in the center of the front of the steering 30. If the button 31 is pressed while pressing the special key 32 in the center, the same operation as pressing the above-mentioned "Shift" key, for example, can be achieved. Here, the button 31 is usually a button for sounding a horn. By pressing the button 31 while pressing the special 32 in the center, the function of the sound command input device can be used without sounding the horn. Further, if the button 33 is pressed while pressing the special key 32 in the center, the same operation as pressing the above-mentioned "Ctrl" key can be obtained.

1 Sound command input device 10 Sound input device 11 Input command analysis unit 14 Registration command storage unit 15 Input command adaptation unit 16 Operation execution unit 17 Display device such as monitor 20,21,24,27,31,32 Special keys

Claims (3)

Pre-matched and recorded the operation sequence determined from multiple types of operations on the computer and the command by sound input matched with the electric signal input by one or more keys for the shortcut command in the keyboard function of the computer. Search for the registered command storage unit, the input command analysis unit that recognizes the input command by the sound input, the command by the sound input analyzed by the input command analysis unit, and the command recorded in the registration command storage unit. A specific function of the computer characterized by having an input command adaptation unit to be matched and an operation execution unit to execute a corresponding operation sequence based on the command recorded in the searched registration command storage unit. A sound command input device that can be executed. The sound command input device according to claim 1 , wherein one or more keys for the shortcut command are icons displayed on a screen keyboard displayed on a monitor by software. The sound command input device according to claim 1 , wherein the one or more keys for the shortcut command are switch buttons installed on an automobile accessory, an automobile steering column, or a shift lever.

Images