JP2014112129A - Control device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a control device which does not need a user operation in order to enable a voice operation again after the voice operation is disabled, in a configuration having both of a manual operation and the voice operation.SOLUTION: When a speech button is depressed by a user, a control device shifts to a voice operation possible section in its time chart. A manual operation is always possible. When the user performs the manual operation, the control device immediately shifts to a voice operation disabled section in its time chart, and if a predetermined time elapses after completion of the manual operation, the control device automatically returns to the voice operation possible state. Since the control device automatically returns to the voice operation possible state without an operation by the user, convenience for the user is improved.

Description

  The present invention relates to a control device.

  In various devices operated by the user, in addition to the conventional operation method in which the user operates buttons etc. by hand, the user instructs the command content by voice, and the device side analyzes the voice to determine the command content. Operation methods are becoming widespread. For example, Patent Document 1 below discloses a control device that includes both a manual operation unit and a voice input operation unit, and allows an operator to continuously perform an input operation while freely changing both operation units. ing.

JP 2003-291750 A

  An example of a time chart in the operation of the control device of Patent Document 1 is shown in FIG. In this figure, in order from the top, the presence / absence of an operation on a speech button, whether or not a voice operation is possible, whether or not a manual operation is possible, and whether or not a manual operation is possible are illustrated with the horizontal axis as a time axis. As shown in FIG. 8, this apparatus is always in a manually operable section, and a manual operation from the user is received by a predetermined input unit, and processing corresponding to the operation content is performed.

  On the other hand, the voice operation is not always possible, and when the user operates a predetermined speech button, the voice operation can be entered and the voice operation can be accepted. Therefore, when the utterance button is operated, the user can perform both manual operation and voice operation. However, when the manual operation is performed, the key operation sound at that time may become noise for voice input. Therefore, as shown in FIG. 8, the voice operation is automatically switched to be disabled at the same time when the manual operation is accepted.

  In the apparatus of Patent Document 1, when entering the voice operation disabled section, the user must perform an operation (manual operation) such as operating the speech button again in order to enable the voice operation again. When manual operation is accepted, the automatic voice operation disabled section is effective for avoiding a decrease in voice input accuracy due to noise caused by manual operation, as described above, but to enable voice operation again. It is undesirable from the viewpoint of user convenience that some manual operation is required.

  Therefore, in view of the above, the problem to be solved by the present invention is that, in a configuration including both manual operation and voice operation, an operation by the user is unnecessary in order to enable the voice operation again after disabling the voice operation. It is to provide a control device.

  In order to achieve the above object, a control device according to the present invention has a function of accepting an input by voice, and can be switched between activation and interruption of the function, and input by manual operation A second input means for receiving the input, and an interruption means for interrupting the function of the first input means when the second input means accepts an input by manual operation while the function of the first input means is activated. In a state where the interrupting means interrupts the function of the first input means, when the second input means stops accepting input by manual operation and a predetermined time has elapsed, the function of the first input means is activated again. And an activating means. According to the present invention, even if the voice input function is interrupted by manual operation, the voice input function is automatically restarted if no manual operation is accepted for a predetermined time. High convenience can be realized without any operation.

  In addition, there is provided a stopping means for stopping the function of the first input means, and the plurality of manual inputs received by the second input means includes a state in which the function of the first input means is stopped by the stopping means. The input executed may be different from the case where the input is received by the stop unit and the case where the input is received in a state where the function of the first input unit is not stopped by the stop unit. . According to the present invention, the voice input function is executed by manual operation in a state where the voice input function is interrupted by manual operation after activation and in a state where the voice input function is stopped by a method other than the manual input operation or by interruption. The user convenience can be further improved by appropriately setting the contents.

  The display unit displays operation items by the first input unit and the second input unit, and the display unit displays in a visible manner whether the function of the first input unit is activated or stopped. Display control means. According to this invention, since the user is appropriately informed whether the voice input function is being activated or stopped, it is possible to suppress user operation errors.

  And a voice output means for outputting a voice associated with the input received by the first input means or the second input means, wherein the predetermined time is equal to a time during which the voice output by the voice output means is performed. It may be a length. According to the present invention, since the voice input function is not restarted while the voice associated with the operation input is being output, the voice output from the control device side becomes noise and lowers the voice input function. Avoided.

  The stop means may stop the function of the first input means when processing associated with the input received by the first input means is executed. According to the present invention, since the voice input function is automatically stopped (terminated) when the process instructed by the user is executed, it is avoided that the voice input function is unnecessarily sustained.

The figure which shows one Embodiment of the control apparatus of this invention. The figure which shows the example of a manual operation part and a voice operation starting part. The flowchart which shows the example of the control procedure of this invention. The figure which shows the example of the time chart by this invention. The figure which shows the example of the transition of the display state by this invention. The figure which shows the example of the transition of the display state with respect to manual operation before voice input operation starting. The figure which shows the example of the transition of the display state with respect to manual operation during audio | voice input operation starting. The figure which shows the example of the time chart in a prior art.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic diagram of an apparatus configuration in an embodiment of a control apparatus (control system) of the present invention. The control system 1 (system) includes a voice recognition execution unit 2, a voice input start / end determination unit 3, a voice operation activation unit 4, an operation state determination unit 5, a manual operation unit 6, a manual operation end determination unit 7, and a voice guide output unit. 8. An operation state display unit 9 and a system controller 10 are provided. For example, the system 1 may be installed in an automobile vehicle.

  The system 1 corresponds to two types of input: voice input operation (or voice input, voice operation, etc.) and manual operation input (or manual operation, manual operation input, manual operation, etc.). The voice recognition execution unit 2, the voice input start / end determination unit 3, and the voice operation activation unit 4 are parts related to the voice input operation, and the manual operation unit 6 and the manual operation end determination part 7 are parts related to the manual operation input. is there. The operation state determination unit 5 is a part that performs processing for integrating processing related to both input operations. The manual operation input is an input performed by the user using a hand such as pressing various buttons or keys. The voice operation input is a voice generated by the user instructing the command content, and the system 1 recognizes the voice. In this method, the contents of the command are determined by performing processing.

  The voice recognition execution unit 2 is a part that executes a process for recognizing a voice uttered by a user. The voice recognition execution unit 2 includes a voice input operation unit 20 and a standby word storage / management unit 21. The voice input operation unit 20 includes a microphone, for example, and acquires voice from the user. The standby word storage / management unit 21 includes a memory for storing standby word speech data used for speech recognition in the speech recognition execution unit 2 in advance, and stores standby word speech data and speech of speech data of standby words. Management such as sending to the recognition execution unit 2 is performed.

  The speech recognition execution unit 2 executes speech recognition processing using an existing method. That is, for example, matching is calculated between the voice data acquired by the voice input operation unit 20 and the voice data of the standby word stored in the standby word storage / management unit 21, and the matching rate becomes a predetermined value or more. When there is a standby word, it is determined that an instruction including the standby word is instructed by the user. The voice recognition execution unit 2 transmits the operation instruction content to the operation state determination unit 5. If there is no standby word having a matching rate equal to or higher than a predetermined value, the voice recognition execution unit 2 transmits voice input stop instruction information to the operation state determination unit 5 on the assumption that voice recognition has failed.

  The voice input start / end determination unit 3 is a part that determines the start and end of a voice input operation. Specifically, the voice input start / end determination unit 3 performs the following processing, for example. The voice input start / end determination unit 3 suspends the function related to the voice input operation in the voice recognition execution unit 2 and the like when manual operation start instruction information (described later) is given from the operation state determination unit 5. The voice input start / end determination unit 3 stops (ends) the function related to the voice input operation in the voice recognition execution unit 2 or the like when voice input stop instruction information or voice input end instruction information (described later) is given from the operation state determination unit 5. )

  Further, the voice input start / end determination unit 3 is configured to perform a voice recognition execution unit when voice input operation start instruction information (described later) is given from the operation state determination unit 5 in a state where the function of the voice input operation is stopped (interrupted or terminated). Activates the function of voice input operation at 2 etc. The voice input start / end determination unit 3 receives the redo instruction information (described later) from the operation state determination unit 5, and the voice recognition execution unit 2 or the like receives the last (up to the current time) from the operation state determination unit 5. Cancels the latest instruction information and returns to the previous state.

  The voice operation activation unit 4 (speech button) is a part that receives an input requesting the user to start a voice input operation. Specifically, the voice operation activation unit 4 may be a button or the like equipped on the steering wheel of the vehicle as shown in FIG. When the user operates (for example, presses) the voice operation activation unit 4, voice input operation start instruction information is transmitted from the voice operation activation unit 4 to the operation state determination unit 5.

  The operation state determination unit 5 is a part that performs overall processing in the system 1. Specifically, when manual operation start instruction information is transmitted from the manual operation unit 6, the operation state determination unit 5 stores it in the memory 50 and transmits it to the voice input start / end determination unit 3. When the voice input stop instruction information is transmitted from the voice recognition execution unit 2, the operation state determination unit 5 stores it in the memory 50 and transmits it to the voice input start / end determination unit 3. When the voice input operation start instruction information is transmitted from the voice operation activation unit 4, the operation state determination unit 5 stores it in the memory 50 and transmits it to the voice input start / end determination unit 3.

  Further, when the redo instruction information is transmitted from the manual operation unit 6, the operation state determination unit 5 stores it in the memory 50 and transmits it to the voice input start / end determination unit 3. When the operation state determination unit 5 receives the operation command content from the user transmitted from the voice recognition execution unit 2 or the manual operation unit 6, the operation state determination unit 5 transmits the operation command content to the system controller 10 related to the operation command content and The input end instruction information is transmitted to the voice input start / end determination unit 3. The system controller 10 executes the acquired operation command content.

  Further, the operation state determination unit 5 executes a process related to automatic restart of the voice input operation as a main part of the present invention. Specifically, when the manual operation end instruction information transmitted from the manual operation end determination unit 7 is received, this is stored in the memory 50 and the voice input operation start instruction information is transmitted to the voice input start end determination unit 3. . This process will be described later with reference to FIG.

  The manual operation unit 6 is a part that receives a manual operation (manual operation) from a user. Specifically, as shown in FIG. 2, the manual operation unit 6 may be, for example, direction keys 60, 61, 62, 63, an enter key 64, a return key 65, and the like equipped on the steering wheel of the vehicle. When the user operates (for example, presses) each key of the manual operation unit 6, the operation command content associated with each key is transmitted to the operation state determination unit 5, and the manual operation unit 6 operates the operation state determination unit 5. Manual operation start instruction information is transmitted to.

  The manual operation end determination unit 7 is a part that determines whether or not the manual operation to the manual operation unit 6 by the user has ended. The manual operation end determination unit 7 transmits manual operation end instruction information to the operation state determination unit 5 when a predetermined time elapses after no manual operation to the manual operation unit 6 is detected.

  Next, the voice guide output unit 8 is a part that includes a speaker, for example, and outputs a voice guide to the user. In relation to the present invention, the voice guide unit 8 outputs voice associated with an operation by the user (including guidance voice for guiding the operation and feedback voice for the user to reconfirm the operation content). The operation state display unit 9 is a part that displays to inform the user of the operation state. For example, the operation state display unit 9 includes a liquid crystal display, and when the system 1 is mounted on a vehicle, the user (vehicle occupant, driver, for example) as shown in FIG. ) Can be visually recognized (a part of the instrument panel, etc.). The system controller 10 is a part that controls various devices operated by the system 1 and controls, for example, each device mounted on the vehicle.

  Under the configuration shown in FIG. 1 (or FIG. 2 as well), the system 1 executes the processing procedure shown in FIG. 3, for example. Except for the user operation portion in this processing procedure, it may be programmed in advance and stored in, for example, the memory 50 and called by the system 1 and automatically executed.

  In the processing procedure of FIG. 3, first, the user operates (eg, presses) the utterance button 4 in S10. As a result, the voice input operation start instruction information is transmitted from the voice operation activation unit 4 to the operation state determination unit 5. The operation state determination unit 5 stores the transmitted voice input operation start instruction information in the memory 50 and transmits it to the voice input start / end determination unit 3. Upon receiving the voice input operation start instruction information, the voice input start / end determination unit 3 activates the voice input operation function in the voice recognition execution unit 2 or the like.

  Next, in S20, the speech recognition execution unit 2 acquires the standby word stored in the standby word storage / management unit 21 and creates a standby word list (for example, on its own RAM). The operation state determination unit 5 instructs the operation state display unit 9 to display the operation menu list.

  Next, in S30, the user performs a desired manual operation on the manual operation unit 6 while referring to the operation menu list displayed in S20. As a result, an operation command associated with the user's operation content with respect to the manual operation unit 6 is transmitted to the operation state determination unit 5, and manual operation start instruction information is transmitted from the manual operation unit 6 to the operation state determination unit 5. . When receiving the manual operation start instruction information, the operation state determination unit 5 stores the same information in the memory 50 and transmits it to the voice input start / end determination unit 3.

  Subsequently, in S40, the voice input start / end determination unit 3 receives the manual operation start instruction information from the operation state determination unit 5, and interrupts the voice input operation function in the voice recognition execution unit 2 and the like. This process suppresses manual operation noise from causing erroneous operation in the voice input operation.

  In S50, the operation state determination unit 5 causes the display of the operation menu on the operation state display unit 9 to transition according to the content of the manual operation in S30. As a specific example, for example, a menu indicating that the voice input is disabled in the operation menu is started (the display indicating that the voice input is enabled is terminated) or the menu is displayed in response to the manual operation in S30. Perform page switching.

  Next, in S60, the operation state determination unit 5 determines whether or not the time when there is no manual operation from the user exceeds a predetermined time. While there is no manual operation from the user, S60 is repeated to measure the elapsed time without the manual operation (S60: NO), and when the time without the manual operation from the user exceeds a predetermined time (S60: YES) Proceed to S70.

  Note that the length of the predetermined time in S60 may be set appropriately in advance, for example, or may be set by the user. In the case of setting in advance, for example, it may be the length of time required for a predetermined voice (including guidance voice and feedback voice) associated with a manual operation performed by the user to be output from the voice guide output unit 8. By setting the predetermined time in this way, it is possible to avoid confusion between the voice guidance and the user's voice.

  In S70, the manual operation end determination unit 7 transmits manual operation end instruction information to the operation state determination unit 5 because a predetermined time has elapsed since the manual operation to the manual operation unit 6 is not detected.

  In step S80, the operation state determination unit 5 receives the manual operation end instruction information transmitted from the manual operation end determination unit 7, stores the information in the memory 50, and inputs the voice input start / end determination unit 3 to the voice input start / end determination unit 3. The operation start instruction information is transmitted. Upon receiving the voice input operation start instruction information, the voice input start / end determination unit 3 activates (restarts or restores) the voice input operation function in the voice recognition execution unit 2 or the like.

  Since the voice input operation has been restarted, in S90, the voice recognition execution unit 2 acquires the standby word stored in the standby word storage / management unit 21 and creates a standby word list.

  When the user instructs the desired operation content by voice in S100, the voice input operation unit 20 acquires the voice, and the voice recognition execution unit 2 performs matching calculation with the words in the standby word list for the voice data. I do. Accordingly, if there is a word having a predetermined matching rate or more, the speech recognition execution unit 2 transmits a command including the word to the operation state determination unit 5.

  In step S110, when the operation state determination unit 5 receives the operation command content, the operation state determination unit 5 transmits the operation command content to the system controller 10 related to the operation command content and sends the voice input end instruction information to the voice input start / end determination unit 3. Send. The system controller 10 executes the acquired operation command content.

  In S120, since the voice input start / end determination unit 3 has received the voice input end instruction information, the voice input operation function in the voice recognition execution unit 2 or the like is stopped (terminated). This avoids unnecessary sustaining of the voice input operation function. The above is the processing procedure of FIG.

  A time chart when the processing of FIG. 3 is executed is, for example, as shown in FIG. In the example of FIG. 4, a voice operable section is entered by pressing the utterance button in S10. Manual operation is always possible. When the user performs a manual operation (arbitrary operation with respect to the manual operation unit 6) (S30), the voice operation disabled section is immediately entered (S40). However, when a predetermined time elapses after the manual operation is finished (S60: YES), the voice operation is automatically returned to the ready state (S80).

  As described above, according to the present invention, even if the user cannot perform a voice operation by performing some manual operation, if the time without the manual operation exceeds a predetermined time, the voice operation can be automatically performed without the user's operation. Return to. Therefore, the user operation for returning to the voice operable state is unnecessary, which is convenient for the user. This high convenience is particularly effective when the present invention is mounted on an automobile and the user is driving the vehicle.

  FIG. 5 shows an example of a state in which the display state on the operation state display unit 9 changes according to the processing procedure shown in FIG. In the following, the upper left, upper right, left middle, right middle, lower left, and lower right displays in FIG. 5 are referred to as first, second, third, fourth, fifth, and sixth displays, respectively.

  First, the first display is an example of an initial screen, and the display content includes a menu display 90 and an icon display 91. In the menu display 90, four menu lists (operation items) of “AAA”, “BBB”, “CCC”, and “DDD” are displayed. Specifically, “AAA” is “destination setting” in the case of a navigation device. In the icon display 91, icons indicating a direction key and a determination key are displayed. In the first display, “AAA” is selected from among the four items (however, the selected state indicates a selected state before the enter key is pressed). It is displayed so as to be visible to the user. Specifically, in the selection display 92 in the example of FIG. 5, only the area “AAA” is changed in color.

  When the utterance button 4 is pressed while the first display is displayed (S10 in FIG. 3), the display changes to the second display. Since the voice operation is enabled when the utterance button 4 is pressed, a display for notifying the user of this is made in the second display. Specifically, in the second display, icon displays 93 and 94 are added to the first display. The icon displays 93 and 94 are both icon displays indicating that voice operation is possible. In the example of FIG. 5, the icon display 93 displays an icon indicating a keyword that can be recognized by voice before each item of the menu, and the icon display 94 displays an icon including a picture or character indicating a voice operation in the vicinity of the menu. .

  When the user presses the down key 62 (the example of S30 in FIG. 3) while the second display is being displayed, the display transitions to the third display. Since the manual operation is performed by the user, the voice operation is disabled, and the third display displays that information to the user. Specifically, in the third display, the icon displays 93 and 94 are deleted from the second display, and an icon display 95 is added instead. The icon display 95 is an icon display indicating that the voice operation is disabled. In the example of FIG. 5, the icon display 95 displays an icon including a picture or character indicating that voice operation is impossible in the vicinity of the menu.

  In a state where the third display is being displayed, if a manual operation from the user is not performed for a predetermined time (S60: YES in FIG. 3), the display transitions to the fourth display. As described above, if the manual operation is not performed for a predetermined time, the voice operation is automatically returned to a state where it can be operated. Therefore, in the fourth display, a display for notifying the user is made. Specifically, in the fourth display, the icon display 95 is deleted from the third display, and icon displays 93 and 94 are added instead.

  In a state where the fourth display is displayed, when the user speaks “FFF” (an example of S100 in FIG. 3), the display transitions to the fifth display. When the utterance is performed, the process associated with the command by the utterance is executed, so the transition from the fourth display to the fifth display is a transition by the process. Specifically, in the fifth display, the menu list in the lower hierarchy of “FFF” in the menu display by the fourth display (“aaa”, “bbb”, “ccc”, “ddd” in the example of FIG. 5) is superimposed. Is displayed.

  When the user presses the enter key 64 while the fourth display is displayed, the display transitions to the sixth display. When the enter key 64 is pressed, the process associated with the press is executed, and the transition from the fourth display to the sixth display is a transition by the process. In the example of FIG. 5, in the sixth display, the icon displays 93 and 94 are deleted from the fourth display, an icon display 95 is added, and a selection display 92 is added to “EEE”. As described above, in the display mode of the present invention illustrated in FIG. 5, information necessary for the user to easily operate can be visually recognized by using display of various icons.

  In the present invention, the processing contents executed by the same manual operation are set differently before the voice input operation is started or when the voice input operation is stopped other than the manual operation and when the voice input operation is started or interrupted by the manual operation. May be. Examples thereof are shown in FIGS. 6 and 7 show the same menu lists “AAA”, “BBB”, “CCC”, “DDD”, and after the downward key 62 is pressed in a state where “AAA” is selected. FIG. 6 shows the state before the voice input operation is started. In this case, when the downward key 62 is pressed, the state is changed to “BBB” being selected. This is the same when the voice input operation is stopped other than by manual operation.

  On the other hand, FIG. 7 shows that the voice input operation is being activated. In this case, when the down key 62 is pressed, an icon indicating the transition to the voice operation disabled state is displayed and the next page of the menu list (“EEE”, “FFF”, “GGG”, “HHH”). Even during interruption of the voice input function by manual operation, transition may be made as shown in FIG. That is, in the case of this example, if a manual operation is performed while the voice input operation is being started or interrupted by a manual operation, the menu list on the next page can be viewed immediately, so that keywords that can be recognized by voice can be viewed efficiently.

  The above embodiments may be appropriately changed within the scope of the gist of the claims. For example, the present invention is not limited to the examples shown in FIGS. 6 and 7, and in the present invention, the processing contents executed by the same manual operation before and during the start of the voice input operation are different so as to improve the convenience for the user. Should be set appropriately. In the example of FIG. 3, when the function is executed in S110, the voice input operation function is ended in S120. However, the present invention is not limited to this. For example, a voice input such as “End voice input” is made by the user. Then, the voice input operation function may be terminated. Alternatively, the voice input operation function may be terminated when a predetermined manual operation input for completing the voice input is performed.

1 Control system (control device)
4 Voice operation starting part 6 Manual operation part

Claims (5)

A first input means having a function of accepting an input by voice and capable of switching between activation and interruption of the function;
A second input means for accepting manual input;
Interrupting means for interrupting the function of the first input means when the second input means accepts an input by manual operation while the function of the first input means is activated;
When the interrupting means interrupts the function of the first input means and the second input means no longer accepts manual input and a predetermined time has elapsed, the restart of restarting the function of the first input means Means,
A control device comprising: Stop means for stopping the function of the first input means,
The plurality of manual inputs received by the second input means include a case where the input is received in a state where the function of the first input means is stopped by the stop means, and a case where the input of the first input means is performed by the stop means. The control device according to claim 1, wherein the input includes a process executed differently depending on an input received when the function is not stopped. A display unit for displaying operation items by the first input unit and the second input unit;
In the display unit, display control means for displaying in a visible manner whether the function of the first input means is activated or interrupted;
The control device according to claim 1, further comprising: Voice output means for outputting voice associated with the input received by the first input means or the second input means;
4. The control device according to claim 1, wherein the length of the predetermined time is a length of time during which sound output by the sound output unit is performed.   The control device according to claim 2, wherein the stop unit stops the function of the first input unit when a process associated with the input received by the first input unit is executed.

Images