JP2006208461A - Equipment controller of voice recognition type - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform an appropriate control operation in accordance with a voice input even though the meaning of the voice input is vague. <P>SOLUTION: An analysis section 22 determines whether a plurality of different selection candidates exists or not as a control operation of control equipment 14 for the meaning of the voice input on the basis of correspondence information (information related to the correspondence relationship between the control operation of the control equipment 14 and operation information extracted from a recognized language) of a correspondence information storage section 23. When the determination result is "YES", a control operation determination section 26 extracts control operations related to the latest past control operation (a prior operation) of the control equipment 14 on the basis of related information (for example, degree of relation information between the control operations of the plurality of pieces of the control equipment 14) and operation history information of an operation history storage section 28 (history information of the control operation of the control equipment 14 operated by an operator in the past or selected by the control operation determination section 26) and selects the control operation having a highest degree of relationship to the prior operation. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a voice recognition type device control apparatus.

Conventionally, for example, a history of recognition results for an input voice signal is stored, the use frequency of each of the plurality of recognition results is detected based on the stored history, and the recognition accuracy of the voice recognition process is improved by referring to the detected use frequency. A voice recognition device (see, for example, Patent Document 1) is known.
JP 2003-108189 A

By the way, in the speech recognition apparatus according to the above-described prior art, only the recognition accuracy for the input speech signal is improved, so that when performing an appropriate control operation according to the recognition result for the input speech signal, for example, When the speech itself has ambiguous meaning content, even if the character string constituting this input speech is recognized with high accuracy, the meaning content intended by the operator cannot be accurately understood, and appropriate control operations are performed. There is a possibility that it cannot be executed.
The present invention has been made in view of the above circumstances, and provides a voice recognition type device control apparatus capable of executing an appropriate control operation according to voice input even if the meaning content of the voice input is ambiguous. For the purpose.

  In order to solve the above-described problems and achieve the object, the voice recognition type device control apparatus according to the first aspect of the present invention includes voice input means for inputting voice (for example, the voice input apparatus 11 in the embodiment). ), Voice recognition means for recognizing the voice input by the voice input means (for example, the voice recognition unit 21 and the analysis unit 22 in the embodiment), and control of devices whose execution timings are adjacent in time series Relevance level storage means (for example, related information storage unit 27 in the embodiment) for storing the relevance level between operations, and operation state acquisition means (for example, in the embodiment) for acquiring information on the operating state of the device The control operation of the device according to the recognition result by the voice recognition unit based on the relevance degree related to the operation state of the device acquired by the control operation determination unit 26, the device operation detection unit 29) and the operation state acquisition unit The fruit Control action setting means (for example, control action determination unit 26 in the embodiment) to be set as a target, and control means (for example, control equipment) according to the control action of the equipment set by the control action setting means (for example, And a device control unit 30) according to the embodiment.

According to the voice recognition type device control apparatus having the above-described configuration, the relevance storage unit stores in advance the relevance between the control operations of devices that are sequentially executed as information on the control operations of a plurality of devices. For example, in the case where the meaning content of the input voice itself is ambiguous and there are a plurality of selection candidates as device control operations for the recognition result by the voice recognition unit, first, the operation state acquisition unit, For example, information on the control operation of the device actually executed in the last past or information on the control operation of the device selected as the execution target, and further, selected as the history or the execution target of the control operation of the device actually executed so far The operation state of the device including the history of the control operation of the device is acquired by an operation such as detection or search for an appropriate storage unit. Then, the control operation setting unit searches the relevance level relating to the operation state of the device acquired by the operation state acquisition unit from the relevance level storage unit, and based on the relevance level obtained by the search, the device that is a candidate for the execution target Get the control action. Then, the control operation of the device to be executed is set according to the acquired control operation of the device and the recognition result by the voice recognition means.
Thereby, even if the meaning content of the voice input is ambiguous, an appropriate control operation can be set.

  Furthermore, in the voice recognition type device control apparatus according to the present invention as set forth in claim 2, the relevance level storage means stores a relevance level between an appropriate device control operation and a plurality of device control operations. It is said.

  According to the voice recognition type device control apparatus having the above-described configuration, by setting the degree of relevance for the control operation of a plurality of devices for each control operation of a single device as appropriate, while supporting various control contents, An appropriate control operation can be set according to the recognition result by the voice recognition means.

  Furthermore, in the voice recognition type device control apparatus according to the third aspect of the present invention, the operation state acquisition unit is configured to operate the device based on a history of device control operations set by an operator or the control operation setting unit. It is characterized by acquiring state information.

  According to the voice recognition type device control apparatus having the above configuration, compared to the case where the control operation of the device according to the recognition result by the voice recognition means is simply set based on the information on the operation state of the device in the latest past. Thus, when setting the control operation of the device to be executed, it is possible to set a more appropriate control operation by reflecting the processing contents of a series of control processes executed sequentially or by the selected control operation.

  Furthermore, the voice recognition type device control apparatus according to the present invention described in claim 4 is based on the history of the control operation of the device set by the operator or the control operation setting means, and is stored in the association degree storage means. It is characterized by comprising a relevance level changing means (for example, a control operation determination unit 26 in the embodiment) for changing the relevance level.

  According to the voice recognition type device control apparatus having the above configuration, the degree of relevance is changed based on the history of control operations of the set device, so that in the subsequent processing, the recognition result by the voice recognition unit is determined based on the degree of relevance. The reliability when setting the control operation of the device can be improved.

  Furthermore, in the voice recognition type device control apparatus according to the present invention as set forth in claim 5, the relevance level changing means is arranged so that each execution timing is adjacent within a predetermined time interval on a time series in the history of control operations of the device. The relevance degree stored in the relevance degree storage means is changed based only on the history of the control operations of the matching devices.

  According to the voice recognition type device control apparatus having the above-described configuration, the degree of relevance with respect to each control content is zero or slightly with respect to control operations of devices adjacent to each other whose execution timing exceeds a predetermined time interval in time series. Therefore, it is possible to prevent the association degree stored in the association degree storage unit from being changed unnecessarily.

As described above, according to the voice recognition type device control device of the present invention, an appropriate control operation can be set even if the meaning content of voice input is ambiguous.
Furthermore, according to the voice recognition type device control apparatus of the present invention as set forth in claim 2, by setting the relevance level for the control operations of a plurality of devices for each appropriate single device control operation, It is possible to set an appropriate control operation according to the recognition result by the voice recognition means while dealing with various control contents.
Furthermore, according to the voice recognition type device control apparatus of the present invention described in claim 3, the control operation of the device according to the recognition result by the voice recognition means is simply based on the information of the operation state of the device in the latest past. Compared with the case of setting as an execution target, when setting the control operation of the device to be executed, reflecting the processing contents of a series of control processing by sequential or selected control operation, more appropriate control operation Can be set.
Furthermore, according to the voice recognition type device control apparatus of the present invention as set forth in claim 4, by changing the relevance level based on the history of control operation of the set device, the voice based on the relevance level in the subsequent processing The reliability at the time of setting the control operation of the device according to the recognition result by the recognition means can be improved.
Furthermore, according to the voice recognition type apparatus control apparatus of the present invention as set forth in claim 5, it is possible to prevent the relevance degree stored in the relevance degree storage means from being unnecessarily changed.

Hereinafter, a voice recognition type device control apparatus according to an embodiment of the present invention will be described with reference to the accompanying drawings.
A voice recognition type device control apparatus 10 according to the present embodiment is mounted on a vehicle as shown in FIG. 1, for example, and includes a voice input device 11, an output device 12, an electronic control unit (ECU) 13, and a control device 14. And an appropriate response is output from the output device 12 such as a speaker or a display in response to the voice input from the operator to the voice input device 11 including a microphone or the like, for example, navigation. It controls the operation of various control devices 14 mounted on a vehicle such as a device, an air conditioner, an acoustic device, a broadcast receiver, and a communication device.

  The electronic control unit (ECU) 13 includes, for example, a voice recognition unit 21, an analysis unit 22, a correspondence information storage unit 23, a dialogue control unit 24, a dialogue data storage unit 25, a control operation determination unit 26, and related information. The storage unit 27, the operation history storage unit 28, the device operation detection unit 29, and the device control unit 30 are configured.

The voice recognition unit 21 performs voice recognition processing based on vocabulary data stored in advance for voice input input from the operator via the voice input device 11, and recognizes character data corresponding to voice input. A language is generated, and this recognition language is output to the analysis unit 22.
The analysis unit 22 analyzes the recognition language generated by the speech recognition unit 21, grasps the meaning content of the recognition language, and outputs the analysis result to the dialogue control unit 24. For example, the analysis unit 22 extracts operation information related to the control operation of the control device 14 from the recognition language, and stores correspondence information (for example, the control operation of the control device 14 and the analysis unit 22 stored in the correspondence information storage unit 23 in advance). Whether or not there are a plurality of different selection candidates as the control operation of the control device 14 according to the semantic content of the recognition language. The determination result is output to the dialogue control unit 24.

  The dialogue control unit 24 has a plurality of different control operations of the control device 14 according to the analysis result of the analysis unit 22, for example, the operation information related to the control operation of the control device 14 extracted from the recognition language and the meaning content of the recognition language. The determination result of whether or not there is a selection candidate is output to the control operation determination unit 26, and the determination result in the control operation determination unit 26 is acquired. Then, from a plurality of dialogue data such as character data and voice data stored in advance in the dialogue data storage unit 25, appropriate dialogue data according to the meaning contents grasped by the analysis unit 22 or the control action determination unit 26 Appropriate dialogue data corresponding to the determination result is retrieved and output to the output device 12.

The control operation determination unit 26 responds to the analysis result input from the dialogue control unit 24, that is, the determination result of whether or not there are a plurality of different selection candidates as the control operation of the control device 14 according to the meaning content of the recognition language. When the determination result is “NO”, that is, when there is only a single control operation for the analysis result, a command signal for causing the control device 14 to execute this control operation is sent to the device control unit 30. Output to.
On the other hand, when the determination result is “YES”, that is, when there are a plurality of control operations for the analysis result, first, the plurality of control operations are stored in advance in the related information storage unit 27. Related information (for example, information on the degree of association between control operations of a plurality of control devices 14) and operation history information stored in the operation history storage unit 28 (for example, voice input or direct operation of the operator in the past) Control information of the control device 14 operated in the past or control information of the control device 14 operated in the past in the past based on the history information of control operation of the control device 14 selected by the control operation determination unit 26 in the past). A control action related to the action (previous operation) is extracted. Then, the control operation having the highest degree of relevance with respect to the previous operation is selected from the extracted control operations, and a command signal for causing the control device 14 to execute this control operation is output to the device control unit 30.
Then, the device control unit 30 controls the control device 14 according to the command signal input from the control operation determination unit 26.

In the related information storage unit 27, information on the degree of association between the control operations of the plurality of control devices 14 is stored as related information. The degree-of-association information stored in the relation information storage unit 27 in advance is, for example, the degree of association between control operations whose execution timings are adjacent on a time series, for example, statistical data or the interface of each control device 14 If the relevance level of the control operations of the plurality of control devices 14 is set for each control operation of the appropriate single control device 14, the sum of the relevance levels is a predetermined value ( For example, it is set to be equal to 1).
Further, in the operation history storage unit 28, information related to the execution of the control operation of the control device 14 according to the operation of the operator detected by the device operation detection unit 29 and the control operation determination unit 26 have selected. Information related to the control operation of the control device 14 is stored as time series data. The information stored in the operation history storage unit 28 is initialized, for example, when the vehicle is started, and is set to a state without a previous operation.

The voice recognition type device control apparatus 10 according to the present embodiment has the above-described configuration. Next, the operation of the voice recognition type device control apparatus 10 will be described with reference to the accompanying drawings.
First, for example, in step S01 shown in FIG. 2, the voice input input from the operator via the voice input device 11 is acquired.
Next, in step S02, a speech recognition process is executed on the acquired speech input to generate a recognition language that is character data corresponding to the speech input.
Next, in step S03, the generated recognition language is analyzed, and information necessary for grasping the semantic content of the recognition language, for example, operation information related to the control operation of the control device 14 is extracted.
Next, in step S04, for example, dialogue data corresponding to the analysis result of the recognition language is output from the output device 12, and correspondence information corresponding to the analysis result (for example, extracted from the control operation of the control device 14 and the recognition language). Information related to the corresponding operation information) is searched in the correspondence information storage unit 23.

In step S05, it is determined whether or not correspondence information exists.
When the determination result is “NO”, that is, when there is no information on the control operation of the control device 14 corresponding to the meaning content of the acquired voice input, for example, dialogue data that prompts re-input of voice input is output to the output device 12. To end the series of processing.
On the other hand, if the determination result is “YES”, that is, if there is information on the control operation of the control device 14 corresponding to the meaning content of the acquired voice input, the process proceeds to step S06.
In step S06, it is determined whether or not there are a plurality of different selection candidates as information on the control operation of the control device 14 corresponding to the semantic content of the acquired voice input.
If the determination result in step S06 is “NO”, that is, if only information on a single control operation exists as a selection candidate, the process proceeds to step S09 described later.
On the other hand, if the determination result in step S06 is “YES”, that is, if there is information on a plurality of control operations as selection candidates, the process proceeds to step S07. For example, when the voice input is “much higher”, the control operation information of the control device 14 corresponding to the meaning content of the voice input includes the control operation for raising the vehicle interior temperature by the air conditioner, and the acoustic device. There are a plurality of different selection candidates for the control operation for increasing the volume and the control operation for the scroll operation on the display screen of the navigation device.

In step S07, the operation history information of the control device 14 (for example, control operation history information of the control device 14 operated by the operator in the past) is acquired from the operation history storage unit 28.
In step S08, a plurality of control operations to be selected from the related information stored in the related information storage unit 27 in advance (for example, information on the degree of association between the control operations of the plurality of control devices 14). The control information of the control device 14 operated by the operator in the latest past is selected from the plurality of control operation information based on the related information and the operation history information obtained by searching the related information related to the information. A control action related to the action is extracted. Then, among the extracted control actions, the control action having the highest degree of relevance with respect to the control actions of the control device 14 operated by the operator in the latest past is selected. Then, the dialogue data corresponding to the selected control operation is output from the output device 12.
In step S09, a relevance level changing process described later is executed.

In step S10, it is determined whether or not a voice input (cancel input) intended to cancel execution of the control operation selected in step S08 is input.
If the determination result is “YES”, for example, dialogue data that prompts re-input of voice input is output from the output device 12, and the series of processing ends.
On the other hand, if this determination is “NO”, the flow proceeds to step S11.
In step S11, the control device 14 is controlled in accordance with the selected control operation information, and the series of processing ends.

Below, the relevance level change process in step S09 mentioned above is demonstrated.
First, for example, in step S21 shown in FIG. 3, it is determined whether or not the elapsed time from the previous operation is within a predetermined time (for example, 30 seconds).
When the determination result is “NO”, the series of processes is terminated.
On the other hand, if this determination is “YES”, the flow proceeds to step S22.
In step S21, for example, when there is no previous operation at the time of starting the vehicle, the process proceeds to step S22.
In step S22, the degree of association between the single control operation corresponding to the meaning content of the acquired voice input or the control operation selected in step S08 described above and the previous operation is changed to the increasing side.
Next, in step S23, a single control operation corresponding to the meaning content of the acquired voice input or a voice input (cancel input) intended to cancel execution of the control operation selected in step S08 described above is input. It is determined whether or not it has been done.
When the determination result is “NO”, the series of processes is terminated.
On the other hand, if this determination is “YES”, the flow proceeds to step S24.
In step S24, the relevance level changing process is canceled, the relevance level is returned to the value before the change, and the series of processes is terminated.

In the related information stored in the related information storage unit 27, as a control operation of each of the plurality of control devices 14, as shown in FIGS. 4 and 5, for example, a control operation for the navigation device and a communication device such as a portable terminal Control operations related to the acquisition of traffic information via a broadcast receiver, control operations for an air conditioner, control operations for an acoustic device, and acquisition of weather information via a communication device such as a mobile terminal or a broadcast receiver Control action is set. And between each control operation | movement, the transition probability of the bidirectional | two-way or predetermined one direction with respect to the case where it performs continuously is set as a relevance degree between each control operation | movement. In addition, when the vehicle is started, the information stored in the operation history storage unit 28 is initialized and executed continuously from the state without the previous operation in response to being set to the state without the previous operation. A one-way transition probability is set for each control operation.
For example, as shown in FIG. 4, as each control operation that is continuously executed from the state without the previous operation, the degree of association a1 (for example, a1 = 0.5) is set in the control operation for the navigation device, and the traffic information The relevance degree a2 (for example, a2 = 0.2) is set for the control operation related to the acquisition, and the relevance degree a3 (for example, a3 = 0.15) is set for the control operation for the air conditioner. A relevance level a4 (for example, a4 = 0.1) is set for the control operation, and a relevance level a5 (for example, a5 = 0.05) is set for the control operation related to acquisition of weather information.

For example, the first voice input after the driver gets into the vehicle at the start of the vehicle
(A1) “Kashiwacho, Chiyoda-ku, Tokyo”
In this case, the control operation information of the control device 14 corresponding to the meaning content of the voice input includes, for example, a plurality of control operations related to route setting of the navigation device and control operations related to acquisition of weather information. Different selection candidates are searched based on the correspondence information in the correspondence information storage unit 23. Then, related information related to information on a plurality of control operations that are selection candidates is retrieved from the related information stored in the related information storage unit 27.
Here, the relevance level a1 (for example, a1 = 0.5) of the control operation for the navigation device with respect to the state without the previous operation is the relevance level a5 (for example, a5 = 0) of the control operation related to the acquisition of the weather information. .05) is determined based on the related information in the related information storage unit 27, and execution of the control operation related to the route setting of the navigation device is selected.
Then, dialogue data in response to the voice input is retrieved from the dialogue data storage unit 25, for example,
(A2) "Do you want to set Kojimachi, Chiyoda-ku, Tokyo as your destination?"
Is output from the output device 12.

In response to this output, a voice input (cancel input) intended to cancel execution of the control action selected by the control action determination unit 26 is not input from the operator. For example, a voice input is output from the output device 12. As a response to a query for
(A3) “OK”
If it is, the process of changing the related information in the related information storage unit 27, that is, the selected control operation (for example, the control operation for the navigation device shown in FIG. 4) and the previous operation (for example, the state without the previous operation shown in FIG. 4). Is performed to change the degree of association (for example, degree of association a1 = 0.5 shown in FIG. 4) to the increase side.
As a result, for example, as shown in Table 1 below, in the related information at this time, the relevance level a1 of the control operation for the navigation device, which is the next operation when the previous operation is in the state without the previous operation, is a predetermined magnification r ( For example, it increases by r = 1.05), and the degree of association a2,..., A5 with respect to other control operations decreases accordingly.

Then, the dialogue data for inquiring about the control operation related to the route search of the navigation device is retrieved from the dialogue data storage unit 25, for example,
(A4) "Do you use expressways?"
Is output from the output device 12.
In response to this output, a voice input (cancel input) intended to cancel the control action selected by the control action determination unit 26, that is, the control action related to the route search of the navigation device is not input by the operator. The input is
(A5) “No, not use”
If the control operation of the control device 14 corresponding to the meaning content of the voice input is the control operation related to the route setting of the navigation device is a single selection candidate, It is determined based on correspondence information.
Then, dialogue data for confirming execution of the route search of the navigation device is retrieved from the dialogue data storage unit 25, for example,
(A6) “We will guide you to the shortest route to Kojimachi, Chiyoda-ku, Tokyo”
Is output from the output device 12.

Then, the process of changing the related information in the related information storage unit 27, that is, the relationship between the selected control operation (for example, the control operation for the navigation device shown in FIG. 5) and the previous operation (for example, the control operation for the navigation device shown in FIG. 5). A process of changing the degree (for example, the degree of association b1 = 0.5 shown in FIG. 5) to the increasing side is executed.
For example, as shown in FIG. 5, as each control operation continuously executed from an appropriate control operation for the navigation device, the relevance b1 (for example, b1 = 0.6) is applied to other control operations for the navigation device. Is set, relevance b2 (for example, b2 = 0.22) is set for the control operation related to the acquisition of traffic information, and relevance b3 (for example, b3 = 0.06) is set for the control operation for the air conditioner. The degree of relevance b4 (for example, b4 = 0.06) is set for the control operation for the sound device, and the degree of relevance b5 (for example, b5 = 0.06) is set for the control operation related to acquisition of weather information. Has been.
Accordingly, as shown in Table 2 below, for example, in the related information at this time, the relevance b1 of the control operation for the navigation device, which is the next operation when the previous operation is a control operation for the navigation device, is a predetermined magnification r ( For example, it increases by r = 1.05), and accordingly, the relevance b2,..., B5 with respect to other control operations decreases.

Next, for example, voice input
(A7) "How many times is Tokyo now?"
If the control action of the control device 14 corresponding to the meaning content of the voice input is a single selection candidate, the correspondence information storage 23 corresponds to the control action related to the acquisition of the weather information. Determined based on information.
And weather information is acquired via communication apparatuses, such as a portable terminal, and a broadcast receiving apparatus, and the dialog data which alert | reports weather information are searched from the dialog data storage part 25, for example,
(A8) “Current temperature is 18 degrees”
Is output from the output device 12.

And the process which changes the relevant information of the relevant-information memory | storage part 27, ie, selected control action (For example, control action concerning acquisition of the weather information shown in FIG. 5), and previous operation (For example, control action with respect to the navigation apparatus shown in FIG. 5) Is performed to change the degree of association (for example, degree of association b3 = 0.06 shown in FIG. 5) to the increasing side.
Thereby, as shown in the following Table 3, for example, in the related information at this time, the relevance b5 of the control operation related to acquisition of weather information which is the next operation when the previous operation is a control operation for the navigation device is predetermined. The magnification r increases (for example, r = 1.05), and accordingly, the relevances b1,..., B4 with respect to other control operations decrease.

Also, for example, the first voice input after the driver gets on the vehicle at the time of starting the vehicle,
(B1) “Guide to Tokyo Station”
If the control operation of the control device 14 corresponding to the meaning content of the voice input is the control operation related to the route setting of the navigation device is a single selection candidate, It is determined based on correspondence information.
Then, dialogue data for confirming execution of the route search of the navigation device is retrieved from the dialogue data storage unit 25, for example,
(B2) “Yes, I will guide you to Tokyo Station”
Is output from the output device 12.

Then, the process of changing the related information in the related information storage unit 27, that is, the relationship between the selected control operation (for example, the control operation for the navigation device shown in FIG. 4) and the previous operation (for example, the state without the previous operation shown in FIG. 4). A process of changing the degree (for example, the degree of association a1 = 0.5 shown in FIG. 4) to the increasing side is executed.
As a result, for example, as shown in Table 1 above, in the related information at this time, the relevance level a1 of the control operation for the navigation device that is the next operation when the previous operation is in the state without the previous operation is the predetermined magnification r ( For example, it increases by r = 1.05), and the degree of association a2,..., A5 with respect to other control operations decreases accordingly.

Next, for example, voice input
(B3) “Is it hot here?”
In this case, the control operation information of the control device 14 corresponding to the meaning content of the voice input includes, for example, a plurality of different selection candidates for the control operation for the air conditioner and the control operation for acquiring weather information. Search is performed based on the correspondence information in the correspondence information storage unit 23. Then, related information related to information on a plurality of control operations that are selection candidates is retrieved from the related information stored in the related information storage unit 27.
Here, for example, as shown in FIG. 5, when the previous operation is a control operation for the navigation device, the relevance b3 (for example, b3 = 0.06) of the control operation for the air conditioner and the acquisition of weather information It is determined that the relevance degree b5 (for example, b5 = 0.06) of the control operation related to the control operation has an equivalent value based on the related information in the related information storage unit 27. Selected.

Then, dialogue data in response to the voice input is retrieved from the dialogue data storage unit 25, for example,
(B4) “Reduce the set temperature”
Is output from the output device 12.
Then, the process of changing the related information in the related information storage unit 27, that is, the relationship between the selected control operation (for example, the control operation for the air conditioner shown in FIG. 5) and the previous operation (for example, the control operation for the navigation device shown in FIG. 5). A process of changing the degree (for example, the degree of association b3 = 0.06 shown in FIG. 5) to the increasing side is executed.
As a result, for example, as shown in Table 4 below, in the related information at this time, the relevance b3 of the control operation for the air conditioner, which is the next operation when the previous operation is a control operation for the navigation device, is a predetermined magnification r ( For example, it increases by r = 1.05), and accordingly, the relevance a1, a2, a4, a5 with respect to other control operations decreases.

Then, as a voice input (cancellation input) intended to cancel the execution of the control operation selected by the control operation determination unit 26 in response to the response output from the output device 12, for example,
(B5) “No. Tokyo is hot?”
Is input from the operator, processing that has already been executed to change the related information in the related information storage unit 27, that is, the selected control operation (for example, the control operation for the air conditioner shown in FIG. 5) and the previous operation (for example, FIG. 5). The process of changing the relevance level (for example, the relevance level b3 = 0.06 shown in FIG. 5) to the increase side is canceled.
As a result, for example, as shown in Table 5 below, in the related information at this time, the relevance levels b1,..., B5 of each control operation, which is the next operation when the previous operation is a control operation for the navigation device, are The value before execution of the change process is restored.

Then, as information on the control operation of the control device 14 corresponding to the meaning content of the voice input by the operator, the correspondence information in the correspondence information storage unit 23 indicates that the control operation related to acquisition of weather information is a single selection candidate. It is determined based on.
And weather information is acquired via communication apparatuses, such as a portable terminal, and a broadcast receiving apparatus, and the dialog data which alert | reports weather information are searched from the dialog data storage part 25, for example,
(B6) “I'm sorry. The expected temperature in Tokyo is 23 degrees.”
Is output from the output device 12.

As described above, according to the voice recognition type device control apparatus 10 according to the present embodiment, information related to the correspondence between the control operation of the control device 14 and the operation information extracted from the recognition language by the analysis unit 22 in advance. Is stored in the correspondence information storage unit 23 as correspondence information, and further, information on the degree of association between the control operations of each of the plurality of control devices 14 is stored in the related information storage unit 27 as the relevant information. Since the control device 14 is controlled on the basis of the analysis result for the vehicle and the related information retrieved from the related information storage unit 27 according to the analysis result, for example, the running state of the vehicle, the load state of the driving operation, or the voice recognition type device. Even if the meaning content of the voice input by the operator is ambiguous due to the level of proficiency with respect to the operation of the control device 10 or the like, the control operation of the appropriate control device 14 according to the will of the operator It can be selected. That is, even if it is difficult to specify a single control action from a plurality of selection candidates by simply referring to an analysis result for voice input, an operation history of the control device 14 by an operator, and the like, By selecting the control operation according to the information on the degree of association between the control operations of each of the control devices 14, it is possible to suppress the selection against the will of the operator.
In addition, since the related information stored in the related information storage unit 27 is updated according to the operator's response to the selected control operation, a plurality of different control operations of the control device 14 are performed on the analysis result of the voice input. Even when there is a selection candidate, it is possible to accurately reflect the will of the operator in the selection of the control action.

  In the above-described embodiment, when there are a plurality of different selection candidates as the control operation of the control device 14 with respect to the analysis result of the voice input in the analysis unit 22, the operation was performed by the operator in the latest past. Although the control operation related to the control operation (previous operation) of the control device 14 is extracted, the present invention is not limited to this. For example, the control operation related to the past operation over a predetermined number of times (for example, 2 to 3 times). May be extracted. In this case, the reliability with respect to selection of the control operation can be improved.

In the above-described embodiment, as shown in steps S21 to S24, when a single control operation corresponding to the semantic content of the acquired voice input is searched based on the correspondence information, or by the operator When a single control action is selected from a plurality of selection candidates based on past operation history, correspondence information, and association degree information, first, the degree of association between the selected control action and the previous operation is increased. And, when there is a cancel input, the change processing of the relevance level is canceled. However, the present invention is not limited to this. For example, as in the first modified example shown in FIG. The degree change process may be executed.
That is, in the first modification, first, in step S21 shown in FIG. 6, it is determined whether or not the elapsed time from the previous operation is within a predetermined time.
When the determination result is “NO”, the series of processes is terminated.
On the other hand, if the determination is “YES”, the flow proceeds to step S31.
Next, in step S31, a single control operation corresponding to the meaning content of the acquired voice input or a voice input (cancel input) intended to cancel execution of the control operation selected in step S08 described above is input. It is determined whether or not it has been done.
If the determination result is “YES”, the series of processes is terminated.
On the other hand, if this determination is “NO”, the flow proceeds to step S 32.
In step S32, the relevance between the single control operation corresponding to the meaning content of the acquired voice input or the control operation selected in step S08 described above and the previous operation is changed to the increasing side, The process ends.

Further, for example, as in the second modified example illustrated in FIG. 7, the degree of association may be changed to a decreasing side when there is a cancel input.
That is, in this second modification, first, in step S21 shown in FIG. 7, it is determined whether or not the elapsed time from the previous operation is within a predetermined time.
When the determination result is “NO”, the series of processes is terminated.
On the other hand, if the determination is “YES”, the flow proceeds to step S31.
Next, in step S31, a single control operation corresponding to the meaning content of the acquired voice input or a voice input (cancel input) intended to cancel execution of the control operation selected in step S08 described above is input. It is determined whether or not it has been done.
If this determination is “NO”, the flow proceeds to step S32.
On the other hand, if the determination is “YES”, the flow proceeds to step S33.
In step S32, the relevance between the single control operation corresponding to the meaning content of the acquired voice input or the control operation selected in step S08 described above and the previous operation is changed to the increasing side, The process ends.
In step S33, the relevance between the single control operation corresponding to the meaning content of the acquired voice input or the control operation selected in step S08 described above and the previous operation is changed to the decreasing side, and a series of steps is performed. The process ends.

Further, in the above-described embodiment, as shown in steps S06 to S09, the relevance degree changing process is performed when a single control operation corresponding to the semantic content of the acquired voice input is retrieved based on the correspondence information. However, the present invention is not limited to this. For example, when only a single control operation is searched as in the third modification shown in FIG. May be.
That is, in the third modification, in step S06, it is determined whether or not there are a plurality of different selection candidates as information on the control operation of the control device 14 corresponding to the meaning content of the acquired voice input.
If the determination result is “YES”, that is, if there is information on a plurality of control actions as selection candidates, the process proceeds to step S07.
On the other hand, when the determination result is “NO”, that is, when only information on a single control operation exists as a selection candidate, the process proceeds to step S10.

It is a block diagram of the speech recognition type | mold apparatus control apparatus which concerns on embodiment of this invention. It is a flowchart which shows operation | movement of the speech recognition type | mold apparatus control apparatus shown in FIG. It is a flowchart which shows the relevance degree change process shown in FIG. It is a figure which shows an example of the relevance degree of each control action performed continuously from the state without previous operation. It is a figure which shows an example of the relevance degree of each control action performed continuously from the appropriate control action with respect to a navigation apparatus. It is a flowchart which shows the relevance degree change process which concerns on the 1st modification of embodiment of this invention. It is a flowchart which shows the relevance degree change process which concerns on the 2nd modification of embodiment of this invention. It is a flowchart which shows operation | movement of the speech recognition type | mold apparatus control apparatus which concerns on the 3rd modification of embodiment of this invention.

Explanation of symbols

10 voice recognition type device control device 11 voice input device (voice input means)
14 control equipment 21 voice recognition part (voice recognition part)
22 Analysis unit (voice recognition unit)
23 Corresponding information storage unit 24 Dialogue control unit 25 Dialogue data storage unit 26 Control action determination part (operation state acquisition means, control action setting means, relevance degree change means)
27 Related Information Storage Unit (Relevance Degree Storage Unit)
28 Operation history storage unit 29 Device operation detection unit (operation state acquisition means)
30 Device control unit (control means)

Claims (5)

Voice input means for inputting voice;
Voice recognition means for recognizing the voice input by the voice input means;
Relevance storage means for storing relevance between control operations of devices whose execution timings are adjacent on a time series;
An operation state acquisition means for acquiring information on the operation state of the device;
Control action setting means for setting the control action of the device according to the recognition result by the voice recognition means as an execution target based on the relevance related to the action state of the device acquired by the action state acquisition means;
A voice recognition type device control apparatus comprising: control means for controlling a device in accordance with the control operation of the device set by the control operation setting means. The speech recognition type device control apparatus according to claim 1, wherein the relevance level storage unit stores a relevance level between an appropriate device control operation and a plurality of device control operations. The apparatus according to claim 1 or 2, wherein the operation state acquisition unit acquires information on an operation state of the device based on a history of control operations of the device set by an operator or the control operation setting unit. The voice recognition type apparatus control device described. The relevance degree changing means for changing the relevance degree stored in the relevance degree storage means based on a history of control operations of the device set by an operator or the control action setting means. The voice recognition type apparatus control device according to claim 3. The degree-of-association changing means stores in the degree-of-association storage means based only on the history of control operations of devices adjacent to each other within a predetermined time interval in the time series among the history of control operations of the device. 5. The voice recognition type apparatus control device according to claim 4, wherein the degree of association is changed.

Images