JP4503310B2 - Electronic equipment control device - Google Patents

Description

  The present invention relates to an electronic device control apparatus that controls an electronic device by voice.

  2. Description of the Related Art Conventionally, some control devices that control electronic devices improve operability by changing an operation amount according to a difference in expression contents in quantitative control by voice recognition. Specifically, words of different expressions corresponding to different amounts of operation are registered in the recognition target vocabulary database, and the words are extracted from the speech input by the microphone by pattern matching with the recognition target vocabulary database. recognize. Then, control is performed with different operation amounts depending on which expression is recognized (for example, see Patent Document 1).

On the other hand, some electronic devices are voice-controlled using respective keywords for device identification, device control, and termination for the purpose of performing voice control of devices easily and quickly without causing malfunction. In this device, a keyword storage unit that stores keywords for device identification, device control, and termination, a voice input unit that captures a user's voice, a keyword that is extracted and stored in the keyword storage unit, The speech recognition unit includes a speech recognition unit for collation and a device control unit that controls each electronic device based on the keyword recognized by the speech recognition unit. Upon recognition, the electronic device is controlled based on the input device control keyword until a keyword for ending the specified electronic device or a keyword for specifying the device specifying another electronic device is recognized (for example, , See Patent Document 2).
Japanese Patent Laid-Open No. 11-242497 JP 2002-169484 A

By the way, in the apparatus described in Patent Document 1, it is possible to perform control with different operation amounts according to the recognized words / phrases by recognizing the difference in the operation amounts from the inputted word / phrase differences. When attempting to control an electronic device at a time, there is a problem in that an electronic device to be operated must be specified every time an operation is performed.
On the other hand, in the apparatus described in Patent Document 2, although an electronic device to be operated can be recognized using a keyword for specifying, the specified electronic device is used even when an operation keyword common to a plurality of electronic devices is input. It was only possible to execute control of the electronic device, and it was impossible to control other electronic devices on an as-needed basis while executing control of one electronic device.

  The present invention has been made in view of the above problems, and when an operation keyword common to a plurality of electronic devices is input, an electronic device that identifies and controls an optimal electronic device from the plurality of electronic devices An object is to provide a control device.

In order to solve the above-described problem, an electronic device control device according to the invention of claim 1 uses a voice recognition means (for example, a later-described embodiment of the embodiment described later) as a voice input means (for example, a microphone 2 of a later-described embodiment). In the electronic device control apparatus that recognizes a voice by the voice recognition unit 3) and controls a plurality of electronic devices (for example, an air conditioner ECU 51, an audio ECU 52, a navigation ECU 53, a wiper ECU 54, a window ECU 55, etc. in an embodiment described later) by the voice. Keyword storage for storing a category keyword for specifying control target items for a plurality of electronic devices, an operation keyword corresponding to the operation control amount of the control target item, and a determination keyword for determining the operation control amount of the control target item Means (for example, a category / operation keyword correspondence table in the embodiment described later And Le 11), compares a keyword included in the recognition word recognized in the voice recognition unit and storage contents of the keyword storage means, sets a score for each of the control target items, depending on the value of the score electronic device control target item to be operated, and the speech recognition result analyzing means for determining the operation content based on the operation keyword (e.g. speech recognition result of embodiment described later analysis unit 4), determined by the voice recognition result analyzing means with the run for equipment control means controlling said electronic equipment operation content and (e.g. apparatus control unit 5 of the embodiment described later), the speech recognition result analyzing means recognizes words that are recognized in the voice recognition unit When the determination keyword is present in the list, the score value of the control target item of the control content executed immediately before is set as an initial value .

  The electronic device control device having the above configuration includes a category keyword for specifying control target items for a plurality of electronic devices in advance, an operation keyword corresponding to the operation control amount of the control target item, and operation control of the control target item. The determination keyword for determining the amount is stored in the keyword storage means, and the score setting means determines whether the keyword included in the recognized word recognized by the speech recognition means is in the keyword storage means, The stored contents of the keyword storage means are compared. At this time, the score setting means sets a score for each control target item corresponding to the keyword, and sets the score value for each control target item in accordance with whether or not the input keyword is in the keyword storage means. Since the operation order based on this is set, the device control means can execute control based on the operation keyword on the electronic device specified from the set operation order.

According to the electronic device control device according to claim 1, the operation order is set for each control target item from the score value set corresponding to the keyword included in the input voice, and the electronic order is determined from the operation order. Control can be executed by identifying the device.
Therefore, even when an operation keyword common to a plurality of electronic devices is input and it is not clear which electronic device is an operation target, an electronic device control that performs control by specifying an optimal electronic device from a plurality of electronic devices The effect that the apparatus can be realized is obtained.

  Embodiments of the present invention will be described below with reference to the drawings.

(Device configuration)
FIG. 1 is a block diagram showing a configuration of an electronic device control apparatus according to an embodiment of the present invention.
In FIG. 1, in the storage area 1 of the electronic device control apparatus of the present embodiment, a category keyword for specifying control target items (categories) in a plurality of electronic devices to be operated in advance, and an operation control amount of the control target item. It is assumed that a category / operation keyword correspondence table 11 for storing the quantity operation keyword corresponding to the item and the quantity determination keyword for determining the operation control amount of the control target item is provided.

In addition, the electronic device control apparatus according to the present embodiment includes a microphone 2 for inputting a user's voice, and the voice recognition unit 3 performs voice recognition on the user's voice input from the microphone 2. Is converted into a recognized word.
The converted recognition word is input to the speech recognition result analysis unit 4, and the speech recognition result analysis unit 4 analyzes which keyword stored in the category / operation keyword correspondence table 11 is input. The speech recognition result analysis unit 4 sets a category score value for each control target item of a plurality of electronic devices corresponding to the keyword based on the analyzed keyword content, and is provided in the storage area 1. Store in the score storage area 12.

The voice recognition result analysis unit 4 once confirms whether or not the category keyword, the quantity operation keyword, and the quantity determination keyword are input, and is based on the electronic device to be operated, the control target item, and the quantity operation keyword. The operation content is determined, and the operation content based on the electronic device to be operated, the control target item, and the quantity operation keyword is instructed to the device control unit 5 that controls a plurality of electronic devices.
The voice recognition result analysis unit 4 stores the control target item instructed to the device control unit 5 and the operation content based on the quantity operation keyword in the history storage area 13 provided in the storage area 1 and is input. Depending on the contents of the keyword, the past history is stored so that at least the previous control can be restored.

  On the other hand, the device control unit 5 is a processing unit that specifically executes control instructed by the speech recognition result analysis unit 4, and is a control unit unique to each electronic device provided in the electronic device to be operated. An ECU (Electronic Control Unit) is connected. Specifically, the electronic device control apparatus of this embodiment is particularly useful when mounted on a vehicle such as an automobile. As an example, when the electronic apparatus control device is mounted on an automobile, The plurality of operation target electronic devices corresponding to the keywords stored in the operation keyword correspondence table 11 include, for example, an air conditioner (hereinafter referred to as an air conditioner) that is a vehicle auxiliary device mounted on a vehicle, an audio device, and navigation. Equipment, wipers, power windows, etc. are included. Therefore, the device control unit 5 is provided in each of the above-described electronic devices, and also executes an air conditioner ECU 51, an audio ECU 52, a navigation ECU 53, and a wiper that execute control specific to each electronic device based on a control instruction from the device control unit 5. ECUs such as the ECU 54 and the window ECU 55 are connected.

  The device control unit 5 is connected to a control result output unit 6 that displays a control result on a speaker 61, a display 62, a meter panel 63, and the like. The control result output unit 6 is output from the speaker 61, for example, an electronic voice by voice synthesis processing, or an electronic sound, a display by a picture, a character, or a character on the display 62, an LED or a display lamp on the meter panel 63, for example. The control result of each electronic device is displayed to the user by display or the like.

  The storage area 1 is a volatile memory such as a hard disk device, a magneto-optical disk device, a nonvolatile memory such as a flash memory, a recording medium such as a CD-ROM that can only be read, or a RAM (Random Access Memory). It is assumed that the recording medium is configured by a memory or a computer-readable / writable recording medium.

  Further, the voice recognition unit 3, the voice recognition result analysis unit 4, the device control unit 5, and the control result output unit 6 may be realized by dedicated hardware. It is also possible to realize the functions by loading a program for realizing the functions of the above-described units into a memory and executing the programs.

(Recognition keyword)
Next, an example of the category keyword, quantity operation keyword, and quantity determination keyword for a plurality of operation target electronic devices stored in the category / operation keyword correspondence table 11 will be described. Table 1 below is a table showing examples of category keywords, quantity operation keywords, and quantity determination keywords. In Table 1, for example, a plurality of electronic devices to be operated are navigation devices, audio devices, air conditioners, and power windows, and control target items are “map scale” of navigation devices, “volume” of audio devices, and “temperature” of air conditioners. ”, In the case of“ window opening / closing ”of the power window, a category keyword for specifying the control target item set for each control target item, an amount operation keyword corresponding to the operation control amount of the control target item, In addition, an example of an amount determination keyword for determining the operation control amount of the control target item is shown.

  The setting of the control target item for the electronic device described above is an example, and the correspondence between the electronic device and the control target item is not necessarily limited to one-to-one. For example, for the audio device that is an electronic device. A plurality of control target items may be set for one electronic device so that the control target item has “sound quality” in addition to “volume”.

  Further, as shown in Table 1, in order to specify the control target item, the category keyword stores a characteristic phrase for each of the control target items of the plurality of operation target electronic devices. In addition, there are words / phrases characteristic of the control target item, and words / phrases relating to an abstractly expressed quantity such as “more” are also stored. In addition, the quantity determination keyword stores a similar phrase indicating the intention to end the user's operation for any control target item.

(Overall processing)
Next, the overall processing of the electronic device control apparatus of this embodiment will be described with reference to the drawings. FIG. 2 is a flowchart showing the overall processing operation of the electronic device control apparatus of this embodiment.
In FIG. 2, the voice recognition unit 3 first converts the voice input from the microphone 2 into a recognized word by voice recognition (step S1).
Next, the speech recognition result analysis unit 4 analyzes the recognition result for analyzing which keyword stored in the category / operation keyword correspondence table 11 is input for the recognized word recognized by the speech recognition unit 3. (Step S2).

  The speech recognition result analysis unit 4 sets a category score value for each control target item of a plurality of electronic devices corresponding to the keyword based on the analyzed keyword content, and is provided in the storage area 1. The electronic device and the control target item to be operated on the basis of the category score value when the presence / absence of the input of the category keyword, the quantity operation keyword, and the quantity determination keyword is once confirmed while being stored in the score storage area 12 And the operating device determination which determines the operation content based on quantity operation keyword is performed (step S3). Details of the operation device determination process will be described later.

  In addition, if the electronic device to be operated, the control target item, and the operation content based on the quantity operation keyword can be determined, the electronic devices such as the air conditioner, the audio device, the navigation device, the wiper, and the power window specified as the operation target are determined. For the air conditioner ECU 51, audio ECU 52, navigation ECU 53, wiper ECU 54, window ECU 55, and other ECUs provided in the device, the device control unit 5 uses the control target items and quantity operation keywords determined by the speech recognition result analysis unit 4. The device control is specifically executed with the operation content based on the control result, and the control result of each electronic device is displayed to the user via the control result output unit 6 (step S4).

(Operating equipment judgment processing)
Next, the operation device determination process of the electronic device control apparatus according to the present embodiment will be described with reference to the drawings. FIG. 3 is a flowchart showing the operation device determination processing operation of the electronic device control apparatus according to the present embodiment.
In FIG. 3, first, the speech recognition result analysis unit 4 stores the keywords included in the recognized words recognized and input by the speech recognition unit 3 in the category / operation keyword correspondence table 11 shown in Table 1 above. It is determined whether there is an amount determination keyword (whether it is included) (step S11).
In step S11, when there is no quantity determination keyword in the input keyword (NO in step S11), the speech recognition result analysis unit 4 similarly has a category keyword stored in the category / operation keyword correspondence table 11. It is determined whether or not (included) (step S12).

Furthermore, when there is no category keyword in the input keyword in step S12 (NO in step S12), the speech recognition result analysis unit 4 similarly stores the quantity operation keyword stored in the category / operation keyword correspondence table 11. It is determined whether or not there is (included or not) (step S13).
In step S12, if the input keyword includes a category keyword (YES in step S12), the speech recognition result analysis unit 4 determines whether the category keyword has been rephrased (step S14). .

  If the paraphrase of the category keyword is not performed in step S14 (NO in step S14), the speech recognition result analysis unit 4 uses the category score value of the control target item selected based on the input category keyword. The maximum value (for example, 10) is set (step S15), and the process proceeds to step S13 to determine whether or not there is an amount operation keyword stored in the category / operation keyword correspondence table 11 (whether or not included) ( Step S13).

  In step S13, when there is a quantity operation keyword in the input keyword (YES in step S13), the speech recognition result analysis unit 4 refers to the score storage area 12, and the category score value is “1” or more. And the number N of control target items having the largest category score value is counted, whether the number N is only 1 (N = 1?), More than 1 (N> 1?), Or 0? (N = 0?) Is determined (step S16).

  If it is determined in step S16 that the category score value is “1” or more and the number N of control target items having the largest category score value is only one (step S16: N = 1), that is, the operation has been performed from the past. When there is only one control target item that follows, the speech recognition result analysis unit 4 identifies an electronic device corresponding to the control target item having the largest category score value, and the device control unit 5 The operation content is instructed based on the control target item for which the device is the operation target and the quantity operation keyword (step S17).

On the other hand, when the category score value is “1” or more and the number N of control target items having the largest category score value is greater than one in step S16 (step S16: N> 1), that is, the operation has been performed from the past. When there are a plurality of control target items that continue, the speech recognition result analysis unit 4 desires which control target item the electronic recognition result analysis unit 4 uses, for example, electronic speech by speech synthesis processing output from the speaker 61. Or, the user is inquired to input a desired control target item (step S18).
Then, the process proceeds to step S17, where the speech recognition result analysis unit 4 identifies the electronic device having the largest category score value and corresponding to the control target item selected by the user, and the device control unit 5 An operation content is instructed based on the control target item for which the electronic device is to be operated and the quantity operation keyword (step S17).

Furthermore, in step S16, when the category score value is “1” or more and the number N of control target items having the largest category score value is 0 (step S16: N = 0), that is, the operation continues from the past. If there is no control target item and the command is completely new, the speech recognition result analysis unit 4 counts the number M of control target items including the input quantity operation keyword, and whether the number M is one (M = 1?) Or not one (M ≠ 1?) (Step S19).
If, in step S19, the number M of control target items including the input quantity operation keyword is 1 (step S19: M = 1), the speech recognition result analysis unit 4 sets the input quantity operation keyword as the input quantity operation keyword. The category score value of the control target item selected on the basis is set to the maximum value (for example, 10) (step S20).

In step S19, when the number M of control target items including the input quantity operation keyword is not one (step S19: M ≠ 1), the speech recognition result analysis unit 4 outputs, for example, from the speaker 61. The user is inquired about which control target item is desired by electronic voice by voice synthesis processing, and the desired control target item is input (step S21). Since the operation has not been continued from the past, The user is inquired and inputted how to manipulate the operation amount (step S22).
Then, the process proceeds to step S20, and the voice recognition result analysis unit 4 sets the category score value of the control target item selected by the user to the maximum value (for example, 10) based on the input quantity operation keyword (step 10). S20).

In addition, in the above-described step S14, when the paraphrase of the category keyword is performed (YES in step S14), the speech recognition result analysis unit 4 controls the control target item that has given the operation instruction stored in the history storage area 13, And based on the history of the operation content based on the quantity operation keyword, the previous quantity operation keyword is acquired, and an instruction to restore the previous control to the device control unit 5 is given (step S23). The category score value of the control target item selected based on the category keyword after paraphrasing is set to the maximum value (for example, 10) (step S24).
Then, the process proceeds to step S16, the speech recognition result analysis unit 4 refers to the score storage area 12, and counts the number N of control target items having a category score value of “1” or more and the largest category score value. It is determined whether the number N is only one (N = 1?), More than one (N> 1?), Or zero (N = 0?) (Step S16).

If the voice recognition result analysis unit 4 executes an operation instruction to the device control unit 5 in step S17, the category score value stored in the score storage area 12 is set for the control target item that is not instructed to operate, for example. By subtracting “1”, the operation order of the control target item is lowered by one (step S25).
In addition, the control target item for which the operation is instructed and the operation content based on the quantity operation keyword are stored as a history in the history storage area 13 (step S26), and the speech recognition result analysis unit 4 performs one operation device determination. The process ends and prepares for the next operation input.

On the other hand, in the above-described step S11, when there is a quantity determination keyword among the input keywords (YES in step S11), the speech recognition result analysis unit 4 refers to the history stored in the history storage area 13, The category score value of the control target item for which the operation has been instructed immediately before is set to “0”, for example, and the category score value of the control target item is reset (step S27), and the speech recognition result analysis unit 4 performs one operation device determination. The process ends and prepares for the next operation input.
Also, in the above-described step S13, when there is no quantity operation keyword in the input keyword (NO in step S13), the speech recognition result analysis unit 4 ends the operation device determination process without doing anything, and the next operation Prepare for input.

In the present embodiment, it may be excluded from the operation target by explicitly specifying that the operation of each control target item is completed.
Further, when the control target item cannot be specified from the category score value, the control target item may be directly designated as in step S18 or step S21, or the control target item operated immediately before is set as a candidate. It may be presented to the user.
Furthermore, the initial value (reset value) of the category score value described in the above-described operation device determination processing operation = 0, the maximum value = 10, and the value to be subtracted to drop the operation order of the control target item in step S25 = 1 Is an example, and these are determined based on the number of electronic devices to be operated and the number of control target items.

(Operation example)
Next, based on the above processing, the user's operation instruction (user utterance content) and the transition of the category score value for each control target item will be described with reference to three operation examples. In the following three operation examples, the initial value (reset value) of the category score value to be set = 0, the maximum value = 10, and subtraction in order to drop the operation order of the control target item in step S25. Description will be made assuming that value = 1.

(Operation example 1: Normal operation instruction is executed)
Table 2 shows user operation instructions (contents of user utterances) for each operation step when operation instructions are normally executed, and “map scale”, “volume”, “temperature”, and “window opening / closing”. The transition of the category score value for each control target item is shown.

To explain with reference to Table 2, first, the operation step 01 is in an initial state, and the category score values of the four control target items are all “0”.
Next, when the user's operation instruction “map reduction” is input in operation step 02, since “map reduction” includes both the category keyword and the quantity operation keyword, the control target item “map” The category score value of “scale” is set to “10”, and map control for the navigation ECU 53 by the device control unit 5 is executed.

  Also, in the operation step 03, when the user's operation instruction “volume reduction” is input, since both the category keyword and the quantity operation keyword are included in “volume reduction”, the control target item “volume” Is set to “10” and volume control for the audio ECU 52 by the device control unit 5 is executed. Further, “1” is subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “9”.

  Furthermore, in the operation step 04, when the user's operation instruction “more” is input, since “more” includes only the quantity operation keyword, the category score value of the control target item “volume” is “10”. The volume control for the audio ECU 52 by the device control unit 5 is continuously performed. Further, “1” is further subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “8”.

  In addition, when the user's operation instruction “OK” is input in the operation step 05, “OK” is an amount determination keyword, and therefore, the category score of the control target item “volume” for which the operation has been continued. Although the value is reset to “0”, the category score value of the control target item “map scale” is held at “8”.

  Next, in the operation step 06, when the user's operation instruction “large” is input, “large” includes only the quantity operation keyword, and the control has been continued from the past. Since there is no target item, the control target item “map scale” having the largest category score value is selected, the category score value of the control target item “map scale” is set to “10”, and navigation by the device control unit 5 is performed. Map control for the ECU 53 is executed.

  In addition, when the user's operation instruction “decrease the temperature” is input in the operation step 07, both the category keyword and the quantity operation keyword are also included in the “decrease the temperature”. The category score value of “temperature” is set to “10”, and temperature control for the air conditioner ECU 51 by the device control unit 5 is executed. Further, “1” is subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “9”.

  Furthermore, in the operation step 08, when the user's operation instruction “more” is input, since “more” includes only the quantity operation keyword, the category score value of the control target item “temperature” is “10”. The temperature control for the air conditioner ECU 51 by the device control unit 5 is continued. Further, “1” is further subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “8”.

  Further, when the user's operation instruction “open window” is input in operation step 09, both “category keyword” and “quantity operation keyword” are included in “open window”. The category score value of “window opening / closing” is set to “10”, and window opening / closing control for the window ECU 55 by the device control unit 5 is executed. Further, “1” is subtracted to lower the operation order, the category score value of the control target item “map scale” is set to “7”, and similarly, the category score value of the control target item “temperature” is “9”. Set to

  Also, in the operation step 10, when the user's operation instruction “more more” is input, “more more” includes only the quantity operation keyword, so the category score value of the control target item “window opening / closing” The window opening / closing control for the window ECU 55 by the device control unit 5 is continuously executed with the value “10”. Then, “1” is subtracted to further lower the operation order, the category score value of the control target item “map scale” is set to “6”, and the category score value of the control target item “temperature” is similarly set to “8”. "Is set.

  Next, when the user's operation instruction “OK” is input in the operation step 11, since “OK” is the quantity determination keyword, the category score of the control target item “window opening / closing” for which the operation has been continued. Although the value is reset to “0”, the category score value of the control target item “map scale” is kept at “6”, and the category score value of the control target item “temperature” is kept at “8”.

  In the operation step 12, when the user's operation instruction “raise” is input, the “raise” only includes the quantity operation keyword, and the operation has been continued from the past. Since there is no control target item, the control target item “temperature” having the largest category score value is selected, the category score value of the control target item “temperature” is set to “10”, and the air conditioner ECU 51 by the device control unit 5 is set. The temperature control for is performed. Further, “1” is further subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “5”.

  Then, when the user's operation instruction “just right” is input in operation step 13, “just right” is a quantity determination keyword, and therefore the category score of the control target item “temperature” for which the operation has continued. The value is reset to “0”, but the category score value of the control target item “map scale” remains “5”.

Next, when the user's operation instruction “large” is input in the operation step 14, “large” includes only the quantity operation keyword, and the control has been continued from the past. Since there is no target item, the control target item “map scale” having the largest category score value is selected, the category score value of the control target item “map scale” is set to “10”, and navigation by the device control unit 5 is performed. Map control for the ECU 53 is executed.
Finally, in the operation step 15, when a user's operation instruction “OK” is input, since “OK” is a quantity determination keyword, the category of the control target item “map scale” that has been operated continues. The score value is reset to “0”.

(Operation example 2: When the user corrects the operation instruction)
Table 3 shows user operation instructions (contents of user utterances) at each operation step when the user corrects the operation instructions, and “map scale”, “volume”, “temperature”, and “window opening / closing”. The transition of the category score value for each control target item is shown.

  Since the operation example from operation step 01 to operation step 11 in Table 3 is the same as the operation example described with reference to Table 2, only operation step 12 and subsequent steps will be described.

  Referring to Table 3, the user's operation instruction “OK” is input in operation step 11, the category score value of the control target item “window opening / closing” is reset to “0”, and the control target item “map” From the state in which the category score value of “Scale” is kept “6” and the category score value of the control target item “Temperature” is kept “8”, in the operation step 12, the user who made the wrong operation instruction “ ”Is input, only“ amount ”keyword is included in“ Raise ”, and there is no control target item that has been operated from the past, so the category score value is the largest. The control target item “temperature” is selected, the category score value of the control target item “temperature” is set to “10”, and the device controller 5 controls the temperature of the air conditioner ECU 51. It is executed. Further, “1” is further subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “5”.

  Next, in operation step 13, when the user who notices that the operation instruction has not been performed as intended is input a paraphrase of the category keyword “volume instead of temperature”, the previous device control unit 5 is canceled, the control target item “volume” corresponding to the newly paraphrased category keyword and the previous quantity operation keyword is selected, and the category score value of the control target item “volume” is selected. While being set to “10”, the volume control for the audio ECU 52 by the device control unit 5 is executed. Also, “1” is subtracted to drop the operation order, the category score value of the control target item “map scale” is set to “4”, and similarly, the category score value of the control target item “temperature” is “9”. Set to

Further, when the user's operation instruction “more” is input in the operation step 14, since “more” includes only the quantity operation keyword, the category score value of the control target item “volume” is “10”. The volume control for the audio ECU 52 by the device control unit 5 is continuously performed. Further, “1” is subtracted to lower the operation order, the category score value of the control target item “map scale” is set to “3”, and similarly, the category score value of the control target item “temperature” is “8”. Set to
Then, when the user's operation instruction “OK” is input in the operation step 15, since “OK” is an amount determination keyword, the category score value of the control target item “volume” for which the operation has continued is determined. Although it is reset to “0”, the category score value of the control target item “map scale” is kept “3”, and the category score value of the control target item “temperature” is kept “8”.

(Operation example 3: When the control target item cannot be determined)
Table 4 shows the user's operation instruction (user utterance content) at each operation step when the control target item cannot be determined, the response (utterance content) of the electronic device control device, “map scale”, “volume”, “ The transition of the category score value for each of the four control target items “temperature” and “window opening / closing” is shown.

To explain with reference to Table 4, first, the operation step 01 is in an initial state, and the category score values of the four control target items are all “0”.
Next, when the user's operation instruction “map reduction” is input in operation step 02, since “map reduction” includes both the category keyword and the quantity operation keyword, the control target item “map” The category score value of “scale” is set to “10”, and map control for the navigation ECU 53 by the device control unit 5 is executed.

  Also, in the operation step 03, when the user's operation instruction “volume reduction” is input, since both the category keyword and the quantity operation keyword are included in “volume reduction”, the control target item “volume” Is set to “10” and volume control for the audio ECU 52 by the device control unit 5 is executed. Further, “1” is subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “9”.

  Furthermore, in the operation step 04, when the user's operation instruction “more” is input, since “more” includes only the quantity operation keyword, the category score value of the control target item “volume” is “10”. The volume control for the audio ECU 52 by the device control unit 5 is continuously performed. Further, “1” is further subtracted to lower the operation order, and the category score value of the control target item “map scale” is set to “8”.

  In addition, when the user's operation instruction “OK” is input in the operation step 05, “OK” is an amount determination keyword, and therefore, the category score of the control target item “volume” for which the operation has been continued. Although the value is reset to “0”, the category score value of the control target item “map scale” is held at “8”.

  Next, in the operation step 06, when the user's operation instruction “large” is input, “large” includes only the quantity operation keyword, and the control has been continued from the past. Since there is no target item, the control target item “map scale” having the largest category score value is selected, the category score value of the control target item “map scale” is set to “10”, and navigation by the device control unit 5 is performed. Map control for the ECU 53 is executed.

In addition, when a user's operation instruction “OK” is input in the operation step 07, “OK” is a quantity determination keyword, and therefore, the category of the control target item “map scale” for which the operation has continued has been continued. The score value is reset to “0”, and the category score values of all the control target items become “0”.
Next, in the operation step 08, when the user's operation instruction “more” is input, “more” includes only the quantity operation keyword, and the control continues to operate from the past. Since there are no target items and the category score values of all the control target items are “0”, the control target item cannot be selected from the category score values.

  In such a case, the electronic device control apparatus according to the present embodiment makes an inquiry about the control target item estimated from the previous operation “Do you want to enlarge the map?” Shown in the operation step 09, or this is denied in the operation step 10. Then, an inquiry is made as to which control target item is desired, such as “Please specify the control target item to be operated” or how the operation amount is to be set, as shown in the operation step 11.

When the user's operation instruction “volume up” is input in the operation step 12, “volume up” includes both the category keyword and the quantity operation keyword. Is set to “10” and volume control for the audio ECU 52 by the device control unit 5 is executed.
Further, when the user's operation instruction “OK” is input in the operation step 13, since “OK” is a quantity determination keyword, the category score value of the control target item “volume” for which the operation has continued is determined. Reset to “0”.

  As described above, according to the electronic device control apparatus of the present embodiment, the category keyword for specifying the control target item for the plurality of electronic devices in advance, the quantity operation keyword corresponding to the operation control amount of the control target item, The determination keyword for determining the operation control amount of the control target item is stored in the keyword / category / operation keyword correspondence table 11, and the speech recognition result analysis unit 4 is included in the recognized words recognized by the speech recognition unit 3. The input keyword is compared with the stored contents of the category / operation keyword correspondence table 11 to determine whether or not the keyword to be stored is in the category / operation keyword correspondence table 11. As a result of the comparison, if there is a category keyword for specifying control target items for a plurality of electronic devices in the input keyword, the control target corresponding to the category keyword stored in the score storage area 12 Set the category score value of the item to the maximum value.

  On the other hand, even if there is no category keyword among the input keywords, if there is a quantity operation keyword, the electronic device corresponding to the control target item with the maximum category score value set based on the past operation flow is specified. Then, the operation control unit 5 is instructed of the operation content based on the control target item for which the electronic device is to be operated and the quantity operation keyword. For the control target item for which no operation instruction has been given, the category score value stored in the score storage area 12 is subtracted by, for example, “1”, and the operation order of the control target item is lowered by one.

As described above, in accordance with whether or not the input keyword is in the category / operation keyword correspondence table 11, the speech recognition result analysis unit 4 sets the category score value for each control target item corresponding to the keyword. Since the operation order based on the category score value is set for each control target item, the device control unit 5 executes control based on the operation keyword on the electronic device specified from the set operation order.
Accordingly, even when a quantity operation keyword common to a plurality of electronic devices is input and it is not clear which electronic device is to be operated, an electronic device that specifies and controls the optimum electronic device from the plurality of electronic devices The effect that a control apparatus is realizable is acquired.

It is a block diagram which shows the structure of the electronic device control apparatus of one Example of this invention. It is a flowchart which shows the whole process operation | movement of the electronic device control apparatus of the Example. It is a flowchart which shows the operation equipment determination processing operation | movement of the electronic device control apparatus of the Example.

Explanation of symbols

2 Microphone (voice input means)
3 Voice recognition unit (voice recognition means)
4 Speech recognition result analysis unit (score setting means)
5 Device control unit (device control means)
11 Category / operation keyword correspondence table (keyword storage means)
51 Air conditioner ECU (electronic equipment)
52 Audio ECU (electronic equipment)
53 Navigation ECU (electronic equipment)
54 Wiper ECU (electronic equipment)
55 Window ECU (electronic equipment)

Claims (1)

In the electronic device control apparatus for recognizing the voice input to the voice input means with the voice recognition means and controlling a plurality of electronic devices with the voice,
A keyword for storing a category keyword for specifying control target items for the plurality of electronic devices, an operation keyword corresponding to the operation control amount of the control target item, and a determination keyword for determining the operation control amount of the control target item Storage means;
An electronic device that compares a keyword included in a recognized word recognized by the voice recognition unit with a stored content of the keyword storage unit, sets a score for each control target item, and sets an operation target according to the value of the score Voice recognition result analysis means for determining operation contents based on the device, the control target item, and the operation keyword ;
And a device control means for executing the control of the electronic apparatus in operation content determined by the voice recognition result analyzing means,
The speech recognition result analysis means sets the score value of the control target item of the control content executed immediately before to the initial value when the determined keyword is included in the recognized words recognized by the speech recognition means. An electronic device control device characterized by that.

Images