JP2018180030A - Operation device and operation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation device capable of improving a success rate of acceptance of an operation by speech recognition.SOLUTION: An operation device comprises: a storage unit 15 which stores operation information which is information in which receivable items are layered as operations of apparatus 2-1 and 2-2; an operation input unit 11 which receives input of information in a certain number of higher hierarchical level which includes the highest hierarchical level in the operation information by the operation from a user; a voice input unit 12 which receives the input by voice; and a control unit 14 which restricts vocabulary received by the voice input unit 12, based on the operation information and the information in the certain number of higher hierarchical level received by the operation input unit 11, performs voice recognition based on the restricted vocabulary and the voice received by the voice input unit 12, and generates the operation information for operating the apparatus 2-1 and 2-2 based on the result of the voice recognition.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an operating device and an operating method for operating a device.

  When accepting the operation of equipment such as air conditioners and lighting equipment by voice input, natural operating devices can operate natural language even though the operation that can be instructed to the equipment is only a limited vocabulary. It is configured to accept everything as speech input. For this reason, the user does not know what vocabulary the operating device corresponds to, that is, does not know what operation can be instructed to the device by the operating device, and There is a possibility that an operation that can not be instructed can be input by voice. When an operation that can not be instructed to the device is input by voice, the controller device indicates that the input operation can not be performed, and the user will try to input voice again by this display. That is, the controller device fails in the operation of the device by voice input.

  In addition, since the controller accepts voice input without knowing what the user is interested in, there are a wide variety of voice recognition result candidates, and correct voice recognition results can not be obtained. The operation may fail.

  On the other hand, Patent Document 1 also describes that the accuracy of speech recognition is improved by limiting the vocabulary to be subjected to speech recognition.

Unexamined-Japanese-Patent No. 2004-12809

  However, according to the technique described in Patent Document 1, the accuracy of speech recognition is improved by limiting the range of the vocabulary recognized by the speech recognition dictionary. Therefore, in order to improve the accuracy of speech recognition, it is necessary to limit the range of vocabulary in advance. However, in the case of an operating device for operating a device, there are cases where it is possible to operate a plurality of devices, and the contents of the operation differ depending on the device, and it is difficult to determine the range of vocabulary in advance. Also, even if there is only one device that can operate the operating device and the range of the vocabulary is determined in advance, there is a possibility that the user may input an operation that can not be instructed to the device by voice. As a result, there is a possibility that the operation of the device by voice input may fail.

  The present invention has been made in view of the above, and it is an object of the present invention to obtain an operating device capable of improving the success rate of the operation of the device by voice input.

  In order to solve the problems described above and achieve the object, the present invention is an operating device capable of operating a device, and an operation in which items that can be accepted as operations of the device are hierarchical information. A storage unit for storing information, an operation input unit for receiving input of information of a fixed number of upper layers including the highest hierarchy in operation information by an operation from a user, and a voice input unit for receiving input by voice . Further, the operation device restricts the vocabulary accepted by the voice input unit based on the operation information and the information of the upper fixed number of layers accepted by the operation input unit, and is accepted by the restricted vocabulary and the voice input unit And a control unit configured to perform speech recognition based on speech and to generate operation information for operating the device based on a result of speech recognition.

  According to the present invention, it is possible to improve the success rate of accepting an operation by speech recognition.

A diagram showing an example of a device system according to a first embodiment Flowchart showing an example of the operation procedure of the device in the operating device of the embodiment 1 The figure which shows an example of the database of Embodiment 1 A figure showing an example of a screen of Embodiment 1 for prompting a user to input a first hierarchy. The figure which shows an example of the screen of Embodiment 1 for prompting a user to input the 2nd hierarchy. A diagram showing an example of a screen displayed in step S12 of the first embodiment A figure showing an example of a database concerning Embodiment 2 A diagram showing an example of a display screen displayed for prompting an input of the first hierarchy in step S10 in the second embodiment. A diagram showing an example of a display screen displayed to prompt an input of the second hierarchy in step S10 in the second embodiment. A diagram showing an example of a screen displayed when illumination is selected when the screen shown in FIG. 9 is displayed. The figure which shows an example of the database concerning Embodiment 3. A diagram showing an example of a display screen displayed in step S10 in the third embodiment. A diagram showing an example of a display screen displayed in step S10 in the third embodiment.

  Hereinafter, an operating device and an operating method according to an embodiment of the present invention will be described in detail based on the drawings. The present invention is not limited by the embodiment.

Embodiment 1
FIG. 1 is a diagram showing an example of a device system according to a first embodiment of the present invention. As shown in FIG. 1, the device system 100 according to the first embodiment includes the controller device 1 and the devices 2-1 and 2-2. Hereinafter, when showing apparatus 2-1, 2-2 without distinguishing, it describes as apparatus 2. FIG.

  The device 2 is, for example, a home device such as an air conditioner (hereinafter, abbreviated as an air conditioner), a lighting device, and an audio device. Although two devices 2 are illustrated in FIG. 1, the number of devices 2 is not limited, and any number of devices 2 may be used. The controller device 1 is a device capable of operating the device 2. The controller device 1 may be a device called a remote controller for operating the device 2, or may be a smartphone, a tablet, a personal computer, or the like which is a general-purpose terminal. The communication line between the controller device 1 and the device 2 may be a wireless line or a wired line.

  As shown in FIG. 1, the controller device 1 includes an operation input unit 11, an audio input unit 12, a display unit 13, a control unit 14, a storage unit 15, and a communication unit 16. The operation input unit 11 is an input unit that receives an input from the user by an input operation, and the voice input unit 12 is an input unit that receives an input by a voice from the user. Although an example in which the operation input unit 11 and the display unit 13 are integrated and realized by a touch panel will be described below, the operation input unit 11 and the display unit 13 may be separately provided. When the operation input unit 11 and the display unit 13 are separately provided, for example, the operation input unit 11 is a keyboard, a mouse, or a button, and the display unit 13 is, for example, a display or a monitor. The storage unit 15 is realized by a memory. The communication unit 16 is realized by a communication circuit.

  The control unit 14 is realized by, for example, a memory and a processor that is a CPU (Central Processing Unit) or the like. The function of the control unit 14 is realized by execution of a program stored in a memory by a processor. Memory is also used by the processor to execute programs. The control unit 14 may be realized by a microcomputer or the like. In addition, the control unit 14 may be realized by a dedicated processing circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  Next, a method of operating the device 2 in the controller device 1 of the present embodiment will be described. FIG. 2 is a flowchart showing an example of the operation procedure of the device 2 in the controller device 1. As shown in FIG. 2, first, the control unit 14 of the controller device 1 receives an input from the user by the operation input unit 11 of the controller device 1 (step S10).

  Specifically, the control unit 14 displays on the display unit 13 a screen for prompting the user to make an input regarding the operation of the device 2. The user operates the operation input unit 11 according to the screen displayed on the display unit 13 to input information on the operation of the device 2 to the operation device 1. The operation input unit 11 converts the user's operation into information, and outputs the converted information to the control unit 14 as input information.

  The control unit 14 refers to the database stored in the storage unit 15 when displaying a screen for prompting an input regarding the operation of the device 2 on the display unit 13. The database is a database in which operation information which is an item that can be operated on the device 2 is stored, and has a hierarchical structure. Although an example in which operation information having a hierarchical structure is stored as a database in the storage unit 15 will be described below, any method may be used to store the operation information in the storage unit 15.

  FIG. 3 is a diagram showing an example of a database according to the present embodiment. In the example shown in FIG. 3, the operation information is configured in three layers of the target device, the operation attribute, and the operation value. The first hierarchy is a target device, the second hierarchy is an operation attribute, and the third hierarchy is an operation value. The target device is an example of information indicating the target of the operation, and is information indicating the device 2 to be the target of the operation. The operation attribute is information indicating the attribute of the operation. Here, it is assumed that the first hierarchy is the highest hierarchy, and as the number of hierarchies increases, such as the second hierarchy and the third hierarchy, the lower hierarchy. The database is set in advance according to the device 2 to be operated by the controller device 1.

  FIG. 3 shows an example in which the device 2 includes an air conditioner and a lighting device. Therefore, the target device which is the information of the first hierarchy includes the air conditioner and the lighting device. The operation attribute which is the information of the second hierarchy includes the operation mode, the set temperature and the wind when the first hierarchy is an air conditioner, and the operation attribute is ON or OFF when the first hierarchy is a lighting device. OFF) and mode, and illumination included. The operation value, which is the information of the third hierarchy, includes, for example, cooling, heating, dehumidification and air flow when the first hierarchy is an air conditioner and the second hierarchy is an operation mode. Note that FIG. 3 shows an example in which the nighttime mode can be set as the mode for the lighting device. The good night mode is, for example, a mode in which a night light is lit, but the contents of the good night mode are not limited to this example. Note that FIG. 3 is an example, and the specific contents of the target device, the operation attribute, and the operation value may be set according to the device 2, and are not limited to the example of FIG. Further, in the present embodiment, an example is shown in which the first hierarchy is the target device, the second hierarchy is the operation attribute, and the third hierarchy is the operation value, but the items of each hierarchy are not limited to this example. Also, the number of layers is not limited to three.

  FIG. 4 and FIG. 5 are diagrams showing an example of a screen for prompting the user for input regarding the operation of the device 2. FIG. 4 and FIG. 5 show an example of a screen on the premise of the database illustrated in FIG. First, as shown in FIG. 4, the control unit 14 refers to the database of the storage unit 15 to display a screen including an image respectively showing the air conditioner and the lighting device as the information of the first hierarchy on the display unit 13. Here, it is assumed that the user selects the air conditioner via the operation input unit 11. Based on the input received by the operation input unit 11, the control unit 14 displays, as shown in FIG. 5, a screen including an image showing an operation mode, set temperature, and wind, which is information of the second hierarchy corresponding to the air conditioner. Display to section 13. When the screen shown in FIG. 5 is displayed on the display unit 13, the user selects one of the operation mode, the set temperature and the wind via the operation input unit 11. As a result, the control unit 14 receives the input of the selection result for the first hierarchy and the second hierarchy via the operation input unit 11. For example, the user selects one of the operation mode, the set temperature and the wind by a touch operation. Although FIG. 5 shows an example in which the image showing the information of the second hierarchy is displayed superimposed on the image of the air conditioner, the display method of the image showing the information of the second hierarchy is the example shown in FIG. It is not limited to.

  In the example shown in FIGS. 4 and 5, in step S10 shown in FIG. 2, the input for two layers of the first hierarchy and the second hierarchy is accepted by the operation input unit 11, but the input via the operation input unit 11 The number of layers to receive is not limited to two and may be one or more.

  It returns to the explanation of FIG. After step S10, the control unit 14 limits the acceptance target based on the information input in step S10 and the database stored in the storage unit 15 (step S11). Specifically, the control unit 14 extracts an item matching the information input in step S10 in the database, and limits the reception target so that only the extracted item is accepted as an input. The item matching the information input in step S10 in the database means that the information input in step S10 in the hierarchy of operation information is from the first hierarchy to the Mth (M is an integer of 1 or more) hierarchy When this is done, the information from the first hierarchy to the Mth hierarchy is an item of a hierarchy of (M + 1) or higher hierarchy that matches the database. For example, in the example shown in FIGS. 4 and 5, when the screen shown in FIG. 5 is displayed and the set temperature is selected by the user, the target device shown in FIG. 3 is the air conditioner and the operation attribute is the set temperature. The operation values of 10 ° C. to 30 ° C. in the given case are raised and lowered. In addition, about 10 ° C-30 ° C, since it is not decided to one, the item of 10 ° C-30 ° C is actually said as 10 ° C, 11 ° C, 12 ° C, ..., 30 ° C, for example It is treated as multiple items such as being treated as an item in 1 ° C. increments or as an item in 0.5 ° C. increments.

  Next, the control unit 14 displays on the display unit 13 a screen prompting the user for an input, and stands by for an input from the user (step S12). FIG. 6 is a view showing an example of a screen displayed in step S12. FIG. 6 shows an example in which the set temperature is selected in FIG. For example, the user selects the set temperature by flick operation. When the set temperature is selected, the control unit 14 causes the display unit 13 to display a screen in which the set temperature can be changed by the arrow button as shown in FIG. In addition, the control unit 14 restricts the range in which the set temperature can be changed to the display unit 13 by the arrow button to the range limited in step S11. Furthermore, the control unit 14 displays on the display unit 13 information indicating that the set temperature can also be input by voice input.

  It returns to the explanation of FIG. After step S12, the control unit 14 determines whether there is an input from the operation input unit 11 (step S13). Specifically, for example, the control unit 14 determines whether the set temperature has been changed by pressing the arrow button on the screen illustrated in FIG.

  When the control unit 14 determines that there is an input from the operation input unit 11 (Yes in step S13), the control unit 14 generates operation information for instructing the information input to the device 2 based on the input information ( Step S16). The control unit 14 transmits the operation information to the device 2 via the communication unit 16 (step S17), and ends the process.

  If it is determined in step S13 that there is no input from the operation input unit 11 (No in step S13), the control unit 14 determines whether there is an input from the voice input unit 12 (step S14). When it is determined that there is no input from the voice input unit 12 (No in step S14), the control unit 14 executes the process from step S12 again.

  If it is determined that there is an input from the voice input unit 12 (Yes in step S14), the control unit 14 performs voice recognition with the voice recognition target limited to the reception target, ie, the reception target limited in step S11. (Step S15). The control unit 14 proceeds to the process of step S16 as the information of the input voice recognition result. For example, in the example shown in FIG. 6, since the acceptance target is limited to the operation value corresponding to the set temperature of the air conditioner, the control unit 14 limits the target of voice recognition to the item corresponding to 10 ° C. to 30 ° C. Do. That is, in this case, the control unit 14 limits the candidate of the vocabulary obtained as the recognition result to 10 ° C. to 30 ° C. in the speech recognition.

  Note that the process illustrated in FIG. 2 may be allowed to end by, for example, touching an end button (not illustrated) at an arbitrary timing in the process illustrated in FIG.

  Generally, in speech recognition, among the features of the vocabulary included in the dictionary for speech recognition, using the features of the inputted speech and the dictionary for speech recognition defined in advance, the features of the inputted speech are the most common. Find near vocabulary as recognition result. In the present embodiment, as described above, the dictionary for speech recognition, that is, the candidates obtained as the recognition result is limited based on the input from the operation input unit 11. As a result, the probability of correctly recognizing speech can be improved as compared to the case where limitation is not performed. Any specific algorithm for speech recognition may be used. The control unit 14 may display an error or the like when the speech recognition fails.

  As described above, in the present embodiment, the storage unit 15 stores operation information which is information in which items that can be accepted as an operation of the device 2 are hierarchized, and the operation input unit 11 is the highest rank in the operation information. The input of the information of the upper fixed number of layers including the layer of is accepted by the operation from the user, and the voice input unit 12 receives the input by voice. In the example described with reference to FIGS. 3 to 5, the upper fixed number of layers is two layers of the first layer and the second layer. The control unit 14 restricts the vocabulary accepted by the voice input unit 12 based on the operation information and the information of the upper fixed number of layers accepted by the operation input unit 11, and is accepted by the restricted vocabulary and the voice input unit 12. The voice recognition is performed based on the voice and the operation information for operating the device 2 is generated based on the result of the voice recognition. In the example described with reference to FIGS. 3 to 5, the control unit 14 operates the operation information based on the information accepted by the voice input unit 12 based on the information corresponding to the first hierarchy and the second hierarchy accepted by the operation input unit 11. Restrict to the operation values stored in.

  Therefore, the probability of correctly recognizing speech can be improved as compared to the case where restriction of the vocabulary to be subjected to speech recognition is not performed. Therefore, the controller device 1 can improve the success rate of the operation of the device 2 by voice input as compared with the case where the candidates for the voice recognition result are not limited. Also, if the target device is selected by the touch operation and the operation attribute is selected by the flick operation, the selection by the flick operation is made in a series of operations from the touch operation, so the user can touch and flick. The operation can be performed in one operation. That is, selection of information corresponding to the first hierarchy and the second hierarchy can be performed by one operation by the user. Therefore, the user can select two layers in one operation, and can easily select two layers.

  Also, when receiving an operation by voice input from the beginning, the user speaks without any knowledge of what kind of operation can be performed on what kind of device, so a vocabulary that is not actually operable content is uttered There is also the possibility of On the other hand, in the present embodiment, since the upper input of one or more layers is first received by the operation input unit 11, the user generates a vocabulary within a certain range, and the invalid vocabulary is operated The possibility of voice input to the device 1 is reduced, and the success rate of operation of the device by voice input can be improved.

Second Embodiment
Next, an operating device according to a second embodiment of the present invention will be described. The configuration of the device system 100 of the present embodiment and the configuration of the controller device 1 are the same as in the first embodiment. The differences from Embodiment 1 will be mainly described below.

  FIG. 7 is a diagram of an example of a database according to the second embodiment. The database shown in FIG. 7 is a database corresponding to the device information of the second embodiment. As shown in FIG. 7, the operation information of the second embodiment is composed of three layers of a target space, an operation attribute, and an operation value. The target space is an example of information indicating an operation target, and is information indicating a space to be an operation target. The first hierarchy is a target space, the second hierarchy is an operation attribute, and the third hierarchy is an operation value. FIG. 7 shows an example in which the device 2 includes an air conditioner installed in a living room, a lighting device installed in a living room, an air conditioner installed in a children's room, and a lighting device installed in a children's room .

  In the example shown in FIG. 7, the target space of the first hierarchy is a living room and a children's room. The operation attributes of the second hierarchy are temperature and lighting. As described above, in the present embodiment, not the type unit of the device 2 but the target space and the operation attribute indicating the content to be operated are set as the operation information. Then, operation values corresponding to the target space and the operation target are set. In the example shown in FIG. 7, the operation attribute and the operation value are the same between the device 2 installed in the living room and the device 2 installed in the children's room, but in the device 2 installed in the living room and the children's room The operation attribute and the operation value may not be the same for the installed device 2. For example, if the air conditioner installed in the living room has an air cleaning function and the air conditioner installed in the child room does not have the air cleaning function, the air cleaning is added as an operation attribute when the target space is living in the operation information . When a humidifier is installed in the child room as the device 2 and there is no humidifier in the living room, humidification is added as an operation attribute in the case where the target space is a child room in the operation information.

  The method of operating the device 2 in the controller device 1 of the present embodiment is the same as that of the first embodiment although the content of the operation information is different. FIG. 8 and FIG. 9 are diagrams showing an example of a display screen displayed in step S10 of FIG. 2 in the present embodiment. 8 and 9 show an example of a screen on the premise of the database illustrated in FIG.

  The control unit 14 first refers to the database of the storage unit 15 to display a screen including an image respectively showing the living room and the child room, which is information of the first hierarchy, on the display unit 13. Here, it is assumed that the user selects the living room through the operation input unit 11. Based on the input received by the operation input unit 11, the control unit 14 sends to the display unit 13 a screen including an image respectively showing temperature and illumination, which is information of the second hierarchy corresponding to the living room, as shown in FIG. indicate.

  FIG. 10 is a view showing an example of a screen displayed when the illumination is selected when the screen shown in FIG. 9 is displayed. The screen shown in FIG. 10 is the screen displayed in step S12 of FIG. In the example shown in FIG. 10, living is selected in the first hierarchy and lighting is selected in the second hierarchy, so the target of speech recognition, that is, the candidate of speech recognition result is brightened, dimmed, extinguished and extinguished. Limited to good night. The operation of the present embodiment other than that described above is the same as that of the first embodiment.

  As described above, in the operation device 1 according to the present embodiment, the first hierarchy is the target space, and the second hierarchy is the operation information indicating the contents to be operated, using the operation information hierarchized as the operation attribute. The same operation was performed. As described above, even when the speech recognition result is limited in units of space, the same effect as that of the first embodiment can be obtained. Also, if the target space is selected by the touch operation and the operation attribute is selected by the flick operation, the user can perform the touch and flick operation with a single operation. Therefore, the user can select two layers in one operation, and can easily select two layers.

Third Embodiment
Next, an operating device according to a third embodiment of the present invention will be described. The configuration of the device system 100 of the present embodiment and the configuration of the controller device 1 are the same as in the first embodiment. The differences from Embodiment 1 will be mainly described below.

  FIG. 11 is a diagram of an example of a database according to the third embodiment. The database shown in FIG. 11 is a database corresponding to the device information of the third embodiment. As shown in FIG. 11, the operation information of the third embodiment is composed of three layers of a target device, an operation attribute and an operation value. The first hierarchy is a target device, the second hierarchy is an operation attribute, and the third hierarchy is an operation value. However, in the present embodiment, the target device also includes information indicating the installation location, that is, information indicating the target space. That is, the target device of the present embodiment is an example of information indicating an operation target, and is information indicating a space to be an operation target and the device 2. In the example shown in FIG. 11, a living air conditioner and a children's room air conditioner are included as target devices. The operation attribute and the operation value are the same as in the first embodiment. Note that FIG. 11 shows an example in which the items that can be operated are the same for the living air conditioner and the children's room air conditioner, but when the living air conditioner and the children's room air conditioner are different models, for example, In the child room air conditioner, the operation attribute and the operation value may not be the same.

  The method of operating the device 2 in the controller device 1 of the present embodiment is the same as that of the first embodiment although the content of the operation information is different. 12 and 13 are diagrams showing an example of the display screen displayed in step S10 of FIG. 2 in the present embodiment. 12 and 13 show an example of a screen on the premise of the database illustrated in FIG.

  The control unit 14 first refers to the database of the storage unit 15 to display a screen including an image respectively showing the living air conditioner and the children's room air conditioner, which is information of the first hierarchy, on the display unit 13. Here, it is assumed that the user selects a living air conditioner via the operation input unit 11. Based on the input received by the operation input unit 11, as shown in FIG. 13, the control unit 14 displays a screen including an image indicating the operation mode, the set temperature, and the wind, which is information of the second hierarchy corresponding to the living room. Display on the display unit 13. The operation of the present embodiment other than that described above is the same as that of the first embodiment.

  As described above, in the controller device 1 of the present embodiment, the first layer is set as the target device including the information of the target space, and the same operation as that of the first embodiment is performed. As described above, by including the information of the target space in the first hierarchy, the same effect as that of the first embodiment can be obtained even when the devices 2 of the same type are installed in a plurality of rooms. Further, if the target device is selected by the touch operation and the operation attribute is selected by the flick operation, the user can perform the touch and flick operation with a single operation. Therefore, the user can select two layers in one operation, and can easily select two layers.

  In the first to third embodiments, only the lowermost layer of the operation information is accepted by voice input, but one or more layers of the operation information may be accepted by voice input. For example, the operation value below the wind of the operation attribute of the air conditioner illustrated in FIG. 3 is hierarchized into two layers, and the upper layer of the operation value is the wind direction and the air volume. Then, the upper and lower items are provided in the lower layer of the wind direction, and the strong, weak and 1 to 5 items are provided in the lower layer of the air volume. When a wind is selected when the screen shown in FIG. 5 is displayed, a screen for accepting selection of either the wind direction or the air volume is displayed, and either of the operation input unit 11 or the voice input unit 12 is displayed. But let me input it. When one of the wind direction and the air volume is selected, the input of the lower layer corresponding to the selected item can be input by either of the operation input unit 11 and the voice input unit 12. Further, the number of layers in the operation information may not be the same, as in the case where the number of layers is different between the air conditioner and the certification device.

  In the first to third embodiments, when the input of the first hierarchy and the second hierarchy is not received by the operation input unit 11, the reception of the input by the voice input unit 12 is stopped and the first hierarchy is performed. After the input of the information of the second hierarchy and the second hierarchy is received by the operation input unit 11, the reception of the input by the voice input unit 12 may be validated. As a result, since the reception of the speech input is not started until the user can easily imagine the vocabulary that can be accepted by the speech recognition with the operation device 1, false recognition can be suppressed. For example, in the examples shown in FIGS. 3 to 5, when the display screen shown in FIG. 5 is displayed, the user may input the operation value corresponding to the selected operation attribute by voice input. Recognize. Therefore, after the input to the second hierarchy is accepted on the display screen shown in FIG. 4, the voice input is accepted, and by not accepting the voice input until then, the user can set the selected operation attribute. It is possible to suppress uttering a vocabulary other than the corresponding operation value, and to suppress erroneous recognition.

  The configuration shown in the above embodiment shows an example of the contents of the present invention, and can be combined with another known technique, and one of the configurations is possible within the scope of the present invention. Parts can be omitted or changed.

  DESCRIPTION OF SYMBOLS 1 operation device, 2-1, 2-2 apparatus, 11 operation input part, 12 audio | voice input part, 13 display part, 14 control part, 15 memory part, 16 communication part, 100 apparatus system.

Claims (8)

An operating device capable of operating the device,
A storage unit that stores operation information, which is information in which items that can be accepted as operations of the device are hierarchized;
An operation input unit that accepts input of information of a fixed number of upper layers including the highest hierarchy in the operation information by an operation from a user;
A voice input unit that accepts input by voice,
The vocabulary accepted by the voice input unit is limited based on the operation information and the information of the upper fixed number of layers accepted by the operation input unit, and the restricted vocabulary and the voice accepted by the voice input unit A control unit configured to perform voice recognition based on the above and to generate operation information for operating the device based on the result of the voice recognition;
An operating device provided with The upper fixed number of layers are two layers of a first layer and a second layer,
The operating device according to claim 1, wherein the selection of the information corresponding to the first hierarchy and the second hierarchy can be performed by a single operation by a user. The operation information is information indicating the target of the operation in the first layer information, and the information in the second layer, which is a layer lower than the first layer, is information indicating an attribute of the operation.
The operation information includes information on the first layer and the second layer, and an operation value which is information on a third layer which is a layer lower than the second layer,
The control unit limits the vocabulary accepted by the voice input unit to the operation value stored in the operation information based on the information corresponding to the first hierarchy and the second hierarchy accepted by the operation input unit. The operating device according to claim 2.   The control device according to claim 3, wherein the target of the operation is information indicating a device to be a target of the operation.   The control device according to claim 3, wherein the target of the operation is information indicating a space to be a target of the operation.   The control device according to claim 3, wherein the target of the operation is information indicating a space and a device to be a target of the operation.   When the input of the information of the upper fixed number of layers is not received by the operation input unit, the reception of the input by the voice input unit is stopped, and the input of the information of the upper fixed number of layers is the operation input unit The operating device according to any one of claims 1 to 6, wherein acceptance of an input by the voice input unit is enabled after being accepted by the control unit. An operating method in an operating device capable of operating a device, comprising:
The operating device
A first step of storing operation information which is information in which items that can be accepted as operations of the device are hierarchized;
A second step of accepting, by an operation from a user, input of information of a fixed number of upper layers including the highest hierarchy in the operation information;
The third step of accepting input by voice;
The vocabulary accepted by voice is limited based on the operation information and the information of the upper fixed number of layers accepted in the second step, and the restricted vocabulary and the voice accepted in the third step are restricted. A fourth step of performing speech recognition based on the speech recognition result and generating operation information for operating the device based on the speech recognition result;
Operation method including.

Images