JPWO2020095633A1 - Dialogue device and dialogue program - Google Patents

Abstract

The dialogue device is a device that extracts a device associated with the user's position information by referring to a position acquisition unit that acquires the position information indicating the user's location information and setting information that associates each device with the location information. The phrase extraction unit that extracts the instruction phrase associated with the extracted device by referring to the vocabulary information that associates the extraction unit with the instruction phrase that represents the control instruction of each device and the instruction phrase, and the instruction phrase. Based on this, it includes a generation unit that generates an utterance sentence for controlling the device, and a presentation unit that presents the generated utterance sentence to the user.

Description

The present invention relates to a dialogue device and a dialogue program.

There is known a technique for operating and controlling devices such as so-called IoT (Internet of Things) devices including home appliances by utterance. In such a technique, the content of the instruction is determined by voice recognition of the utterance by the user, morphological analysis, and the like, and control information is output. Patent Document 1 describes a technique in which a server that manages home appliances provides a terminal device with an operation screen corresponding to each home appliance.

Japanese Unexamined Patent Publication No. 2002-186057

In a system that controls a device by a user's utterance, it is difficult for the user to recognize what kind of utterance should be made in a situation where information about a device to be controlled and options regarding the utterance content are not shown. There is a technique for guiding the utterance content to the user based on a scenario stored in advance as the utterance content for controlling the device, but even in such a technique, the utterance content is guided based on the pre-stored scenario. Therefore, it is not possible to flexibly and dynamically present the utterance content in response to a change in the device to be controlled, a change in the user's situation, or the like.

The technique described in Patent Document 1 merely shows an operation screen for operating a home electric appliance, and does not support the user's utterance. Further, since this operation screen is stored in advance, the display content cannot be dynamically changed according to the situation.

Therefore, the present invention has been made in view of the above problems, and in the technique of controlling a device by a user's utterance, a suitable utterance content is guided according to the type of the device to be controlled and the situation of the user. By doing so, the purpose is to improve convenience.

In order to solve the above problems, the dialogue device according to one embodiment of the present invention is a dialogue device that accepts user utterances composed of voice or text for generating control information for controlling the device, and is a user's location position. The position acquisition unit that acquires the position information indicating that, and the device extraction unit that extracts the device associated with the position information acquired by the position acquisition unit by referring to the setting information that associates each device with the location position. , One or more associated with the device extracted by the device extractor, with reference to the vocabulary information associated with each device and the instruction phrase representing the control instruction of the device and containing at least one phrase or sentence. The phrase extraction unit that extracts the instruction phrase of, the generation unit that generates the utterance sentence for controlling the device based on the instruction phrase extracted by the phrase extraction unit, and the utterance sentence generated by the generation unit to the user. It is provided with a presentation unit for presenting to the subject.

In order to solve the above problems, the dialogue program according to one embodiment of the present invention causes the computer to function as a dialogue device for receiving user utterances consisting of voice or text for generating control information for controlling a device. It is an interactive program, and the position acquired by the position acquisition function by referring to the position acquisition function that acquires the position information indicating the user's location position on the computer and the setting information that associates each device with the location position. Device extraction by referring to the device extraction function that extracts the devices associated with the information and the vocabulary information that associates each device with an instruction phrase that represents the control instruction of the device and contains at least one phrase or sentence. A phrase extraction function that extracts one or more instruction phrases associated with the device extracted by the function, and a generation function that generates an utterance sentence for controlling the device based on the instruction phrase extracted by the phrase extraction function. And a presentation function that presents the utterance sentence generated by the generation function to the user.

According to the above form, the device associated with the position information indicating the user's location is extracted, and the utterance sentence is generated based on the instruction phrase representing the control instruction of the extracted device, so that the user can use the device. It is possible to present to the user an utterance sentence that can appropriately control a device that is likely to perform a control operation at the current location. Since it is highly possible that the user can control the desired device by speaking the presented utterance sentence, the convenience is improved.

In the technique of controlling a device by a user's utterance, it is possible to improve convenience by guiding suitable utterance contents according to the type of the device to be controlled and the situation of the user.

It is a figure which shows the apparatus configuration of the dialogue system including the dialogue apparatus which concerns on this embodiment. It is a functional block diagram which shows the functional structure of the dialogue apparatus which concerns on this embodiment. It is a hard block diagram of a dialogue device. It is a figure which shows the structure of the setting information storage part, and the example of the stored data. 5 (a) and 5 (b) are diagrams showing an example of usage logs for each device. It is a figure which shows the structure of the vocabulary information storage part, and the example of the stored data. It is a figure which shows the screen example of the terminal of the user which displayed the utterance sentence. It is a flowchart which shows the processing content of the dialogue method of this embodiment. It is a flowchart which shows the processing content of the dialogue method of this embodiment. It is a figure which shows the structure of a dialogue program.

An embodiment of a dialogue device and a dialogue program according to the present invention will be described with reference to the drawings. If possible, the same parts will be designated by the same reference numerals, and duplicate description will be omitted.

FIG. 1 is a diagram showing a device configuration of a dialogue system according to the present embodiment. The dialogue system 1 includes a dialogue device 10, an external system 30, and a terminal 50. The dialogue device 10 and the terminal 50 can communicate with each other. Further, the dialogue device 10 and the external system can communicate with each other.

The dialogue device 10 is a device that accepts user utterances composed of voice or text for generating control information for controlling the device. Further, the dialogue device 10 may transmit control information to the external system 30 in order to operate a device managed by the external system 30. The dialogue device 10 is composed of, for example, a computer such as a server, but the devices constituting the dialogue device 10 are not limited.

The external system 30 constitutes a device management system that manages devices such as so-called IoT (Internet of Things) devices including home appliances and the like. The external system 30 can communicate with a plurality of devices according to their respective communication standards.

The external system 30 has setting information for each device that can configure an interface for controlling each device, and is managed based on the control information received from the dialogue device 10 by using and referring to the setting information. You can control any of the devices in.

The setting information storage unit 31 is a storage means for storing the setting information of the device to be controlled. The setting information is information used and referred to for controlling the device. Details of the setting information will be described later. In the example shown in FIG. 1, the setting information storage unit 31 is configured in the external system 30, but is not limited to such a configuration, and if it can be accessed from the external system 30, the external system 30 It may be configured outside.

The terminal 50 is a device that constitutes an interface with a user in controlling a device by speaking, and is composed of, for example, a stationary or portable personal computer, a high-performance mobile phone (smartphone), or the like. The device constituting the device is not limited, and may be a mobile terminal such as a mobile phone or a personal digital assistant (PDA).

The terminal 50 can transmit the voice data uttered to the user to the dialogue device as the user utterance. Further, the terminal 50 may transmit the data obtained by converting the user's voice into text by voice recognition processing to the dialogue device 10 as a user's utterance.

Further, the terminal 50 can present the utterance sentence transmitted from the dialogue device 10 to the user, as will be described later. Specifically, the terminal 50 presents the utterance sentence to the user by displaying the text indicating the utterance sentence on the display. Further, the terminal 50 may display an operation object on the display, which is associated with a text indicating an utterance sentence and can be instructed. The operation object may be displayed in the form of a button that can be operated by the user. When the operation for the displayed operation object is accepted, the terminal 50 uses the information indicating that the operation object has been operated, the text data or the voice data of the utterance text associated with the operation object as the user's utterance, and the dialogue device. It may be transmitted to 10.

FIG. 2 is a diagram showing a functional configuration of the dialogue device 10 according to the present embodiment. As shown in FIG. 2, the dialogue device 10 includes a position acquisition unit 11, a time acquisition unit 12, a setting information acquisition unit 13, a device extraction unit 14, a phrase extraction unit 15, a generation unit 16, a presentation unit 17, and an utterance reception unit 18. And the control instruction transmitting unit 19. Further, the dialogue device 10 includes a vocabulary information storage unit 20. Each functional unit included in the dialogue device 10 may be distributed and configured in a plurality of devices, or for example, some functional units may be configured in the terminal 50.

The block diagram shown in FIG. 2 shows a block for each function. These functional blocks (components) are realized by any combination of hardware and / or software. Further, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one physically and / or logically coupled device, or directly and / or indirectly by two or more physically and / or logically separated devices. (For example, wired and / or wireless) may be connected and realized by these a plurality of devices.

Functions include judgment, decision, judgment, calculation, calculation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, solution, selection, selection, establishment, comparison, assumption, expectation, and assumption. Broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, assigning, etc., but limited to these I can't. For example, a functional block (component) that functions transmission is called a transmitting unit or a transmitter. As described above, the method of realizing each of them is not particularly limited.

For example, the dialogue device 10 in one embodiment of the present invention may function as a computer. FIG. 3 is a diagram showing an example of the hardware configuration of the dialogue device 10 according to the present embodiment. The dialogue device 10 may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

In the following description, the word "device" can be read as a circuit, a device, a unit, or the like. The hardware configuration of the dialogue device 10 may be configured to include one or more of the devices shown in FIG. 3, or may be configured not to include some of the devices.

Each function in the dialogue device 10 is performed by loading predetermined software (program) on hardware such as the processor 1001 and the memory 1002, so that the processor 1001 performs an calculation, and communication by the communication device 1004, memory 1002, and storage 1003 are performed. It is realized by controlling the reading and / or writing of the data in.

Processor 1001 operates, for example, an operating system to control the entire computer. The processor 1001 may be composed of a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic unit, a register, and the like. Further, the processor 1001 may be configured to include a GPU (Graphics Processing Unit). For example, each of the functional units 11 to 19 shown in FIG. 2 may be realized by the processor 1001.

Further, the processor 1001 reads a program (program code), a software module, and data from the storage 1003 and / or the communication device 1004 into the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operations described in the above-described embodiment is used. For example, each functional unit 11 to 19 of the dialogue device 10 may be realized by a control program stored in the memory 1002 and operated by the processor 1001. Although it has been described that the various processes described above are executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. Processor 1001 may be mounted on one or more chips. The program may be transmitted from the network via a telecommunication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be done. The memory 1002 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, or the like that can be executed to carry out the dialogue method according to the embodiment of the present invention.

The storage 1003 is a computer-readable recording medium, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, an optical magnetic disk (for example, a compact disk, a digital versatile disk, a Blu-ray). It may consist of at least one (registered trademark) disk), smart card, flash memory (eg, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, and the like. The storage 1003 may be referred to as an auxiliary storage device. The storage medium described above may be, for example, a database, server or other suitable medium containing memory 1002 and / or storage 1003.

The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like.

The input device 1005 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives an input from the outside. The output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that outputs to the outside. The input device 1005 and the output device 1006 may have an integrated configuration (for example, a touch panel).

Further, each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. Bus 1007 may be composed of a single bus, or may be composed of different buses between devices.

Further, the dialogue device 10 includes hardware such as a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). It may be configured, and the hardware may realize a part or all of each functional block. For example, processor 1001 may be implemented on at least one of these hardware.

Each functional unit of the dialogue device 10 will be described with reference to FIG. 2 again. The position acquisition unit 11 acquires position information indicating the location of the user. Specifically, the position acquisition unit 11 acquires position information acquired by, for example, a GPS device (not shown) included in the user's terminal 50. The position acquisition unit 11 may acquire the position information based on the detection information detected by the motion sensor (not shown) provided in the space to which the dialogue system 1 of the present embodiment is applied. Further, when the terminal 50 is a mobile wireless communication terminal, the position acquisition unit 11 may acquire the service area information of the terminal 50 as the position information. The position acquisition unit 11 may acquire the user's position information by another well-known method.

The time acquisition unit 12 acquires information indicating the current time.

The setting information acquisition unit 13 acquires the setting information. Specifically, the setting information acquisition unit 13 acquires setting information from the setting information storage unit 31 of the external system 30. The setting information includes the attributes of each device and is referred to for device control.

FIG. 4 is information showing an example of the configuration of the setting information storage unit 31 and the stored data. As shown in FIG. 4, the setting information storage unit 31 stores various attributes as setting information in association with the device ID that identifies the device. In the example shown in FIG. 4, the setting information storage unit 31 stores setting information such as a device, a nickname, a group, a device status, and a usage log indicating the category of the device for each device ID. For example, the setting information storage unit 31 associates with the device ID "1" with setting information such as the device "TV", the nickname "Dad's TV", the group "living room", the device status "OFF", and the usage log "L1". I remember.

The setting information includes at least "group" information. The "group" can be information indicating the location where the device is provided. Further, the "group" may be other information for grouping a plurality of devices.

Further, the setting information may include a usage log (history information) which is information related to the control history of the device for each time zone or time. That is, the setting information acquisition unit 13 can configure a history information acquisition unit that acquires a usage log as history information.

FIG. 5 is a diagram showing an example of a usage log. FIG. 5A is a diagram schematically showing the usage log L1 of the device ID “1”. FIG. 5B is a diagram schematically showing the usage log L2 of the device ID “2”. As shown in FIGS. 5A and 5B, the usage log includes the time when the control is executed, the user who controlled the device, and the control contents as the control history of the device.

For example, as shown in FIG. 5A, the device "television" with the device ID "1" is controlled by the user "father" indicated by the user ID "U1" at the time "t1". Has been implemented. Further, for example, as shown in FIG. 5B, the device "light" of the device ID "2" is controlled by the user "mother" indicated by the user ID "U2" at the time "t12". "OFF" is being implemented.

With reference to FIG. 4 again, the setting information may further include a nickname and device information as the setting information. The nickname is a name for pointing to the device in the utterance. It is possible for multiple users to set their respective nicknames for one device. In setting the nickname, each device needs to be uniquely identified from the user's point of view. The device state is information indicating the operating state of the device and is updated in real time.

The setting information acquisition unit 13 may collectively acquire a predetermined amount of setting information at a predetermined timing in a standby state for receiving a user utterance. Further, the setting information acquisition unit 13 may acquire necessary setting information each time the setting information is referred to by the device extraction unit 14 and the phrase extraction unit 15 and the like, which will be described in detail later.

The device extraction unit 14 refers to the setting information and extracts the device associated with the position information acquired by the position acquisition unit 11. As described above, since the setting information includes the association between the device and the group indicating the location of the device, the device extraction unit 14 can extract the device located at the user's location by referring to the setting information. ..

For example, when the position information acquired by the position acquisition unit 11 indicates that the user's location is the living room, the device extraction unit 14 refers to the setting information shown in FIG. The device ID "1" "TV", the device ID "2" "light", the device ID "3" "light", and the device ID "5" "air conditioner" are extracted. ..

The phrase extraction unit 15 refers to the vocabulary information and extracts one or more instruction phrases associated with the device extracted by the device extraction unit 14. Vocabulary information is information that associates each device with an instruction phrase that represents a control instruction for the device and includes at least one phrase or sentence. The phrase extraction unit 15 extracts an instruction phrase by referring to the vocabulary information stored in the vocabulary information storage unit 20.

FIG. 6 is a diagram showing an example of the configuration of the vocabulary information storage unit 20 and the stored data. As shown in FIG. 6, the vocabulary information storage unit 20 stores vocabulary information in which at least an instruction phrase is associated with a device category indicating a device type. The vocabulary information storage unit 20 may further include control contents, setting items, and fluctuation absorbing words in association with the device category.

The control content is the purpose achieved by uttering the associated instruction phrase and indicates the content of the control performed on the device. The setting item is a phrase related to the parameter change width, etc., which is added as an option to the instruction phrase, for example, when the control content is related to the change of the device parameter. The fluctuation absorption phrase is a dictionary for absorbing the fluctuation of the user-spoken phrase in response to the presentation of the utterance sentence including the instruction phrase.

For example, when the device extracted by the device extraction unit is "TV", the phrase extraction unit 15 has the instruction phrases "attach", "kete", and "volume" associated with the device category "TV". "Raise", "Turn down" and "Change channel" are extracted from the vocabulary information.

Further, the phrase extraction unit 15 may extract an instruction phrase based on the control history of the device corresponding to the current time. Specifically, the phrase extraction unit 15 refers to the usage log of the setting information (see FIG. 4) and acquires the control history of the device in the time zone or time corresponding to the current time from the usage log (see FIG. 5). do.

For example, when the time "t3" corresponds to the current time, the phrase extraction unit 15 acquires the control history (time "t3", user "U1", control content "ON"). Then, the phrase extraction unit 15 extracts the instruction phrase "attach" corresponding to the control content "ON" from the instruction phrases associated with the device "TV" corresponding to the extracted control history.

The phrase extraction unit 15 may extract the control history by narrowing down the usage log to be referred to to the device usage log extracted by the device extraction unit 14 when extracting the control history corresponding to the current time. good. Further, the phrase extraction unit 15 may extract the control history corresponding to the current time after narrowing down the control history included in the usage log to the control history of the user of the terminal 50. Information about the user of the terminal 50 can be obtained, for example, by a method based on account information or the like, or by other well-known methods.

The generation unit 16 generates an utterance sentence for controlling the device based on the instruction phrase extracted by the phrase extraction unit 15. Specifically, the generation unit 16 may generate the instruction phrase extracted by the phrase extraction unit 15 as an utterance sentence.

Further, the generation unit 16 may generate an utterance sentence by adding a device category associated with the instruction phrase extracted by the phrase extraction unit 15 to the instruction phrase as a phrase indicating a control target. For example, when the phrase extraction unit 15 extracts the instruction phrase "attach" corresponding to the control content "ON" of the device "TV", the generation unit 16 outputs "TV" and particles indicating the control target. The utterance sentence "Turn on TV" may be generated by adding it to the instruction phrase "Take on".

Further, when the instruction phrase extracted by the phrase extraction unit 15 is intended to change the parameter of the device, the generation unit 16 adds a phrase indicating the change width to the instruction phrase to add an utterance sentence. It may be generated. For example, when the phrase extraction unit 15 extracts the instruction phrase "increase the temperature" corresponding to the control content "increase the set temperature" of the device "air conditioner", the generation unit 16 is a parameter of the air conditioner. Add the words "a little" and "2 degrees" stored in the setting items as words indicating the range of temperature change to the instruction phrase, and the utterances "raise the temperature a little" and "raise the temperature twice". May be generated.

The presentation unit 17 presents the utterance sentence generated by the generation unit 16 to the user. Specifically, the presentation unit 17 transmits text information indicating the utterance sentence to the user's terminal 50, and displays the text indicating the utterance sentence on the display of the terminal 50.

FIG. 7 is a diagram showing a screen example of the user's terminal 50 on which the utterance sentence is displayed. As shown in FIG. 7, the screen D of the terminal 50 includes texts b1 and b2 indicating utterance sentences. By presenting the text indicating the generated utterance sentence on the user's terminal 50 in this way, the user can utter the utterance sentence.

Further, the presentation unit 17 may display an operation object on the user's terminal 50, which is associated with a text indicating an utterance sentence and can be instructed to operate. In this case, in the screen example of FIG. 7, the presentation unit 17 configures each of the text b1 and the text b2 as operation objects such as buttons that can be instructed and operated by the user, and displays them on the display D. When the presenting unit 17 displays such an operation object on the terminal 50, the dialogue device 10 accepts a user utterance composed of voice of the text content when the operation object is operated on the user's terminal 50. Generate the same device control information as in the case of.

The utterance reception unit 18 accepts the user's utterance as the user's utterance. Specifically, the utterance reception unit 18 receives a voice or text representing an utterance uttered by the user presented with the utterance sentence to the terminal 50 as a user utterance via the terminal 50.

Further, when an operation object such as a button associated with the utterance sentence is presented on the terminal 50 and an instruction operation for the operation object is received on the terminal 50, the utterance reception unit 18 indicates that the operation object has been operated. Accept information as user utterances.

The control instruction transmission unit 19 transmits control information for controlling a device managed by the external system 30 based on the user's utterance. Specifically, when a user utterance composed of voice data is received by the utterance receiving unit 18, the control instruction transmitting unit 19 performs voice recognition processing, morphological analysis, and predetermined analysis processing on the user utterance. By doing so, control information for controlling the device is generated, and the generated control information is transmitted to the external system 30. When the user's utterance is accepted as text data, the voice recognition process is unnecessary.

When the information indicating that the operation object has been operated is accepted as the user utterance, the control instruction transmission unit 19 considers that the text data of the utterance sentence associated with the operation object is accepted as the user utterance. , Morphological analysis of the text data and predetermined analysis processing are performed to generate control information for controlling the device.

Next, the processing contents in the dialogue device 10 will be described with reference to FIG. FIG. 8 is a flowchart showing the processing contents of the dialogue method of the present embodiment.

In step S1, the dialogue device 10 is controlled to the reception standby state of the user's utterance. Specifically, the utterance reception unit 18 is controlled to be in a reception standby state for user utterances.

In step S2, the setting information acquisition unit 13 acquires the setting information from the setting information storage unit 31 of the external system 30.

In step S3, the position acquisition unit 11 acquires position information indicating the location of the user. Specifically, the position acquisition unit 11 is based on, for example, a GPS device (not shown) provided in the user's terminal 50, and a motion sensor provided in a space to which the dialogue system 1 of the present embodiment is applied. Acquire the user's location information based on the detected detection information.

In step S4, the position acquisition unit 11 determines whether or not the acquisition of the user's position information in step S3 is successful. If it is determined that the acquisition of the position information is successful, the process proceeds to step S5. On the other hand, if it is not determined that the acquisition of the position information is successful, the process proceeds to step S8.

In step S5, the device extraction unit 14 refers to the setting information and extracts the device associated with the position information acquired by the position acquisition unit 11 in step S3. As described above, since the setting information includes the association between the device and the group indicating the location of the device, the device extraction unit 14 is located at the location of the user by referring to the information of the group of the setting information. Devices can be extracted.

In step S6, the phrase extraction unit 15 refers to the vocabulary information and extracts one or more instruction phrases associated with the device extracted by the device extraction unit 14 in step S5.

In step S7, the generation unit 16 generates an utterance sentence for controlling the device based on the device extracted by the device extraction unit 14 in step S5 and the instruction phrase extracted by the phrase extraction unit 15 in step S6. ..

On the other hand, in step S8, the generation unit 16 generates an utterance sentence that does not depend on the type of device. Specifically, for example, the generation unit 16 may generate an utterance sentence based on an instruction frame randomly extracted from the vocabulary information. Further, the generation unit 16 may refer to the history of user utterances received by the utterance reception unit 18 and use the most recently received user utterance as the utterance sentence.

In step S9, the presentation unit 17 presents the utterance sentence generated by the generation unit 16 to the user. Specifically, the presentation unit 17 transmits text information indicating the utterance sentence to the user's terminal 50, and displays the text indicating the utterance sentence on the display of the terminal 50.

Next, another example of the processing content in the dialogue device 10 will be described with reference to FIG. FIG. 9 is a flowchart showing the processing contents of the dialogue method of the present embodiment. In the process shown in FIG. 8, the user's position information is used, whereas in the process shown in FIG. 9, the current time information is used in addition to the user's position information.

The processing of steps S11 to S15 is the same as the processing of steps S1 to S5 shown in FIG. If it is not determined in step S14 that the acquisition of the position information is successful, the process proceeds to step S21.

In step S16, the time acquisition unit 12 acquires information indicating the current time. In step S17, the time acquisition unit 12 determines whether or not the acquisition of the information indicating the current time has been successful. If it is determined that the acquisition of the current time is successful, the process proceeds to step S18. On the other hand, if it is not determined that the acquisition of the current time is successful, the process proceeds to step S21.

In step S18, the setting information acquisition unit 13 acquires the control history of the device acquired in step S15 in the time zone or time corresponding to the current time acquired in step S16. The time zone corresponding to the current time is, for example, a time zone having a predetermined width including the current time.

In step S19, the phrase extraction unit 15 extracts the instruction phrase associated with the control content shown in the control history acquired in step S18 with respect to the device acquired in step S15 with reference to the vocabulary information.

In step S20, the generation unit 16 generates an utterance sentence for controlling the device based on the device extracted by the device extraction unit 14 in step S15 and the instruction phrase extracted by the phrase extraction unit 15 in step S19. ..

On the other hand, in step S21, the generation unit 16 generates an utterance sentence that does not depend on the type of device and the current time. Specifically, for example, the generation unit 16 may generate an utterance sentence based on an instruction frame randomly extracted from the vocabulary information. Further, the generation unit 16 may refer to the history of user utterances received by the utterance reception unit 18 and use the most recently received user utterance as the utterance sentence.

In step S22, the presentation unit 17 presents the utterance sentence generated by the generation unit 16 to the user. Specifically, the presentation unit 17 transmits text information indicating the utterance sentence to the user's terminal 50, and displays the text indicating the utterance sentence on the display of the terminal 50.

Next, a dialogue program for causing the computer to function as the dialogue device 10 of the present embodiment will be described. FIG. 10 is a diagram showing the configuration of the dialogue program P1.

The dialogue program P1 is a main module m10, a position acquisition module m11, a time acquisition module m12, a setting information acquisition module m13, a device extraction module m14, a phrase extraction module m15, and a generation module m16 that collectively control the dialogue processing in the dialogue device 10. , Presentation module m17, speech reception module m18, and control instruction transmission module m19. Then, by each module m11 to m19, the position acquisition unit 11, the time acquisition unit 12, the setting information acquisition unit 13, the device extraction unit 14, the phrase extraction unit 15, the generation unit 16, the presentation unit 17, and the utterance reception unit in the dialogue device 10 are used. Each function for 18 and the control instruction transmitting unit 19 is realized. The dialogue program P1 may be transmitted via a transmission medium such as a communication line, or may be stored in the recording medium M1 as shown in FIG.

In the dialogue device 10 of the present embodiment described above, the device associated with the position information indicating the location information of the user is extracted, and the utterance sentence is generated based on the instruction phrase indicating the control instruction of the extracted device. Therefore, it is possible to present to the user an utterance sentence that can appropriately control the device that the user is likely to perform the control operation at the current location. Since it is highly possible that the user can control the desired device by speaking the presented utterance sentence, the convenience is improved.

Further, in the interactive device according to another form, the time acquisition unit that acquires the current time and the history information related to the control history of the device for each time zone or time are referred to, and the current time acquired by the time acquisition unit is supported. It further includes a history acquisition unit that acquires the control history of the device in the time zone or time of day, and the vocabulary information associates the control content and the instruction phrase for each device, and the phrase extraction unit is performed by the device extraction unit. The instruction phrase may be extracted based on the control content shown in the extracted device and the control history acquired by the history acquisition unit.

According to the above embodiment, the control history of the device in the time or time zone corresponding to the current time is extracted, and the utterance sentence is generated based on the instruction phrase corresponding to the control content shown in the extracted control history. As a result, it is possible to present to the user an utterance sentence capable of performing a control operation that is likely to be desired by the user at the current time.

Further, in the dialogue device according to another form, the history information may include the control history for each user, and the phrase extraction unit may extract the instruction phrase based on the control history of the user.

According to the above form, the utterance sentence is generated based on the instruction phrase corresponding to the control history of the user to whom the utterance sentence is presented. Therefore, a suitable utterance sentence can be presented to the user.

Further, in the dialogue device according to another form, the presenting unit may display a text indicating the utterance sentence on the user's terminal.

According to the above form, since the text indicating the generated utterance sentence is presented on the user's terminal, the user can utter the utterance sentence.

Further, in the dialogue device according to another form, the presentation unit displays an operation object associated with the text indicating the utterance sentence and can be instructed and operated on the user's terminal, and the dialogue device operates the operation object on the user's terminal. In this case, the control information of the device may be generated in the same manner as when the user utterance consisting of the voice of the text content is received.

According to the above form, an operation object associated with a text indicating the generated utterance sentence is displayed on the user terminal, and when the operation object is operated, the content of the utterance sentence is uttered by voice. Since similar control information is generated, the user can easily execute the desired control instruction.

Further, the dialogue device according to another form further includes a setting information acquisition unit that acquires setting information from the system that manages the setting information, and the device extraction unit collects the setting information acquired by the setting information acquisition unit. It may be referred to.

According to the above embodiment, since the utterance sentence is generated based on the setting information acquired in advance, the load of communication and processing for referring to the setting information each time the utterance sentence generation process is performed is reduced.

Although the present embodiment has been described in detail above, it is clear to those skilled in the art that the present embodiment is not limited to the embodiment described in the present specification. This embodiment can be implemented as a modified or modified mode without departing from the spirit and scope of the present invention determined by the description of the claims. Therefore, the description herein is for purposes of illustration only and has no limiting implications for this embodiment.

Each aspect / embodiment described in the present disclosure includes LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G, 5G, FRA (Future Radio Access), W-CDMA ( Registered Trademarks), GSM®, CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, UWB (Ultra-WideBand), Bluetooth It may be applied to (Registered Trademarks), other systems that utilize suitable systems and / or next-generation systems that are extended based on them.

The order of the processing procedures, sequences, flowcharts, etc. of each aspect / embodiment described in the present disclosure may be changed as long as there is no contradiction. For example, the methods described herein present elements of various steps in an exemplary order, and are not limited to the particular order presented.

Information and the like can be output from the upper layer (or lower layer) to the lower layer (or upper layer). Input / output may be performed via a plurality of network nodes.

The input / output information and the like may be stored in a specific location (for example, a memory) or may be managed by a management table. Input / output information and the like can be overwritten, updated, or added. The output information and the like may be deleted. The input information or the like may be transmitted to another device.

The determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (Boolean: true or false), or by comparing numerical values (for example, a predetermined value). It may be done by comparison with the value).

Each aspect / embodiment described in the present disclosure may be used alone, in combination, or switched with execution. Further, the notification of predetermined information (for example, the notification of "being X") is not limited to the explicit one, but is performed implicitly (for example, the notification of the predetermined information is not performed). May be good.

Software, whether referred to as software, firmware, middleware, microcode, hardware description language, or other names, is an instruction, instruction set, code, code segment, program code, program, subprogram, software module. , Applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc. should be broadly interpreted.

Further, software, instructions, and the like may be transmitted and received via a transmission medium. For example, the software uses wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave to websites, servers, or other When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

The information, signals, etc. described in the present disclosure may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may be represented by a combination of.

The terms described in the present disclosure and / or the terms necessary for understanding the present specification may be replaced with terms having the same or similar meanings.

The terms "system" and "network" used in this disclosure are used interchangeably.

Further, the information, parameters, etc. described in the present disclosure may be represented by an absolute value, a relative value from a predetermined value, or another corresponding information.

The terms "determining" and "determining" as used in this disclosure may include a wide variety of actions. "Judgment" and "decision" are, for example, judgment, calculation, computing, processing, deriving, investigating, looking up, search, inquiry. (For example, searching in a table, database or another data structure), ascertaining may be regarded as "judgment" or "decision". Also, "judgment" and "decision" are receiving (for example, receiving information), transmitting (for example, transmitting information), input (input), output (output), and access. (Accessing) (for example, accessing data in memory) may be regarded as "judgment" or "decision". In addition, "judgment" and "decision" mean that the things such as solving, selecting, choosing, establishing, and comparing are regarded as "judgment" and "decision". Can include. That is, "judgment" and "decision" may include considering some action as "judgment" and "decision". Further, "judgment (decision)" may be read as "assuming", "expecting", "considering" and the like.

The phrase "based on" as used in this disclosure does not mean "based on" unless otherwise stated. In other words, the statement "based on" means both "based only" and "at least based on".

In the use of such designations as "first", "second", etc. in the present disclosure, any reference to the elements does not generally limit the quantity or order of those elements. These designations can be used herein as a convenient way to distinguish between two or more elements. Thus, references to the first and second elements do not mean that only two elements can be adopted there, or that the first element must somehow precede the second element.

As long as "include", "including", and variations thereof are used within the scope of the present specification or claims, these terms are similar to the term "comprising". Is intended to be inclusive. Furthermore, the term "or" as used herein or in the claims is intended not to be an exclusive OR.

In the present disclosure, a plurality of devices shall be included unless the device has only one device apparently in context or technically.

In the whole of the present disclosure, if the context clearly does not indicate the singular, it shall include the plural.

10 ... Dialogue device, 11 ... Position acquisition unit, 12 ... Time acquisition unit, 13 ... Setting information acquisition unit, 14 ... Device extraction unit, 15 ... Phrase extraction unit, 16 ... Generation unit, 17 ... Presentation unit, 18 ... Speech reception Unit, 19 ... Control instruction transmission unit, 20 ... Lexical information storage unit, 30 ... External system, 31 ... Setting information storage unit, 50 ... Terminal, M1 ... Recording medium, m10 ... Main module, m11 ... Position acquisition module, m12 ... Time acquisition module, m13 ... Setting information acquisition module, m14 ... Device extraction module, m15 ... Phrase extraction module, m16 ... Generation module, m17 ... Presentation module, m18 ... Speech reception module, m19 ... Control instruction transmission module, P1 ... Dialogue program ..

Claims (7)

A dialogue device that accepts user utterances consisting of voice or text for generating control information that controls a device.
A position acquisition unit that acquires location information indicating the user's location,
A device extraction unit that extracts a device associated with the position information acquired by the position acquisition unit by referring to the setting information that associates each device with the location, and a device extraction unit.
One or more associated with the device extracted by the device extraction unit with reference to the vocabulary information associated with each device and an instruction phrase representing the control instruction of the device and including at least one phrase or sentence. Phrase extractor that extracts the instruction phrase of
A generation unit that generates an utterance sentence for controlling the device based on the instruction phrase extracted by the phrase extraction unit, and a generation unit.
A presentation unit that presents the utterance sentence generated by the generation unit to the user, and a presentation unit.
Dialogue device. The time acquisition unit that acquires the current time and
With reference to the history information about the control history of the device for each time zone or time, the history acquisition unit that acquires the control history of the device in the time zone or time corresponding to the current time acquired by the time acquisition unit. , And more
The vocabulary information associates the control content with the instruction phrase for each device.
The phrase extraction unit extracts the instruction phrase based on the control content shown in the device extracted by the device extraction unit and the control history acquired by the history acquisition unit.
The dialogue device according to claim 1. The history information includes a control history for each user.
The phrase extraction unit extracts the instruction phrase based on the control history of the user.
The dialogue device according to claim 2. The presenting unit causes the user's terminal to display a text indicating the utterance sentence.
The dialogue device according to any one of claims 1 to 3. The presenting unit causes the user's terminal to display an operation object that is associated with a text indicating the utterance sentence and can be instructed to operate.
When the operation object is operated on the terminal of the user, the dialogue device generates control information of the device similar to the case where the user utterance composed of the voice of the content of the text is received.
The dialogue device according to any one of claims 1 to 4. A setting information acquisition unit for acquiring the setting information from the system that manages the setting information is further provided.
The device extraction unit refers to the setting information acquired by the setting information acquisition unit.
The dialogue device according to any one of claims 1 to 5. A dialogue program that allows a computer to function as a dialogue device that accepts user utterances consisting of voice or text to generate control information that controls a device.
On the computer
A location acquisition function that acquires location information indicating the user's location, and
A device extraction function that extracts a device associated with the position information acquired by the position acquisition function by referring to the setting information associated with each device and the location, and a device extraction function.
One or more associated with the device extracted by the device extraction function with reference to the vocabulary information associated with each device and an instruction phrase representing the control instruction of the device and including at least one phrase or sentence. Phrase extraction function that extracts the instruction phrase of
A generation function for generating an utterance sentence for controlling the device based on the instruction phrase extracted by the phrase extraction function, and a generation function.
A presentation function for presenting the utterance sentence generated by the generation function to the user, and
A dialogue program that realizes.

Images