JP6752870B2 - Methods and systems for controlling artificial intelligence devices using multiple wake words - Google Patents

Description

The following description relates to an artificial intelligence dialogue system.

Generally, artificial intelligence dialogue systems used in personal secretary systems, artificial intelligence (AI) speakers, chatbot platforms, etc. understand the intent of human-issued command words and respond to them. The method of providing is adopted.

Mainly, the artificial intelligence dialogue system adopts a method in which a machine provides an answer to such a human request when a functional request is transmitted from a human, and a user's voice input is input by a microphone (microphone). It will receive and control the operation of the device and the provision of content based on the received voice input.

For example, in Patent Document 1 (publication date: December 30, 2011), in the home network service, the home network service is provided by using a second communication network such as Wi-Fi in addition to the mobile communication network. A technology is disclosed that enables a plurality of multimedia devices in a home to be multi-controlled by voice commands without the user having to operate a button.

A general artificial intelligence dialogue system uses a predetermined wake word (for example, the name of a device) as a dialogue activation trigger for activating (wake-up) the device. As a result, the artificial intelligence device will execute the voice recognition function based on the wake word. For example, the device is activated when the user issues a machine name, and enters a standby mode for receiving a subsequent user's voice command (question).

Korean Publication No. 10-2011-0139977

Provided are a method and a system capable of classifying a wake word of an artificial intelligence device that provides a voice-based interface into two or more, and controlling the operation of the artificial intelligence device so as to be different for each wake word.

It is an artificial intelligence dialogue method implemented by an electronic device realized by a computer, and when the voice interface of the electronic device recognizes any one of a plurality of preset wake words, Artificial intelligence includes a step of activating the dialogue function and a step of controlling a voice command input in the state where the dialogue function is activated so as to perform a different operation according to the recognized wake word. Provide a way of dialogue.

According to one aspect, for each action that can be performed on the electronic device, a step of setting a wake word for identifying the action may be further included.

According to another aspect, the wake word and the operation of each wake word may be personalized to the user of the electronic device.

Further according to another aspect, the wake word includes a basic wake word and an additional wake word, and the control step includes a step of pairing with another device connected to the network such as the electronic device. When the dialogue function is activated by the basic wake word, the operation corresponding to the voice command is executed by the electronic device, and when the dialogue function is activated by the additional wake word, the voice command is executed. The voice command may be transmitted to the other device so that the corresponding operation is performed on the other device.

According to another aspect, the pairing step may search for other devices connected to the network and pair with the device that responds to the search signal.

Further, according to another aspect, when there are a plurality of other devices paired with the electronic device, the step of setting the additional wake word to be different for each device may be further included.

According to another aspect, the control step may call a different engine according to the recognized wake word and output the response information corresponding to the voice command from the engine.

According to yet another aspect, the activation step may include a step of distinguishing and displaying the activation state according to the recognized wake word.

Provided is a computer program stored in a computer-readable recording medium in combination with a computer to cause the computer to perform the artificial intelligence interaction method.

Provided is a computer-readable recording medium, characterized in that a program for causing a computer to execute the artificial intelligence dialogue method is recorded.

An artificial intelligent dialogue system of an electronic device realized by a computer, including at least one processor realized to execute a computer-readable instruction, the at least one processor performing the interactive function of the electronic device. Dialogue for activation When a wake word for setting two or more wake words used as an activation trigger, or one of the wake words is recognized by the voice interface of the electronic device, the wake word is described. An activation unit that activates the dialogue function, and an operation execution unit that controls a voice command input in a state where the dialogue function is activated so as to execute a different operation according to the recognized wake word. Provide an artificial intelligence dialogue system to be equipped.

According to the embodiment of the present invention, the wake word of the artificial intelligence device that provides the voice-based interface can be divided into two or more, and the operation of the artificial intelligence device can be controlled differently according to each wake word.

It is a figure which showed the example of the service environment which utilized the voice-based interface in one Embodiment of this invention. It is a figure which showed the other example of the service environment which utilized the voice-based interface in one Embodiment of this invention. It is a figure which showed the example of the cloud artificial intelligence platform in one Embodiment of this invention. It is a block diagram for demonstrating the internal structure of an electronic device and a server in one Embodiment of this invention. It is a block diagram which showed the example of the component which can include the processor of the electronic device in one Embodiment of this invention. It is a flowchart which showed the example of the artificial intelligence dialogue method which an electronic device can execute in one Embodiment of this invention. It is a figure which showed the example of the device operation of a plurality of wake words and each wake word in one Embodiment of this invention. It is a figure which showed the example of the control environment using a plurality of wake words in one Embodiment of this invention. It is a flowchart which showed the example of the process of controlling the operation of an electronic device by using a plurality of wake words in one Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The artificial intelligence dialogue system according to the embodiment of the present invention may be realized by an electronic device that provides an interface that operates on the basis of dialogue with a user. At this time, the artificial intelligence dialogue system may use two or more wake words to activate (wake-up) the device, and may divide the operation of the device according to each wake word.

The artificial intelligence dialogue method according to the embodiment of the present invention may be executed by the above-mentioned electronic device. At this time, the computer program according to the embodiment of the present invention may be installed and driven in the electronic device, and the electronic device uses the artificial intelligence dialogue method according to the embodiment of the present invention under the control of the driving computer program. You may do it. The computer program described above may be stored in a computer-readable recording medium in order to combine with an electronic device realized by the computer to cause the computer to execute an artificial intelligence dialogue method.

FIG. 1 is a diagram showing an example of a service environment utilizing a voice-based interface according to an embodiment of the present invention. In the embodiment of FIG. 1, in a technique for connecting and controlling home devices such as a smart home and a home network service, an electronic device 100 that provides an interface that operates based on voice is a user 110. An example of recognizing and analyzing the voice input "turn off the light" received by utterance and controlling the power supply of the home lighting device 120 connected to the electronic device 100 via the internal network in the home is shown.

For example, in-house devices include not only the above-mentioned in-house lighting device 120, but also home appliances such as TVs, PCs (Personal Computers), peripheral devices, air conditioners, refrigerators, robot cleaners, etc., as well as water, electricity, and air conditioning. It may include a variety of devices that are connected and controlled online, such as energy consuming devices such as devices and security devices such as door locks and surveillance cameras. In addition, wired network technologies such as Ethernet (registered trademark), HomePNA, and IEEE 1394, as well as Bluetooth (registered trademark), UWB (ultra Wide Band), and ZigBee (registered) are included in the internal network. Wireless network technology such as Bluetooth 1394, Home RF, etc. may be utilized.

The electronic device 100 may be one of the devices in the home. For example, the electronic device 100 may be one of devices such as an artificial intelligence speaker and a robot cleaner provided in the house. The electronic device 100 includes a smartphone (smart phone), a mobile phone, a navigation system, a notebook pancon, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a tablet, a game console, a wearable device, and an IoT. It may be a mobile device of the user 110 such as an (internet of things) device, a VR (virtual reality) device, an AR (augmented reality) device, and the like. As described above, the electronic device 100 is not particularly limited as long as it is a device including a function that can be connected to the device in the house in order to receive the voice input of the user 110 and control the device in the house. Further, depending on the embodiment, the mobile device of the user 110 described above may be included as a device in the home.

FIG. 2 is a diagram showing another example of a service environment utilizing a voice-based interface according to an embodiment of the present invention. In FIG. 2, an electronic device 100 that provides an interface that operates based on voice recognizes and analyzes the voice input “today's weather” received by the utterance of the user 110, and from an external server 210 via an external network today. An example of acquiring information about the weather and outputting the acquired information by voice such as "Today's weather is ..." is shown.

For example, the external network includes PAN (personal area network), LAN (local area network), CAN (campus area network), MAN (metropolitan area network), WAN (wide network), WAN (wide network), etc. It may include any one or more of the networks.

Also in the embodiment of FIG. 2, the electronic device 100 may be one of the devices in the home or one of the mobile devices of the user 110, and receives and processes the voice input of the user 110. The device is not particularly limited as long as it includes a function for providing the service and a function for connecting to the external server 210 via an external network and providing services and contents provided by the external server 210 to the user 110.

As described above, the electronic device 100 according to the embodiment of the present invention is not particularly limited as long as it is a device capable of processing a user command including a voice input received by the utterance of the user 110 on the voice platform interface. Good. For example, the electronic device 100 may process the user command by directly recognizing and analyzing the user's voice input and performing an operation suitable for the voice input, but in some embodiments, the electronic device 100 recognizes the user's voice input. And processing such as analysis of the recognized voice input and synthesis of voice provided to the user may be executed on an external platform linked with the electronic device 100.

FIG. 3 is a diagram showing an example of a cloud artificial intelligence platform according to an embodiment of the present invention. FIG. 3 shows an electronic device 310, a cloud artificial intelligence platform 320, and a content service 330.

As an example, the electronic device 310 may mean a device provided in the home, and may include at least the electronic device 100 described above. Such an electronic device 310 or an application installed and driven on the electronic device 310 (hereinafter, referred to as “application”) can be linked with the cloud artificial intelligence platform 320 via the interface connect 340. Here, the Interface Connect 340 may provide the developer with an SDK (Software Development Kit) and / or a development document for developing an electronic device 310 or an application installed and driven on the electronic device 310. In addition, Interface Connect 340 provides an API (Application Program Interface) that enables an electronic device 310 or an application installed and driven on the electronic device 310 to utilize the functions provided by the cloud artificial intelligence platform 320. You can. As a specific example, the developer uses the SDK and / or the development document provided by Interface Connect 340 to develop a device or application using the API provided by Interface Connect 340 to create a cloud artificial intelligence platform 320. Allows you to take advantage of the features provided by.

Here, the cloud artificial intelligence platform 320 may provide a function for providing a voice-based service. For example, the cloud artificial intelligence platform 320 has an audio processing module 321 for recognizing received audio and synthesizing output audio, a vision processing module 322 for analyzing and processing received video and video, and received audio. Dialogue processing module 323 for determining the appropriate dialogue to output the voice suitable for the received voice, recommendation module 324 for recommending the function suitable for the received voice, artificial intelligence uses the language in sentence units based on data learning. It may include various modules for providing voice-based services, such as Neural Machine Translation (NMT) 325, which assists in translating.

For example, in the embodiments of FIGS. 1 and 2, the electronic device 100 may transmit the voice input of the user 110 to the cloud artificial intelligence platform 320 using the API provided by the interface connect 340. In this case, the cloud artificial intelligence platform 320 may recognize and analyze the received voice input by utilizing the modules 321 to 325 described above, and synthesize and provide an appropriate response voice according to the received voice input. , You may recommend the appropriate operation.

Further, the expansion kit 350 may provide a development kit that enables a third-party content developer or a company to realize a new voice-based function based on the cloud artificial intelligence platform 320. For example, in the embodiment of FIG. 2, the electronic device 100 may transmit the voice input of the user 110 to the external server 210, and the external server 210 utilizes the API provided by the expansion kit 350 to be a cloud artificial intelligence platform. A voice input may be transmitted to the 320. In this case, as described above, the cloud artificial intelligence platform 320 recognizes and analyzes the received voice input, synthesizes and provides an appropriate response voice, and recommends information for a function to be processed according to the voice input. May be provided to the external server 210. As an example, in FIG. 2, the external server 210 transmits the voice input “today's weather” to the cloud artificial intelligence platform 320, and the keyword “today's weather” is extracted from the cloud artificial intelligence platform 320 by recognizing the voice input “today's weather”. Suppose you receive "today's" and "weather". In this case, the external server 210 generates text information such as "Today's weather is ..." based on the keywords "today" and "weather", and transfers the generated text information to the cloud artificial intelligence platform 320. You may resend. At this time, the cloud artificial intelligence platform 320 may synthesize text information by voice and provide it to the external server 210. The external server 210 may transmit the synthesized voice to the electronic device 100, and the electronic device 100 receives the synthesized voice from the user 110 by outputting the synthesized voice “Today's weather is ...” from the speaker. It can process the voice input "Today's weather". At this time, the electronic device 100 is for carrying out device operation and content provision based on a dialogue with the user.

FIG. 4 is a block diagram for explaining the internal configurations of the electronic device and the server according to the embodiment of the present invention. The electronic device 410 of FIG. 4 may correspond to the electronic device 100 described above, and the server 420 may correspond to the external server 210 described above or one computer device realizing the cloud artificial intelligence platform 320.

The electronics 410 and the server 420 may include memories 411, 421, processors 412, 422, communication modules 413, 423, and input / output interfaces 414, 424, respectively. The memories 411 and 421 are computer-readable recording media, such as a RAM (random access memory), a ROM (read only memory), a disk drive, an SSD (solid state drive), and a flash memory (flash memory). Permanent mass storage device may be included. Here, a permanent large-capacity storage device such as a ROM, SSD, flash memory, disk drive, etc. may be included in the electronic device 410 or the server 420 as another permanent storage device classified from the memories 411 and 421. .. In addition, the memories 411 and 421 contain an operating system and at least one program code (for example, a code for an application installed in the electronic device 410 and driven by the electronic device 410 to provide a specific service). May be stored. Such software components may be loaded from a computer-readable recording medium other than the memories 411 and 421. Such other computer-readable recording media may include computer-readable recording media such as floppy (registered trademark) drives, disks, tapes, DVD / CD-ROM drives, and memory cards. In other embodiments, software components may be loaded into memory 411,421 through communication modules 413, 423, which are not computer readable recording media. For example, at least one program is an electronic device 410 based on a computer program (as an example, the application described above) installed by a file provided by a file distribution system that distributes a developer or application installation file over network 430. It may be loaded into the memory 411 of.

Processors 412 and 422 may be configured to process instructions in a computer program by performing basic arithmetic, logic, and input / output operations. Instructions may be provided to processors 412, 422 by memory 411, 421 or communication modules 413, 423. For example, processors 412 and 422 may be configured to execute instructions received according to program code stored in storage devices such as memories 411 and 421.

The communication modules 413 and 423 may provide a function for the electronic device 410 and the server 420 to communicate with each other via the network 430, and the electronic device 410 and / or the server 420 may be another electronic device or another server. May provide the ability to communicate with. As an example, a request generated by the processor 412 of the electronic device 410 according to a program code stored in a storage device such as the memory 411 may be transmitted to the server 420 via the network 430 under the control of the communication module 413. On the contrary, control signals, instructions, contents, files, etc. provided under the control of the processor 422 of the server 420 are received by the electronic device 410 through the communication module 413 of the electronic device 410 via the communication module 423 and the network 430. You may. For example, control signals, commands, contents, files, etc. of the server 420 received through the communication module 413 may be transmitted to the processor 412 and the memory 411, and the contents, files, etc. may be further included in the electronic device 410. It may be stored in (permanent storage device described above).

The input / output interface 414 may be a means for an interface with the input / output device 415. For example, the input device may include devices such as a keyboard, mouse, microphone, camera, and the output device may include devices such as a display, speaker, haptic feedback device (haptic feedback device), and the like. As another example, the input / output interface 414 may be a means for an interface with a device such as a touch screen in which functions for input and output are integrated into one. The input / output device 415 may be composed of an electronic device 410 and one device. Also, the input / output interface 424 of the server 420 may be a means for interfacing with a device (not shown) for input or output that can be linked to or included in the server 420. Good. As a more specific example, when the processor 412 of the electronic device 410 processes an instruction of a computer program loaded in the memory 411, a service screen configured by using data provided by the server 420 or another electronic device or the like. The content may be displayed on the display via the input / output interface 414.

Also, in other embodiments, the electronics 410 and the server 420 may include fewer or more components than the components of FIG. However, most prior art components need not be clearly illustrated. For example, the electronic device 410 may be realized to include at least a part of the above-mentioned input / output device 415, such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, and the like. Other components may be further included. As a more specific example, when the electronic device 410 is a smartphone, acceleration sensors and gyro sensors, motion sensors, camera modules, various physical buttons, buttons using a touch panel, and inputs generally included in the smartphone are used. Various components such as / output ports, vibrators for vibration, etc. may be implemented to be further included in the electronic device 410.

In the present embodiment, the electronic device 410 may basically include a microphone for receiving the user's voice input as the input / output device 415, and sounds such as a response voice or audio content corresponding to the user's voice input. A speaker for outputting the above may be further included as an input / output device 415.

FIG. 5 is a block diagram showing an example of components that can be included in the processor of the electronic device according to the embodiment of the present invention, and FIG. 6 is a block diagram shown by the electronic device according to the embodiment of the present invention. It is a flowchart which showed the example of the artificial intelligence dialogue method which can be done.

An artificial intelligence dialogue system can be configured in the electronic device 410 according to the present embodiment. The artificial intelligence dialogue system may consist of a PC-based program or an application dedicated to a mobile terminal. The artificial intelligence dialogue system in the present embodiment can be realized in a program form that operates independently, or can be configured in an in-app form of a specific application and can operate on the specific application. It may be realized as it is.

For example, the artificial intelligence dialogue system realized in the electronic device 410 may execute the artificial intelligence dialogue method based on the instruction provided by the application installed in the electronic device 410. In order to execute the artificial intelligence dialogue method according to FIG. 6, the processor 412 of the electronic device 410 may include a setting unit 510, an activation unit 520, and an operation execution unit as components, as shown in FIG. it can. In some embodiments, the components of processor 412 may be selectively included or excluded from processor 412. Also, in some embodiments, the components of processor 412 may be separated or merged to represent the functionality of processor 412.

Such a processor 412 and components of the processor 412 can control the electronic device 410 to perform steps 610 to 640 included in the artificial intelligence interaction method of FIG. For example, the processor 412 and the components of the processor 412 may be implemented to execute instructions by the code of the operating system contained in the memory 411 and the code of at least one program.

Here, the components of the processor 412 are executed by the processor 412 according to the instructions provided by the program code stored in the electronic device 410 (for example, the instructions provided by the application driven by the electronic device 410). It may be an expression of functions that are different from each other. For example, the setting unit 510 may be used as a functional representation of the processor 412 that controls the electronic device 410 according to the instructions described above so that the electronic device 410 executes each setting process.

At step 610, the processor 412 can read the required instructions from the memory 411 loaded with the instructions associated with the control of the electronic device 410. In this case, the read instruction may include an instruction for controlling the processor 412 to execute steps 620 to 640 described below.

In step 620, the setting unit 510 can set two or more wakewords used as a dialogue activation trigger for activating the dialogue function of the electronic device 410. In the present invention, the wake word may be used as a dialogue activation trigger for activating the dialogue function of the electronic device 410, and at the same time, may be used for the purpose of specifying the operation of the electronic device 410. At this time, the wake word may be predefined and set for each operation that can be performed by the electronic device 410, or may be arbitrarily set by the user. As an example, the operation of the electronic device 410 is the role of the main device that directly executes the operation corresponding to the voice command in the electronic device 410, and the operation corresponding to the voice command is another device paired with the electronic device 410. It may be divided into the role of a relay that transmits the corresponding voice command to be executed. For example, as shown in FIG. 7A, it is assumed that "clover" is defined as a wake word for the operation of the main device and "friend" is defined as a wake word for the relay operation. At this time, when a plurality of devices are paired with the electronic device 410, the wake word may be specified to be different for each device, and the relay target may be specified according to the different wake word. As another example, the operation of the electronic device 410 may be divided according to the type of voice engine that outputs the response information corresponding to the voice command. For example, as shown in FIG. 7B, “siri” may be defined as a wake word for the action of the female character by the voice engine, and “brown” may be defined as the action of the male character by the voice engine. In addition to this, not only the wake word but also the operation of the electronic device 410 corresponding to each wake word can be individually specified by the user. The above-mentioned operation is merely an example, and any operation that can be realized by the electronic device 410 can be applied.

Referencing FIG. 6 again, in step 630, the activation unit 520 may activate the interactive function of the electronic device 410 when any one of the two or more wake words is recognized. it can. When the voice received by the voice interface (for example, the speaker) in the state where the interactive function of the electronic device 410 is deactivated, the activation unit 520 corresponds to any one of the plurality of wake words. The dialogue function can be activated. At this time, the activation unit 520 performs a preprocessing process such as noise removal of the voice received by the voice interface, and then identifies whether or not the preprocessed voice corresponds to a predetermined wake word. Good.

In step 640, the operation execution unit 530 makes a wake word used when the electronic device 410 activates the dialogue function with respect to the voice input received by the voice interface in the state where the dialogue function of the electronic device 410 is activated. It can be controlled to perform the corresponding action. The action execution unit 530 can execute different actions depending on the wake word used to activate the interactive function. Referring to FIG. 7A, when the electronic device 410 is equipped with two wake words "clover" and "friend", the operation execution unit 530 is activated by the wake word "clover". Occasionally, as the main device operation, the operation corresponding to the voice instruction is directly executed by the electronic device 410, while when the dialogue function is activated by the wake word "friend", the operation corresponding to the voice instruction is performed as the relay operation. A voice command can be transmitted to the other device paired with the electronic device 410 so that it can be executed. In other words, the electronic device 410 is equipped with different types of wakewords, one of which is used to transmit a command input to the electronic device 410 to another device. , The electronic device 410 will act as a relay at the same time as the microphone. As another example, the operation execution unit 530 may output the response information corresponding to the voice command from the electronic device 410 from a different engine according to each wake word. Referring to FIG. 7B, when the wake words “siri” and “brown” are mounted on the electronic device 410, the operation execution unit 530 is activated when the dialogue function is activated by the wake words “siri”. The response information corresponding to the voice command can be output from the female character engine, and when the dialogue function is activated by the wake word "Brown", the response information corresponding to the voice command can be output from the male character engine. In other words, by mounting different types of wakewords in the electronic device 410, it is possible to realize a function of calling different voice engines according to the wakewords in one device.

Therefore, in the present invention, the wake word for activating the interactive function of the electronic device 410 can be divided into two or more, and the operation of the electronic device 410 can be controlled differently according to each wake word.

In the following, a specific scenario of the artificial intelligence dialogue system will be described exemplarily.

FIG. 8 is a diagram showing an example of a control environment using a plurality of wake words in one embodiment of the present invention. In FIG. 8, 410 is an example of an electronic device that provides an audio interface, showing an artificial intelligence speaker, and shows how the artificial intelligence speaker 410 is paired with an IPTV set-top box (STB) 800. There is.

The artificial intelligence speaker 410 can be paired with a set-top box 800 connected to an internal network (not shown) such as the artificial intelligence speaker 410. For example, the artificial intelligence speaker 410 and the set-top box 800 are connected to the same Wi-Fi network using a Wi-Fi router (not shown), and data communication is possible between them. For pairing and data communication between devices in the internal network, an all-join method or the like may be used, but the method is not limited thereto.

The artificial intelligence speaker 410 includes a basic wake word (eg, "clover") for main device operation, as well as an additional wake word (eg, "TV friend") for relay operation that transmits instructions to the set-top box 800. ") May be installed. As the instruction word issued by the user, the basic wake word is used when the operation on the artificial intelligence speaker 410 is desired, and the additional wake word is used when the operation on the IPTV is desired. When the wake word of the artificial intelligence speaker 410, that is, "clover" is spoken, the user's voice command is directly processed by the artificial intelligence speaker 410, and the corresponding operation is executed by the artificial intelligence speaker 410. When the wake word of the set-top box 800, that is, "TV friend" is spoken, the user's voice command is transmitted from the artificial intelligence speaker 410 to the set-top box 800, and the corresponding operation is executed in the set-top box 800. As a specific example, when the device is activated, the artificial intelligence speaker 410 first confirms what the wake word that activated the device is, and the user speaks according to the confirmed wake word. A voice PCM (pulse code modulation) including a command word is transmitted to a target device so that it can be processed.

Therefore, the artificial intelligence speaker 410 is equipped with a basic wake word and an additional wake word, and the additional wake word is used as a wake word for instructing the set-top box 800. At this time, the artificial intelligence speaker 410 is used. It will play the role of the microphone of the set-top box 800. The additional wake word may be enabled or disabled depending on the state of the set-top box 800. The enabled state is when the set-top box 800 is normally connected to the network during the device setting process (at this time, the network to which the artificial intelligence speaker 410 and the set-top box 800 are connected). Should be the same). The disabled state is when the set-top box 800 is not connected to the network during the device setting process, or when the artificial intelligence speaker 410 and the set-top box 800 are not connected to the same network. , When the user cancels the connection, etc. can be applicable.

FIG. 9 is a flowchart showing an example of a process of controlling the operation of the artificial intelligence speaker 410 by using a plurality of wake words in one embodiment of the present invention.

Referring to FIG. 9, the artificial intelligence speaker 410 may search the connectable set-top box 800 after the network setting is completed in the initial setting process (Discovery Mode) (S901).

When the artificial intelligence speaker 410 becomes the Discovery Mode, the set-top box 800 that responds to the all-join signal is waited for a certain period of time (for example, 30 seconds) by the all-join method (S902).

The artificial intelligence speaker 410 can be connected to the set-top box 800 that responds to the all-join signal within a certain period of time (pairing) (S903).

At this time, if there is only one set-top box in the internal network to which the artificial intelligence speaker 410 is connected, the artificial intelligence speaker 410 and the set-top box 800 are immediately paired. On the IPTV screen, a pop-up screen containing a message such as "Connected with AI speaker" is displayed.

On the other hand, if there are two or more set-top boxes in the internal network to which the artificial intelligence speaker 410 is connected, press the "Connect with AI speaker? Connect button" on all connectable IPTV screens. A pop-up like "" is displayed, and pairing is performed with the set-top box 800 that pressed the connect button first. The user can confirm which set-top box can be connected from the pop-up message displayed on the IPTV screen, and the user's confusion can be minimized by providing voice guidance during the process.

If the set-top box does not exist in the internal network to which the artificial intelligence speaker 410 is connected, the Discovery Mode ends at the same time as the guidance voice that the connectable IPTV was not found.

Pairing with the artificial intelligence speaker 410 must always be possible, not only when the set-top box 800 is in the active mode, but also when it is in the sleep mode (Sleep Mode). Further, the artificial intelligence speaker 410 is activated after the pairing with the set-top box 800 is completed, but even if the pairing setting with the set-top box 800 fails, the artificial intelligence speaker 410 is activated. The use of the artificial intelligence speaker 410 must be enabled.

Not only pairing between devices, but also settings for wake words etc. are executed on another device (for example, the user's smartphone), an application for network connection of the artificial intelligence speaker 410 and each setting (that is, a management application). It may be done in. The management app can search for the artificial intelligence speaker 410 and one or more other devices, such as the set-top box 800, connected on the same internal network, receive the information, and configure the settings.

When the pairing with the set-top box 800 is completed or timed out, the artificial intelligence speaker 410 may transmit the corresponding information to the server 420. At this time, when the registration of the set-top box is received on the server 420, the management application displays "Connected to the set-top box" or "Failed to connect to the set-top box" on the setting screen. After displaying the toast pop-up, you will be taken to the main screen. The setting screen of the management application shows the registration status of the set-top box. At this time, if it is registered, it is displayed to the user in the form of a set-top model (Mac address).

In addition, the artificial intelligence speaker 410 is activated by issuing a local announcement such as "Connecting. Please wait." Even if the user speaks a wake word until the necessary settings are completed. Absent.

If there is a pairing history with the set-top box 800 when provisioning with the artificial intelligence speaker 410, the initial setting process as described above is skipped, and the set-top box 800 with the history of recent pairing is used. It may be reconnected automatically.

When reconfiguring the internal network using the management app, the pairing process must be repeated after the network is configured. At this time, the pairing setting history stored in the artificial intelligence speaker 410 is deleted after the network is reset.

When the pairing setting with the set-top box 800 is completed and the basic wake word "clover" is spoken, the artificial intelligence speaker 410 can activate the interactive function for the operation of the main device (S904).

On the other hand, when the pairing setting with the set-top box 800 is completed and the additional wake word "TV friend" is uttered, the artificial intelligence speaker 410 can activate the dialogue function for the relay operation (S906). ..

When the interactive function is activated by the wake word, the artificial intelligence speaker 410 may display the activated state by using a display means such as an LED. At this time, the activation state by the basic wake word and the activation state by the additional wake word may be displayed separately. For example, the "orange" LED may be lit when activated by the basic wake word, and the "purple" LED may be lit when activated by the additional wake word.

When the artificial intelligence speaker 410 is activated by the basic wake word "clover", the electronic device 410 directly executes the operation corresponding to the user's voice command. As an example, the response corresponding to the voice command is performed. Information can be acquired from the server 420 and output from the voice interface of the artificial intelligence speaker 410 (S905).

When the artificial intelligence speaker 410 is activated by the additional wake word "TV Friend", the corresponding voice instruction is set in the set-top box 800 so that the operation corresponding to the user's voice instruction is executed in the set-top box 800. (S907). As a result, the set-top box 800 receives the user's voice command from the artificial intelligence speaker 410 and executes the operation corresponding to the corresponding voice command in the set-top box 800. As an example, the set-top box 800 corresponds to the voice command. The response information to be executed can be acquired from the server 420 and output from the interface of the set-top box 800 (S908).

When the artificial intelligence speaker 410 is activated by the additional wake word while being paired with the set-top box 800, the voice command input from the user is transmitted to the set-top box 800. At this time, when the user utters a function that is not supported by the IPTV based on the communication with the set-top box 800, the artificial intelligence speaker 410 provides guidance such as "This is an unsupported function." Announcements can be output. In addition to this, the artificial intelligence speaker 410 may monitor the power supply state, the connected state, and the like of the set-top box 800, and output a guidance announcement corresponding to the state of the set-top box 800 when the user speaks.

In other words, of the wake words for the artificial intelligence speaker 410, when the basic wake word is spoken, the user's voice command is transmitted to the artificial intelligence speaker 410, and the corresponding operation is executed by the artificial intelligence speaker 410. When the wake word is spoken, the user's voice command is transmitted to the set top box 800 via the artificial intelligence speaker 410, and the corresponding operation is executed in the set top box 800. For example, when the user utters something like "Clover, what's the weather today?", The artificial intelligence speaker 410 acquires information about today's weather from the server 420, and the acquired information is "What's the weather today ...". It is output by speaker sound like ". On the other hand, when the user makes a speech such as "TV friend, what is the weather today?", The corresponding voice command is transmitted to the set-top box 800 via the artificial intelligence speaker 410, and the set-top box 800 is the server 420. Information on today's weather is acquired from, and the acquired information is output by TV sound such as "Today's weather is ...", or information on the weather is output on the screen.

8 and 9 describe that the artificial intelligence speaker 410 is paired with one set-top box 800, but the present invention is not limited to this, and a plurality of set-top boxes or a plurality of different set-top boxes may be used. It is also possible to work with the device of. When pairing the artificial intelligence speaker 410 with a plurality of devices, the wake word may be specified to be different for each device. For example, when there are two set-top boxes to be paired with the artificial intelligence speaker 410, the wake word may be specified. Three words, that is, a basic wake word, a wake word of the set-top box 1, and a wake word of the set-top box 2 may be specified and mounted.

The basic wake word and the additional wake word may be a predefined wake word, but can also be specified directly by the user. For example, when there are two set-top boxes in the house, the artificial intelligence speaker 410 is connected to the two set-top boxes, and the wake word of the set-top box 1 and the wake word of the set-top box 2 are directly specified by the user. Good.

Therefore, when an additional wake word is installed in addition to the basic wake word and the artificial intelligence speaker 410 is activated by using the additional wake word, the artificial intelligence speaker 410 corresponds to the user's voice command to the additional wake word. It is responsible for communicating to the device.

In addition to this, as described above, by using a plurality of wake words, it is possible to make the operation different according to each wake word in one artificial intelligence speaker 410, or to support a function of calling a different engine. It becomes possible to do.

As described above, according to the embodiment of the present invention, the wake words of the artificial intelligence device that provides the voice-based interface are divided into two or more, and the operation of the artificial intelligence device is controlled so as to be different according to each wake word. Can be done.

The devices described above may be implemented by hardware components, software components, and / or combinations of hardware components and software components. For example, the devices and components described in the embodiments include a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microcomputer, an FPGA (field programgate array), a PLU (programmable log unit), a microprocessor, and the like. Alternatively, it may be implemented using one or more general purpose computers or special purpose computers, such as various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also respond to the execution of the software, access the data, store, manipulate, process, and generate the data. For convenience of understanding, one processor may be described as being used, but one of ordinary skill in the art will appreciate that the processor may include multiple processing elements and / or multiple types of processing elements. You can understand. For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

The software may include computer programs, codes, instructions, or a combination of one or more of these, and the processing equipment may be configured to operate as desired, either independently or collectively. May be ordered to. The software and / or data is embodied in any type of machine, component, physical device, computer recording medium or device to be interpreted based on the processing device or to provide instructions or data to the processing device. Good. The software is distributed on networked computer systems and may be stored or executed in a distributed state. The software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be realized in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. At this time, the medium may be one that continuously stores a computer-executable program, or one that temporarily stores the program for execution or download. Also, the medium may be a variety of recording or storage means in the form of a combination of single or multiple hardware, not limited to media that are directly connected to a computer system, and distributed over the network. It may exist. Examples of media include hard disks, floppy (registered trademark) disks, magnetic media such as magnetic tapes, optical media such as CD-ROMs and DVDs, and optical magnetic media such as flotropic disks. And ROM, RAM, flash memory, etc., and may be configured to store program instructions. Further, as another example of the medium, a recording medium or a storage medium managed by an application store that distributes applications, a site that supplies or distributes various other software, a server, or the like may be mentioned.

As described above, the embodiments have been described based on the limited embodiments and drawings, but those skilled in the art will be able to make various modifications and modifications from the above description. For example, the techniques described may be performed in a different order than the methods described, and / or components such as the systems, structures, devices, circuits described may be in a form different from the methods described. Appropriate results can be achieved even if they are combined or combined, or replaced or replaced by other components or equivalents.

Therefore, even different embodiments belong to the attached claims as long as they are equivalent to the claims.

412: Processor 510: Setting unit 520: Activation unit 530: Operation execution unit

Claims (16)

An artificial intelligence dialogue method that is executed in an electronic device realized by a computer.
The stage of pairing the electronic device with other devices connected to the network,
When any one of a plurality of preset wake words is recognized by the voice interface of the electronic device, the step of activating the dialogue function and the input in the state where the dialogue function is activated to voice command is, the recognized viewing including the step of controlling to perform different operations in response to the wake word, the wake word, containing the basic wake word and additional wake word,
The control step is
When the dialogue function is activated by the basic wake word, the operation corresponding to the voice command is executed by the electronic device.
An artificial intelligence dialogue that transmits the voice command to the other device so that when the dialogue function is activated by the additional wake word, the operation corresponding to the voice command is executed on the other device. Method. The artificial intelligence dialogue method according to claim 1, further comprising a step of setting a wake word for identifying the corresponding operation for each operation that can be performed by the electronic device. The artificial intelligence dialogue method according to claim 1, wherein the wake word and the operation of each wake word are personalized to the user of the electronic device. The pairing stage is
The artificial intelligence dialogue method according to claim 1 , wherein another device connected to the network is searched and paired with the device that responds to the search signal. The electronic device and when other devices that pairing is plural, further comprising the step of setting differently the additional wake word for each device, artificial intelligence conversation method of claim 1. The control step is
The artificial intelligence dialogue method according to claim 1, wherein a different engine is called according to the recognized wake word, and the response information corresponding to the voice command is output from the engine. The activation step is
The artificial intelligence dialogue method according to claim 1, further comprising a step of distinguishing and displaying the activated state according to the recognized wake word. A computer program that combines with a computer to cause the computer to execute the artificial intelligence dialogue method according to any one of claims 1 to 7 . A computer-readable recording medium, wherein a program for causing a computer to execute the artificial intelligence dialogue method according to any one of claims 1 to 7 is recorded. An artificial intelligence dialogue system for electronic devices realized by a computer.
Includes at least one processor implemented to execute computer-readable instructions
The at least one processor
A setting unit that sets two or more wake words used as a dialogue activation trigger for activating the dialogue function of the electronic device, and pairs the electronic device with another device connected to the network .
When any one of the wake words is recognized by the voice interface of the electronic device, the activation unit that activates the dialogue function and the voice input in the state where the dialogue function is activated. The wake word includes an action execution unit that controls the command to perform a different action according to the recognized wake word, and the wake word includes a basic wake word and an additional wake word.
The operation execution unit
When the dialogue function is activated by the basic wake word, the operation corresponding to the voice command is executed by the electronic device.
An artificial intelligence dialogue that transmits the voice command to the other device so that when the dialogue function is activated by the additional wake word, the operation corresponding to the voice command is executed on the other device. system. The setting unit,
The artificial intelligence dialogue system according to claim 10 , wherein a wake word for specifying the corresponding operation is set for each operation that can be performed by the electronic device. The artificial intelligence dialogue system according to claim 10 , wherein the wake word and the operation of each wake word are personalized to the user of the electronic device. The setting unit,
The artificial intelligence dialogue system according to claim 10 , wherein another device connected to the network is searched and paired with the device that responds to the search signal. The setting unit,
The artificial intelligence dialogue system according to claim 10 , wherein when there are a plurality of other devices to be paired with the electronic device, the additional wake word is set differently for each device. The operation execution unit
The artificial intelligence dialogue system according to claim 10 , wherein a different engine is called according to the recognized wake word, and the response information corresponding to the voice command is output from the engine. The activation part is
The artificial intelligence dialogue system according to claim 10 , wherein the activated state is displayed separately according to the recognized wake word.

Images