KR20200034056A - System and method for controlling electronic devices by area using a plurality of artificial intelligent voice terminals - Google Patents

Abstract

The present invention provides a system for controlling an electronic device for each section by using a plurality of artificial intelligence (AI) voice terminals, which is capable of preventing multi-triggering, and a method thereof. According to one embodiment of the present invention, the system comprises: a server executing a service for a voice command included in user′s voice when receiving the user′s voice; the plurality of terminals fixedly installed in each of a plurality of sections divided by a wall in a single building, and transmitting the user′s voice to the server when detecting the user′s voice; and a relay selecting one of the plurality of terminals through the user′s voice and relaying the user′s voice received from the selected terminal to the server. The server receives the user′s voice from the relay. When the user′s voice includes a section fixing voice, the server executes the service with respect to an electronic device placed in the section corresponding to the section fixing voice. In the opposite case, the server executes the service with respect to an electronic device placed in the section where the selected terminal is arranged.

Description

System and method for controlling electronic devices for each area using a plurality of artificial intelligence voice terminal devices {SYSTEM AND METHOD FOR CONTROLLING ELECTRONIC DEVICES BY AREA USING A PLURALITY OF ARTIFICIAL INTELLIGENT VOICE TERMINALS}

This embodiment relates to an artificial intelligence voice terminal device and its service technology.

A number of AI speakers have been developed to recognize a user's voice, analyze the voice using artificial intelligence, and provide an appropriate response (service) to it. The conventional service device includes a hand input device such as a keyboard, mouse, and touch pad, and provides a service according to a command input by a user through the input device. However, the artificial intelligence speaker is recognized as a device with increased user convenience because it does not require the user's movement-the movement of the hand-in confirming the user's command.

The artificial intelligence speaker generally operates in the standby mode, and then switches to the command reception mode when it recognizes the call voice to itself, also called the trigger voice. Then, the artificial intelligence speaker transmits the voice recognized in the command reception mode to the server, and the server analyzes the voice and provides a corresponding service. Since it is difficult to distinguish whether a user issues a command to a person nearby or a command to himself / herself, the trigger voice is recognized as an essential element at the current technology level.

On the other hand, if the artificial intelligence speaker incorrectly recognizes the trigger voice, a command issued to another subject-for example, a person in the vicinity-may be processed as a command given to the user, and the user may perform an unexpected operation.

Misrecognition of the trigger voice may occur due to a low voice recognition level, but may also occur when a plurality of artificial intelligence speakers are located close to each other and when a voice uttered by another artificial intelligence speaker is recognized as a speech uttered by itself.

Recently, as the number of cases in which a plurality of artificial intelligence speakers are installed in a single household is increasing, the demand for technology to improve the misrecognition of the artificial intelligence speakers is increasing.

Against this background, it is an object of this embodiment to provide a technique for preventing multiple triggering phenomena in which a plurality of adjacent voice terminal devices are triggered together.

It is also an object of this embodiment to provide a technique for collectively controlling not only the electronic devices in the area where the user is located, but also the electronic devices in other areas of the building through the closest voice terminal device.

In order to achieve the above object, an embodiment includes a server that, when receiving a user voice, executes a service for command voice among the user voices; A plurality of terminal devices fixedly disposed in each of a plurality of different zones partitioned through a wall in a single building, and transmitting the user voice to the server when the user voice is sensed; And a relay device for selecting one of the plurality of terminal devices through the user voice and relaying the user voice received from the selected terminal device to the server, wherein the server includes the user from the relay device. If a voice is received, and the user voice includes zoning voice, the service is executed for an electronic device located in the zone corresponding to the zoning voice, and if the user voice does not include the zoning voice, the Provided is a system for executing the above service for an electronic device located in an area where a selected terminal device is disposed.

In the system, the user voice includes a plurality of command voices, and the server, when the user voice includes a zone designated voice, the plurality of commands to the electronic device located in the zone corresponding to the zone designated voice Multiple services for voice can be executed.

In the system, the user voice includes a plurality of command voices, and the server, if the user voice does not include a zoned voice, the plurality of electronic devices located in an area where the selected terminal device is disposed. Multiple services for command voice can be executed.

In the above system, the server can continuously execute the plurality of services.

In the system, the user voice includes a first zoning voice and a second zoning voice, and the server includes a first electronic device and the second zoning located in the zone corresponding to the first zoning voice. The service may be executed for a second electronic device located in a region corresponding to voice.

In the system, the user voice includes a first command voice for a service to be executed on the first electronic device and a second command voice for a service to be executed on the second electronic device, and the server includes the first electronic A service for the first command voice may be executed for a device, and a service for the second command voice may be executed for a second electronic device.

In the system, the user voice includes a trigger voice, and the plurality of terminal devices transmits an energy measurement value of the trigger voice to the relay device, and the relay device comprises the plurality of energy from the energy measurement value. One of the terminal devices can be selected.

In another embodiment, a plurality of terminal devices fixedly disposed in each of a plurality of different zones partitioned through a wall in a single building may sense a user's voice; A relay device receiving the user voice from the plurality of terminal devices; The relay device selecting one of the plurality of terminal devices through the user voice; A server receiving the user voice from the relay device; And if the user voice includes zoning voice, the server executes a service for command voice among the user voices for electronic devices located in the zone corresponding to the zoning voice, and the user voice is the zoning voice. If it does not include, it provides a method comprising the step of executing the service for the electronic device located in the area where the selected terminal device is disposed.

In the above method, the user voice includes a plurality of command voices, and the operation of executing the service includes: when the user voice includes a zoned voice, for an electronic device located in the zone corresponding to the zoned voice A plurality of services for the plurality of command voices can be executed.

In the above method, the user voice includes a plurality of command voices, and the operation of executing the service is performed by the electronic device located in the area where the selected terminal device is disposed, if the user voice does not include a zoned voice. In contrast, a plurality of services for the plurality of command voices may be executed.

As described above, according to the present embodiment, it is possible to prevent multiple triggering phenomena in which a plurality of adjacent voice terminal devices are triggered together. Through this, it is possible to prevent a malfunction of the voice terminal device based on artificial intelligence, and accurately select and operate one voice terminal device desired by the user from among a plurality of voice terminal devices.

Further, according to the present embodiment, it is possible to collectively control not only the electronic devices in the area where the user is located, but also the electronic devices in other areas of the building through the closest voice terminal device. Through this, it is possible to provide the convenience that the user can control the electronic device of the building regardless of space.

1 is a block diagram of a voice service system according to an embodiment.
2 is a block diagram of a terminal device according to an embodiment.
3 is a flowchart of a control method of a voice service system according to an embodiment.
4 is a view showing an energy measurement unit when the terminal device according to an embodiment generates an energy measurement value.
5 is a diagram illustrating the configuration of energy measurement data transmitted by a terminal device according to an embodiment.
6 is a view showing trigger voice data for measuring energy by a terminal device according to an embodiment.
7 is a flowchart of a control method of a relay device according to an embodiment.
8 is a block diagram of a voice service system according to another embodiment.
9 is a block diagram of a voice service system according to another embodiment.
10 is a view showing various forms of user voice according to another embodiment.
11 is a diagram illustrating a user voice stored in a buffer according to another embodiment.
12 is a flowchart of a control method of a voice service system according to another embodiment.

Hereinafter, some embodiments of the present invention will be described in detail through exemplary drawings. It should be noted that in adding reference numerals to the components of each drawing, the same components have the same reference numerals as possible even though they are displayed on different drawings. In addition, in describing the present invention, when it is determined that detailed descriptions of related well-known configurations or functions may obscure the subject matter of the present invention, detailed descriptions thereof will be omitted.

In addition, in describing the components of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are only for distinguishing the component from other components, and the nature, order, or order of the component is not limited by the term. When a component is described as being "connected", "coupled" or "connected" to another component, that component may be directly connected to or connected to the other component, but another component between each component It should be understood that elements may be "connected", "coupled" or "connected".

1 is a block diagram of a voice service system according to an embodiment.

Referring to FIG. 1, a voice service system (hereinafter referred to as 'system', 100) includes a plurality of voice terminal devices (hereinafter referred to as 'terminal devices', 110a to 110c), relay device 120 and server 130. It can contain.

The plurality of terminal devices 110a to 110c may be disposed in different areas 11a to 11c partitioned through a wall in a single building 10. For example, when a general home is divided into a plurality of zones-a room, a bathroom, a kitchen, a living room, etc.-a plurality of terminal devices 110a to 110c may be disposed in different zones. The first terminal device 110a may be arranged in the first room 11a, the second terminal device 110b may be arranged in the living room 11b, and the third terminal device 110c may be located in the second room ( 11c).

The user 20 can utter the trigger voice at any location in the building 10. Also, at least one terminal device among the plurality of terminal devices 110a to 110c may receive the voice of the user 20.

The plurality of terminal devices 110a to 110c may detect a trigger voice of the user 20 while operating in a first mode-for example, a standby mode. At this time, at least one terminal device among the plurality of terminal devices 110a to 110c disposed in the single building 10 may detect the trigger voice. At this time, it may be a problem which terminal device detects and processes the command voice of the user 20 by switching to a second mode-for example, a command reception mode.

When detecting the trigger voice in the first mode, the terminal devices 110a to 110c according to an embodiment may generate an energy measurement value for the trigger voice and transmit it to the relay device 120. Then, the relay device 120 transmits a trigger execution control signal to the corresponding terminal device so that the terminal device having the largest energy measurement value among the terminal devices 110a to 110c that senses the trigger voice switches from the first mode to the second mode. can do. Then, the relay device 120 may transmit a trigger non-execution control signal to the remaining terminal devices among the terminal devices 110a to 110c that sense the trigger voice.

The terminal device receiving the trigger execution control signal among the plurality of terminal devices 110a to 110c may switch from the first mode to the second mode to detect a command voice from the user 20. Then, the terminal device receiving the trigger non-running control signal may wait for the detection of the trigger voice while maintaining the first mode.

The terminal device switched to the second mode may detect the command voice from the user 20 and transmit the command voice to the server 130 through the relay device 120.

In addition, the server 130 may execute a service for command voice. When the command voice is, for example, "tell me a nursery rhyme", the server 130 may transmit the acoustic data for the nursery to the relay device 120 by streaming, and the relay device 120 may perform streaming again. It can be delivered to the terminal device is switched to the mode. In addition, the terminal device switched to the second mode may receive streaming and output sound data as sound through a speaker.

The relay device 120 may be a kind of home hub device. The relay device 120 may function as a gateway that connects communication devices disposed in the building 10 with other external communication networks. The relay device 120 may be connected to a wired communication device and a wireless communication device, and connect the communication device to an external communication server. The wired communication device may be, for example, a computer or a smart TV, and the wireless communication device may be, for example, the above-described terminal devices 110a to 110c, a smart phone, a laptop computer, a washing machine, or the like.

All transmission data of the terminal devices 110a to 110c may be transmitted externally through the relay device 120 or may be transmitted to the relay device 120. All of the energy measurement data including the energy measurement value for the trigger voice may be transmitted from the terminal devices 110a to 110c to the relay device 120. Then, the relay device 120 may compare the energy measurement values received from the respective terminal devices 110a to 110c, and select the terminal device that has transmitted the largest energy measurement value as a trigger execution terminal device.

2 is a block diagram of a terminal device according to an embodiment.

Referring to FIG. 2, the terminal device 110 may include a microphone 210, an analog-to-digital conversion unit 220, a buffer 230, a trigger monitoring unit 240, a control unit 250, and a communication unit 260. You can.

The microphone 210 may convert a user's voice into a voice signal.

The analog-to-digital converter 220 may convert an analog signal type audio signal into a digital data type audio signal. For convenience of description, the voice signal input to the analog-to-digital converter 220 is referred to as an analog voice signal, and the voice signal converted by the analog-to-digital converter 220 is referred to as a digital voice signal.

The terminal device 110 may further include a filter (not shown) while removing a noise component from the voice signal through the filter (not shown). The filter (not shown) may be an analog filter that removes noise from the analog voice signal, or a digital filter that removes noise from the digital voice signal. The terminal device 110 may include both an analog filter and a digital filter.

The buffer 230 may store digital voice signals. Each storage cell constituting the buffer 230 may have a circular ring structure. When constant data flows into the buffer 230 in a cyclic ring structure, previously stored data may be deleted. The buffer 230 may be used in a format in which new data overwrites old data.

The trigger monitoring unit 240 may detect a trigger voice from a voice signal and generate a trigger signal.

The trigger monitoring unit 240 may generate a trigger signal when a voice signal corresponding to the trigger voice is found in the digital voice signal stored in the buffer 230 while monitoring the buffer 230.

The control unit 250 may wait for the reception of the trigger signal in the first mode-for example, the standby mode. Then, the control unit 250 may process the command voice in the second mode-for example, the command reception mode.

When the trigger signal is generated in the first mode, the controller 250 may measure energy for the trigger voice and control the energy measurement value to be transmitted to the relay device. When the trigger signal is received from the trigger monitoring unit 240, the control unit 250 may calculate an energy value for a voice signal corresponding to a predetermined time period from the digital voice signal stored in the buffer 230. The energy value may be calculated, for example, by squaring the value of the audio signal and taking a commercial log. The control unit 250 may generate an energy measurement value for the trigger voice in a manner that calculates an energy value for each of a plurality of consecutive time periods and averages the energy value.

Here, the control unit 250 may generate an energy measurement value for the digital voice signal corresponding to the trigger voice. The trigger monitoring unit 240 may transmit information on the location where the trigger voice is stored in the buffer 230 to the control unit 250. The control unit 250 may check the portion where the trigger voice is stored according to the information and generate an energy measurement value using the voice signal of the corresponding portion.

In addition, the trigger voice in which the energy measurement value is generated may be a voice signal from which noise has been removed through a filter-for example, a noise canceling device. The control unit 250 can accurately measure the amount of energy when the trigger voice uttered by the user reaches the microphone 210 through the trigger voice from which the noise is removed.

The communication unit 260 may transmit the energy measurement value for the trigger voice to the relay device. Then, the communication unit 260 may receive a trigger execution control signal or a trigger non-running control signal from the relay device and transmit the trigger execution control signal to the control unit 250. The communication unit 260 may transmit the energy measurement data to the relay device, and the energy measurement data may include a communication address value, for example, an IP (internet protocol) address, a terminal ID value, a time value, and an energy measurement value. have.

The relay device receives an energy measurement value for the trigger voice from the plurality of terminal devices 110, transmits a trigger execution control signal to the terminal device 110 that has transmitted the largest energy measurement value, and transmits the trigger execution control signal to the remaining terminal devices 110. The trigger non-execution control signal can be transmitted. When the received energy value is the largest for the same trigger voice of the user, it may occur when the user approaches the terminal device 110 or the user speaks to the terminal device 110 to speak the voice. According to this principle, the relay device transmits the trigger execution control signal to the terminal device that transmits the largest energy measurement value among the energy measurement values received from each terminal device 110 and the trigger non-running control signal to the remaining terminal devices. can do.

Then, when the trigger execution control signal is received from the relay device, the control unit 250 may switch the first mode-for example, the standby mode-to the second mode-for example, the command reception mode. In addition, the controller 250 may maintain the first mode when the trigger non-running control signal is received from the relay device.

The control unit 250 may receive the command voice in the second mode and transmit the command voice to the server through the communication unit 260 and the relay device. Then, the control unit 250 may output service data received from a server or processing result data for a command voice as a sound through a speaker (not shown).

3 is a flowchart of a control method of a voice service system according to an embodiment.

Referring to FIG. 3, the terminal device 110 may detect the trigger voice of the user while operating in the first mode (S302).

Upon detecting the trigger voice, the terminal device 110 may transmit energy measurement data including an energy measurement value for the trigger voice to the relay device 120 (S304).

The relay device 120 may receive energy measurement data from a plurality of terminal devices 110 and compare the energy measurement values generated by each terminal device 110 (S306).

Then, the relay device 120 may transmit a trigger control signal to each terminal device in response to reception of energy measurement data (S308). The relay device 120 may select one trigger execution terminal device, transmit a trigger execution control signal to the trigger execution terminal device, and transmit a trigger non-execution control signal to the remaining terminal devices (S308).

When the energy measurement value is out of a predetermined range, the relay device 120 may determine that the terminal device that has transmitted the energy measurement value is a trigger non-running terminal device. When the energy measurement value received by the relay device 120 from all the terminal devices 110 is out of a predetermined range, all the terminal devices 110 may be determined as a trigger non-execution terminal device. The predetermined range may be, for example, a range above a preset reference value. When the energy measurement value is smaller than the reference value, the relay device 120 may determine the corresponding terminal device as a trigger non-running terminal device.

The relay device 120 may determine the order of each terminal device 110 by the size of the energy measurement value, and determine the terminal device 110 having the largest energy measurement value as a trigger execution terminal device. Then, the relay device 120 may determine the remaining terminal device 110 as a trigger non-running terminal device.

When the plurality of energy measurements at the top of the order of magnitude are within an error range, the relay device 120 is a terminal device 110 corresponding to the energy measurement value that is received most quickly based on the time at which the plurality of energy measurements are received. ) As a trigger execution terminal device. Alternatively, the relay device 120 may determine the terminal device 110 corresponding to the energy measurement value generated most quickly as a trigger execution terminal device based on the time when the plurality of measurement values are generated. The energy measurement data received from the terminal device 110 may include an energy measurement value and a time value. The relay device 120 includes a plurality of terminal devices 110 that transmit energy measurement values corresponding to the highest level and within an error range. ), The terminal device 110 having the fastest time value may be selected as a trigger execution terminal device. Here, the time value may be a time at which the energy measurement value is generated or a time at which the energy measurement value is transmitted.

The terminal device 110 may receive a trigger control signal from the relay device 120 and determine whether or not it is determined to be a trigger execution terminal device (S310).

The trigger control signal may be transmitted in the form of a flag. If the flag value of the trigger control signal is set to true, the terminal device receiving the trigger control signal may be determined as a trigger execution terminal device, and the trigger control signal When the flag value of is set to false, the terminal device receiving the corresponding trigger control signal may be determined as a trigger non-running terminal device.

When the terminal device receives the trigger non-running control signal (NO in S310), the terminal device may maintain the first mode to detect the next trigger voice.

Then, when the terminal device receives the trigger execution control signal (YES in S310), the terminal device operates by switching to the second mode, and can detect the user's command voice in the second mode (S312).

Then, the terminal device may include the sensed command voice in the command voice data and transmit it to the servers 132 and 134.

Servers 132 and 134 may be divided into two functionally. One may be a voice processing server 132, and the other may be a service providing server 134.

The command voice data transmitted by the terminal device 110 may be transmitted to the voice processing server 132 (S314). At this time, the command voice data may be transmitted to the voice processing server 132 via the relay device 120. The relay device 120 may function as a kind of gateway.

The voice processing server 132 may recognize a user's command from the command voice data through an artificial intelligence network developed through learning. Then, the voice processing server 132 may transmit the recognized user's command to the service providing server 134 (S316).

Then, the service providing server 134 may execute a user's command and include the processing result in the processing result data and transmit it to the terminal device 110 (S316). At this time, the processing result data is transmitted to the terminal device 110 via the relay device 120, and the terminal device 110 may output the processing result data as sound through a speaker.

Conventionally, when a plurality of AI speakers are installed in different areas partitioned through a wall in a single building-for example, a home-there is a problem in that a plurality of AI speakers wake up for a single trigger voice. By the way, according to the voice service system according to an embodiment, for a plurality of terminal devices that recognize the trigger voice at the same time, the relay device determines only one terminal device as the trigger execution terminal device and the rest as the trigger non-execution terminal device. By zooming, the aforementioned multi-wakeup problem does not occur.

4 is a view showing an energy measurement unit when the terminal device according to an embodiment generates an energy measurement value, Figure 5 is a view showing the configuration of the energy measurement data transmitted by the terminal device according to an embodiment, 6 is a view showing trigger voice data for measuring energy by a terminal device according to an embodiment.

4 to 6, the terminal device measures energy with respect to the trigger voice data TVDT stored in each cell 232 of the buffer 230, and the energy measurement value EGV is the energy measurement data EGDT ) To transmit to the relay device.

In the terminal device, each storage cell 232 of the buffer 230 may be configured as a circular ring structure. The data inputted into the buffer 230 may be sequentially stored in a circle starting from one storage cell, and when the wheel is rotated in the order of the circle, new data may be stored while overwriting the previously stored data.

The terminal device can detect the trigger voice data (TVDT) matching the preset trigger voice characteristic while monitoring the buffer 230.

Then, the terminal device classifies the trigger voice data (TVDT) for each unit time (T) of energy measurement, and generates energy for data corresponding to N (N is a natural number of 2 or more) unit time (NxT) of the trigger voice data. Can be measured. For example, the terminal device may generate energy measurement values by generating N unit time energy measurements by measuring energy by N unit times of the trigger voice, and generate energy measurement values by averaging the N unit time energy measurement values thus generated. have.

The terminal device may transmit the energy measurement value EGV by including it in the energy measurement data EGDT, and the energy measurement data EGDT includes a communication address value (IPV), a terminal ID value (IDV), and a time value (TIV). And energy measurements (EGV).

The communication address value (IPV) is an address value of communication for transmitting and receiving data, and an IP address value may correspond thereto.

The terminal ID value IDV is a value designated to distinguish terminal devices connected to a relay device, and each terminal device may have a different ID value.

The time value TIV may be a time when the energy measurement value EGV is generated or a time for transmitting the energy measurement data EGDT. The relay device may select the trigger execution terminal device from the terminal devices having the same energy measurement value by checking the time value TIV.

7 is a flowchart of a control method of a relay device according to an embodiment.

Referring to FIG. 7, the relay device may receive energy measurement data including energy measurement values from a plurality of terminal devices (S700).

Then, the relay device may remove the energy measurement value out of the predetermined range-the predetermined appropriate range-(S702). The terminal device transmitting the removed energy measurement value may be designated as a trigger non-execution terminal device.

Then, the relay device may select one terminal device from among the plurality of terminal devices that have transmitted the energy measurement value as the trigger execution terminal device (S704). The relay device selects the terminal device that has transmitted the largest energy measurement value as a trigger execution terminal device, but when a plurality of terminal devices that transmit the highest energy measurement value have an energy measurement value within an error range, the relay device displays the energy measurement data. The terminal device having the fastest included time value may be selected as a trigger execution terminal device. In addition, when all the terminal devices are designated as non-triggered terminal devices by transmitting energy measurement values out of an appropriate range in step S702, the relay device may not select any triggered terminal devices in step S704.

When the triggered terminal device and the non-triggered terminal device are determined, the relay device may transmit a trigger control signal to each terminal device (S706). The relay device may transmit the trigger execution control signal to the trigger execution terminal device, and may transmit the trigger execution execution control signal to the trigger execution execution terminal device. In some cases, the relay device may not transmit the trigger non-execution control signal.

8 is a block diagram of a voice service system according to another embodiment.

Referring to FIG. 8, the voice service system 100 may control a plurality of electronic devices 140a, 140b, and 140c through a plurality of terminal devices 110a, 110b, and 110c.

When the user 20 issues a command voice in one zone, the electronic device belonging to the zone may operate. For example, when the user 20 makes a trigger voice in the living room 11b, the second terminal device 110b of the living room 11b located closest to the ignition point of the user 20 may be activated. The activation of the second terminal device 110b may be determined by the relay device 120 using analysis of the energy measurement value of the trigger voice, as described above. Subsequently, when the user 20 utters a command voice of 'turn on light' in the living room 11b, the second electronic device 140b located in the living room 11b may perform an 'light on' operation. In addition, the first electronic device 140a located in the first room 11a and the third electronic device 140c located in the second room 11c may remain “lights out”.

Specifically, the plurality of terminal devices 110a, 110b, and 110c may sense a user voice, which is a series of voices spoken by the user 20.

The user voice may include trigger voice, zoning voice and command voice. The trigger voice may include a wake-up voice used to activate a specific terminal device among a plurality of terminal devices 110a, 110b, and 110c. For example, when the trigger voice is designated as “high aladdin,” the terminal device can be activated only when the user 20 says “high aladdin”.

The zoning voice may include a voice designating different spaces partitioned through a wall in a single building. For example, the first room 11a may be designated as a “large room” and the second room 11c may be designated as a “small room”. Then, the user 20 can say “large room” when designating the first room 11a, and “small room” when designating the second room 11c.

The command voice may include a voice indicating an operation to be performed by the plurality of electronic devices 140a, 140b, and 140c. For example, when the user 20 wants to turn off the light of the second electronic device 140b, the user 20 may say “turn off the light”.

When a plurality of terminal devices 110a, 110b, and 110c detect a trigger voice among user voices from the user 20, the relay device 120 may select one terminal device. The relay device 120 may activate the selected terminal device and deactivate the rest by transmitting a trigger execution control signal to the selected terminal device and a trigger non-running control signal to the remaining terminal devices. In this figure, the second terminal device 110b is activated and the first and third terminal devices 110a and 110c are deactivated.

The selected terminal device can detect the command voice. The selected terminal device may transmit a command voice to the server 130 through the relay device 120.

The server 130 may execute a service for the command voice. Basically, the server 130 can execute the service to an electronic device located in an area where the terminal device is activated. The execution of the service may include controlling the operation of the electronic device. In this figure, the server 130 provides a “light on” service to the second electronic device 140b located in the living room 11b where the second terminal device 110b is activated. That is, the server 130 controls the second terminal device 110b to light up.

If the server 130 receives a zoned voice in addition to the command voice, it may provide a service to a terminal device located in a zone corresponding to the zoned voice. Therefore, the server 130 may provide the service to an electronic device other than the electronic device located in the zone where the activated terminal device is located. This will be described later.

9 is a block diagram of a voice service system according to another embodiment.

Referring to FIG. 9, the voice service system 100 may provide a service to an electronic device located in an area different from the area spoken by the user 20.

When the user 20 issues a zoning voice and a command voice in one zone, an electronic device belonging to the zone indicated by the zoning voice may operate. For example, when the user 20 utters a zoning voice and a command voice of 'turn on a big room' in the living room 11b, the first electronic device 140a located in the first room 11a turns on ' 'You can perform the action. In addition, the second electronic device 140b located in the living room 11b and the third electronic device 140c located in the second room 11c may remain 'light off'.

Specifically, the plurality of terminal devices 110a, 110b, and 110c may detect the user voice. The selected terminal device can also detect the zoned voice and the command voice included in the user voice. In addition, the relay device 120 may select one terminal device. The selected terminal device may transmit the user voice to the server 130 through the relay device 120.

The server 130 may determine whether the user voice includes the zoning voice. When the user voice includes the zoned voice, the server 130 may identify a zone corresponding to the zoned voice and provide a service for the command voice to an electronic device located in the zone. For example, when the user 20 says “turn on the living room light” in the living room 11b, the server 130 may turn on the second electronic device 140b located in the living room 11b. When the user voice does not include the zoning voice, the server 130 may execute the service for the command voice to an electronic device located in the zone where the selected terminal device is located.

Basically, the server 130 may execute a service on an electronic device in a zone where the selected terminal device is located, unless the zone designated voice is received with the command voice. This is because the server 130 can know in advance information about a region in which a plurality of terminal devices 110a, 110b, and 110c are installed. That is, a plurality of terminal devices (110a, 110b, 110c) is fixedly installed in a plurality of zones (11a, 11b, 11c), the server 130 is a plurality of terminal devices (110a, 110b, 110c) is installed zone Know. Therefore, the server 130 regards the command voice received from the selected terminal device as a command for the electronic device in the area in which the selected terminal device is disposed, and can execute the service only for the electronic device in the area. It may be desirable that the area where the plurality of terminal devices 110a, 110b, and 110c are installed does not change.

10 is a view showing various forms of user voice according to another embodiment.

The user 20 may generate a plurality of types of user voices by mutually combining trigger voices, command voices, and zoned voices. The plurality of user voices may have a plurality of voices and an order. For example, if the user 20 says “Turn on the light of High Aladdin” at once, the user voice will have a combination of the “trigger voice and command voice” sequence. In addition, if the user 20 says “Turn on the big room of high aladdin” at once, the user voice will have a combination of “trigger voice, zoning voice and command voice” order.

The type of service provided by the server 130 and the target of the service may vary according to the type of user voice generated by the user 20.

Referring to FIG. 10, various types of user voices that can be generated by combining the trigger voice, command voice and zonal voice are shown.

10A, the user 20 may speak one trigger voice and one command voice in sequence. The user voice may include a trigger voice 1001 and a first command voice 1011. In this case, the user 20 says “Turn on the high Aladdin”, and the server 130 can execute the service on the electronic device in the area where the terminal device closest to the user 20 is ignited. For example, as shown in FIG. 1, if the user 20 is in the living room 11b, the server 130 may turn on the second electronic device 140b in the living room 11b.

10B, the user 20 may speak one trigger voice and a plurality of command voices in sequence. The user voice may include a trigger voice 1001, a first command voice 1011, and a second command voice 1012. In this case, the user 20 says, “Turn on the high Aladdin and tell the nursery rhyme,” and the server 130 can execute the service on the electronic device in the area where the terminal device closest to the point where the user 20 ignites is located. . For example, as shown in FIG. 1, if the user 20 is in the living room 11b, the server 130 turns on the light of the second electronic device 140b in the living room 11b and the sound device of the living room 110b (Not shown) may provide a service to reproduce nursery rhymes.

As shown in FIG. 10C, the user 20 may sequentially speak one trigger voice, one zoning voice, and one command voice. The user voice may be composed of a trigger voice 1001, a first zoned voice 1021 and a first command voice 1011. In this case, the user 20 says, “Turn on the high Aladdin big room,” and the server 130 can execute the service on the electronic device in the zone corresponding to the zoned voice 1021. For example, as shown in FIG. 1, if the user 20 is in the living room 11b, the server 130 serves to turn on the light of the first electronic device 140a in the large room, that is, the first room 11a. Can provide.

As shown in FIG. 10D, the user 20 may sequentially speak one trigger voice, one zoning voice, one command voice, and another command voice. The user voice may be composed of a trigger voice 1001, a first zone designated voice 1021, a first command voice 1011, and a second command voice 1012. In this case, the user 20 says, “Turn on the high Aladdin big room and tell the nursery rhyme,” and the server 130 can execute the service on the electronic device in the zone corresponding to the zoned voice 1021. For example, as shown in FIG. 1, if the user 20 is in the living room 11b, the server 130 turns on the light of the first electronic device 140a in the large room, that is, the first room 11a. A sound device (not shown) in one room 11a can provide a service to reproduce the nursery rhymes.

As shown in FIG. 10E, the user 20 may sequentially speak one trigger voice, one zoning voice, one command voice, another zoning voice, and another command voice. The user voice may include a trigger voice 1001, a first zoned voice 1021, a first command voice 1011, a second zone designated voice 1022, and a second command voice 1012. In this case, the user 20 says, “Turn on the high Aladdin living room, and tell a big room shake.” The server 130 is an electronic device in an area where the terminal device closest to the point where the user 20 ignites is located, and The service can be executed on the electronic device in the zone corresponding to the zoned voice 1021. For example, as shown in FIG. 1, if the user 20 is in the living room 11b, the server 130 turns on the light of the second electronic device 140b in the living room 11b, that is, the large room, that is, the first A sound device (not shown) in the room 11a may provide a service to reproduce the nursery rhymes.

The method for combining the user voice is not limited to the above-described method, and various methods are possible. In addition, the trigger voice may not necessarily be included in the user voice. This is because the user 20 may first generate a trigger voice, and then, after the terminal device is activated, a zoned voice and / or a command voice.

11 is a diagram illustrating a user voice stored in a buffer according to another embodiment.

Referring to FIG. 11, a buffer 230 in which trigger voices, zoning voices, and command voices are stored is illustrated. In addition to the data related to the trigger voice, data related to the zoning voice and data related to the command voice may be stored in the buffer 230. In the buffer 230, user voice data, that is, trigger voice data, zoning voice data, and command voice data may be sequentially stored in a circular order. The order of storing data is not limited to this method, and may be stored in combination in various orders.

The user voice data may be input to the speakers 210 of the plurality of terminal devices 110a, 110b, and 110c, and may be stored in the buffer 230 through the analog-to-digital converter 220. The user voice data may be in the form of an analog voice signal or a digital voice signal.

12 is a flowchart of a control method of a voice service system according to another embodiment.

Referring to FIG. 12, the relay device 120 may select one terminal device among a plurality of terminal devices 110a, 110b, and 110c (S1202). The relay device 120 may select one terminal device by receiving a trigger voice from a plurality of terminal devices 110a, 110b, and 110c and comparing the energy measurement values of the trigger voice. In addition, the relay device 120 may transmit a trigger execution control signal to the selected terminal device (S1204). The terminal device receiving the trigger execution control signal may be activated. In this drawing, the relay device 120 may select the second terminal device 110b and activate the second terminal device 110b.

The selected terminal device may transmit the user voice including the zoned voice and / or command voice to the server 130 (S1208). In this figure, the second terminal device 110b is selected, and the second terminal device 110b may transmit the user voice to the server 130. As in this figure, the zoning voice and / or command voice may be transmitted to the server 130 after the second terminal device 110b is activated, but is not limited thereto. The zoning voice and / or command voice are transmitted in advance together with the trigger voice, so that this operation can be omitted.

The server 130 may determine whether the user's voice includes zoning voice (S1210). When the user voice includes a zoned voice, the server 130 may execute a service on an electronic device located in the zone corresponding to the zoned voice (S1212-1). When the user voice does not include the zoning voice, the server 130 may execute a service to the electronic device located in the zone where the selected terminal device is installed (S1212-2). In this figure, when a zoning voice designating a large room, that is, the first room 11a is included, the server 130 may execute a service to the first electronic device 140a. In addition, when the zoning voice is not included, the server 130 may execute a service on the second electronic device 140b.

As described above, according to the present embodiment, it is possible to prevent multiple triggering phenomena in which a plurality of adjacent voice terminal devices are triggered together. Through this, it is possible to prevent a malfunction of the voice terminal device based on artificial intelligence, and accurately select and operate one voice terminal device desired by the user from among a plurality of voice terminal devices.

In addition, according to this embodiment, it is possible to collectively control electronic devices in other areas of a building. Therefore, the user can control the electronic device of the building regardless of space.

The terms "comprise", "consist" or "have" as described above mean that the corresponding component can be inherent unless otherwise stated, and do not exclude other components. It should be interpreted that it may further include other components. All terms, including technical or scientific terms, have the same meaning as generally understood by a person skilled in the art to which the present invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted as being consistent with the meaning of the context of the related art, and are not to be interpreted as ideal or excessively formal meanings unless explicitly defined in the present invention.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and variations without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the claims below, and all technical spirits within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Claims (10)

A server that executes a service for command voice among the user voices when a user voice is received;
A plurality of terminal devices fixedly disposed in each of a plurality of different zones partitioned through a wall in a single building, and transmitting the user voice to the server when the user voice is sensed; And
And a relay device selecting one of the plurality of terminal devices through the user voice and relaying the user voice received from the selected terminal device to the server.
The server receives the user voice from the relay device, and when the user voice includes zoning voice, executes the service for the electronic device located in the zone corresponding to the zoning voice, and the user voice If the zoning voice is not included, a system that executes the service for an electronic device located in a zone in which the selected terminal device is disposed. According to claim 1,
The user voice includes a plurality of command voices,
The server, when the user voice includes a zoned voice, a system that executes a plurality of services for the plurality of command voices for an electronic device located in the zone corresponding to the zoned voice. According to claim 1,
The user voice includes a plurality of command voices,
The server, when the user voice does not include a zoned voice, a system that executes a plurality of services for the plurality of command voices for an electronic device located in the zone where the selected terminal device is disposed. The method of claim 2 or 3,
The server is a system that continuously executes the plurality of services. According to claim 1,
The user voice includes a first zoned voice and a second zoned voice,
The server executes the service for the first electronic device located in the zone corresponding to the first zoned voice and the second electronic device located in the zone corresponding to the second zoned voice. The method of claim 5,
The user voice includes a first command voice for a service to be executed on the first electronic device and a second command voice for a service to be executed on the second electronic device,
The server executes a service for the first command voice for the first electronic device and a service for the second command voice for the second electronic device. According to claim 1,
The user voice includes a trigger voice,
The plurality of terminal devices transmit the energy measurement value of the trigger voice to the relay device,
The relay device selects one of the plurality of terminal devices from the energy measurement value. Detecting a user's voice by a plurality of terminal devices fixedly disposed in each of a plurality of different zones partitioned through a wall in a single building;
A relay device receiving the user voice from the plurality of terminal devices;
The relay device selecting one of the plurality of terminal devices through the user voice;
A server receiving the user voice from the relay device; And
When the user voice includes the zoning voice, the server executes a service for the command voice among the user voices for the electronic device located in the zone corresponding to the zoning voice, and the user voice is configured to If not included, executing the service on the electronic device located in the area where the selected terminal device is disposed;
How to include. The method of claim 8,
The user voice includes a plurality of command voices,
In the operation of executing the service, when the user voice includes a zoned voice, a method of executing a plurality of services for the plurality of command voices for an electronic device located in the zone corresponding to the zoned voice. According to claim 1,
The user voice includes a plurality of command voices,
In the operation of executing the service, if the user voice does not include a zoned voice, a method of executing a plurality of services for the plurality of command voices with respect to the electronic device located in the zone where the selected terminal device is disposed.

Images