KR20180110971A - Home appliance, and voice recognition module - Google Patents

Abstract

The present invention relates to a home appliance and a voice recognition module. According to an embodiment of the present invention, the home appliance comprises: a driving unit having an inverter for outputting alternating current power; an audio input unit for acquiring a voice; a camera; a communication unit transmitting voice data from the audio input unit to a server system performing voice recognition processing, and receiving result data for the voice data from the service system; and a control unit for controlling the driving unit, the audio input unit, the camera, and the communication unit. The control unit controls the communication unit to transmit voice data from the audio input unit or video data from the camera to the server system. Accordingly, communication with the server system for natural language voice recognition can be efficiently performed.

Description

Home appliances, and voice recognition modules.

The present invention relates to a home appliance and a speech recognition module, and more particularly, to a home appliance and a speech recognition module capable of efficiently performing communication with a server system for natural language speech recognition.

Home appliances such as an air conditioner, a washing machine, a vacuum cleaner, and the like used in a predetermined space such as a home or an office have performed unique functions and operations according to user's operations, respectively.

For example, the air conditioner includes a compressor for compressing the refrigerant, a condenser for condensing the compressed refrigerant, an expansion valve for expanding the condensed refrigerant, and an evaporator for exchanging the expanded refrigerant with the room air, The device performs the function of adjusting the room temperature.

The refrigerator stores food, the washing machine processes the laundry, the cleaner performs the cleaning function, and the cooking device performs the cooking function.

In order to operate the home appliances such as the air conditioner, the user can use a remote control device such as a remote controller to avoid the inconvenience of manually operating buttons or the like provided on the home appliance main body or moving to the main body every time .

However, even when a remote controller is used, the user has to select and input an operation key for each function, which is inconvenient to use, and when the room is dark, separate illumination for identifying the remote controller and the operation key is required .

Therefore, there is an increasing research on a method of controlling a home appliance using speech recognition technology.

Prior Art 1 (Laid-Open Patent Publication No. 10-1999-00069703) discloses a remote controller for an air conditioner having an audio input unit and a signal processing unit to generate and transmit an operation signal according to voice recognition.

In the conventional art 2 (Japanese Unexamined Patent Publication (Kokai) No. 10-2006-0015092), an input voice signal is converted into a digital signal and text, and it is checked whether there is a control command in the database. And if there is no matching control command, extracts the keyword and controls each device in the air conditioner according to the associated control command.

However, there is a limit to the system resources that individual devices such as remote controllers and air conditioners can have. Especially, it is difficult to realize embedded modules that are installed in individual devices because it requires a high computation amount to recognize natural words rather than only a few words.

Therefore, the speech recognition technology of the related art 1 and the conventional art 2 has a limitation in recognizing and processing various natural language voice commands of users all over the world.

Therefore, there is a need for a method that can recognize and process natural language without restriction of the system resources of the individual devices, and can conveniently control the home appliance.

Also, in order to improve usability and satisfaction, it is necessary to provide a user experience (UX) considering various situations that may occur during a speech recognition process and a home appliance control process.

An object of the present invention is to provide a home appliance and a voice recognition module capable of efficiently performing communication with a server system for natural language speech recognition.

It is another object of the present invention to provide a home appliance and a speech recognition module capable of reducing the possibility of data collision by a plurality of units when communicating with a server system for natural language speech recognition.

According to an aspect of the present invention, there is provided a home appliance comprising: a driving unit including an inverter for outputting an AC power; an audio input unit for acquiring voice; a camera; and a server system for performing voice recognition processing, And a controller for controlling the driving unit, the audio input unit, the camera, and the communication unit, wherein the control unit is configured to transmit audio data from the audio input unit to the audio unit through the communication unit, And controls to transmit audio data from the input unit or video data from the camera to the server system.

According to another aspect of the present invention, there is provided a voice recognition module comprising: an audio input unit for acquiring voice; a camera; and a server system for performing voice recognition processing, And a processor for controlling the audio input unit, the camera, and the communication unit, wherein the processor is configured to transmit the audio data from the audio input unit or the video data from the camera To the server system.

According to an embodiment of the present invention, a home appliance includes a drive unit including an inverter for outputting AC power, an audio input unit for acquiring voice, a camera, and a server system for performing voice recognition processing, And a control unit for controlling the driving unit, the audio input unit, the camera, and the communication unit, wherein the control unit controls the communication unit to transmit the audio data from the audio input unit Or the video data from the camera is transmitted to the server system, so that communication can be efficiently performed when communicating with the server system for natural language speech recognition.

Particularly, when communicating with the server system for natural language speech recognition, it is possible to reduce the possibility of data collision by a plurality of units.

On the other hand, the control unit sets the communication unit as a master, sets the audio input unit and the camera as slaves, and controls to add the transmission data of the communication unit to the audio data from the audio input unit or the video data from the camera, It is possible to perform communication efficiently.

In particular, the control unit controls to execute a communication unit service for driving the communication unit, an audio service for driving the audio input unit, and a camera service for driving the camera, respectively, and the audio data from the audio input unit or the camera Is transmitted to the server system, it is possible to efficiently perform communication with the server system.

According to an embodiment of the present invention, a voice recognition module includes: an audio input unit for acquiring voice; a camera; and a server system for performing voice recognition processing, the voice recognition module transmits voice data from the audio input unit, And a processor for controlling the audio input unit, the camera, and the communication unit, wherein the processor is configured to transmit the audio data from the audio input unit or the video data from the camera to the server system So that communication can be efficiently performed when communicating with the server system for natural language speech recognition.

Particularly, when communicating with the server system for natural language speech recognition, it is possible to reduce the possibility of data collision by a plurality of units.

On the other hand, the processor sets the communication unit as a master, sets the audio input unit and the camera as slaves, and controls to add transmission data of the communication unit to the audio data from the audio input unit or the video data from the camera, It is possible to perform communication efficiently.

Particularly, the processor controls to execute a communication unit service for driving the communication unit, an audio service for driving the audio input unit, and a camera service for driving the camera, respectively, and the audio data from the audio input unit or the camera Is transmitted to the server system, it is possible to efficiently perform communication with the server system.

1 is a view illustrating a smart home system including a voice recognition server system and a home appliance according to an embodiment of the present invention.
2 is a diagram illustrating various examples of home appliances.
3A is an example of a speech recognition server system according to an embodiment of the present invention.
3B is another example of a speech recognition server system according to an embodiment of the present invention.
4 to 6 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention.
7 to 9 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention.
FIG. 10 is a diagram showing an example of an internal block diagram of a server according to an embodiment of the present invention.
11 is a block diagram illustrating an example of an internal block diagram of a home appliance according to an embodiment of the present invention.
12 is a view showing a part of an internal block diagram of an air conditioner according to an embodiment of the present invention.
13 and 14 are views showing an outline of an air conditioner according to an embodiment of the present invention.
15 is a flowchart illustrating an operation method of a home appliance according to the present invention.
16 is a flowchart illustrating an operation method of a smart home system including a speech recognition server system and a home appliance according to the present invention.
17 to 21 are views referred to in explaining various operations of the speech recognition server system and the home appliance according to the present invention.
22 is a diagram showing an example of a platform structure in the control unit of FIG.
23 is a diagram showing an example of the platform structure in the control unit according to the embodiment of the present invention.
24 is a flowchart illustrating an operation method of a home appliance according to an embodiment of the present invention.
25A to 25C are views referred to in the description of the operation method of FIG.
26 is a view showing another example of an internal block diagram of a home appliance according to an embodiment of the present invention.
27 is a diagram illustrating an example of a platform structure in a processor according to an embodiment of the present invention.
Fig. 28 illustrates an example of an internal block diagram of the driving unit of Fig.
29 is an example of an internal circuit diagram of the motor driving apparatus of Fig.
30 is an internal block diagram of the inverter control unit of FIG. 29;

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, it is needless to say that the present invention is not limited to these embodiments and can be modified into various forms.

In the drawings, the same reference numerals are used for the same or similar parts throughout the specification.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description and do not give special significance or role in themselves. Thus, "module" and "part" may be used interchangeably.

FIG. 1 is a schematic view of a smart home system including a speech recognition server system and a home appliance according to an embodiment of the present invention. FIG. 2 is a view for explaining various examples of a home appliance.

Referring to FIG. 1, a smart home system 10 according to an embodiment of the present invention includes a home appliance 200 having a communication module (not shown) and capable of communicating with other devices or connecting to a network, , A voice recognition server system 100 including a plurality of servers for voice recognition and home appliance control.

2, the home appliance 200 may include an air conditioner 200a having a communication module, a robot cleaner 200b, a refrigerator 200c, a washing machine 200d, and a cooking device 200e. have.

In addition, the smart home system 10 according to an embodiment of the present invention may include a mobile terminal (not shown) such as a smart phone, a tablet PC, and the like.

The home appliance 200 may include a communication module to communicate with electronic devices inside / outside the smart home system 10.

The smart home system 10 according to an embodiment of the present invention may further include an access point 300 and the home appliance 200 may be connected to the access point 300 through the access point 300 It can access the wireless Internet network and communicate with other devices.

The access point device 300 can allocate a wired or wireless channel according to a predetermined communication method to the electronic devices in the smart home system 10 and perform wireless data communication through the corresponding channel.

Here, the predetermined communication method may be a Wi-Fi communication method. Correspondingly, the communication module included in the home appliance 200 may be a Wi-Fi communication module, but the present invention is not limited to the communication method.

Alternatively, the home appliance 200 may include other types of communication modules or a plurality of communication modules. For example, the home appliance 200 may include an NFC module, a zigbee communication module, a Bluetooth communication module, and the like.

The home appliance 200 can be connected to a server included in the voice recognition server system 100 or a predetermined external server or a user's mobile terminal through a wi-fi communication module or the like, Smart function can be supported.

The user can check information on the home appliance 200 in the smart home system 10 or control the home appliance 200 through the mobile terminal.

On the other hand, it may be inconvenient for a user to use the mobile terminal even when the user wants to control the home appliance 200 or confirm certain information in the home.

For example, it is more efficient to have a means to control the home appliance 200 in other ways when the user does not know the current location of the mobile terminal or is in another place.

The home appliance 200 according to an embodiment of the present invention can receive a user's voice input and the voice recognition server system 100 recognizes and analyzes the voice input of the user to control the home appliance 200 .

Accordingly, the user can control the home appliance 200 without operating the mobile terminal or the remote control device.

At least some of the servers included in the voice recognition server system 100 may be a server operated by a manufacturer of a home appliance or a sales company, or a server operated by a manufacturer or a company entrusted with a service by a sales company .

3A is an example of a speech recognition server system according to an embodiment of the present invention.

3A, a voice recognition server system 100a according to an embodiment of the present invention includes a voice server 200a for receiving voice data from a home appliance 200a and analyzing voice data received to determine a voice command 110, an associated service server 120, and a home appliance control server 130.

The voice recognition server system 100a according to the embodiment of the present invention receives a signal corresponding to the voice command discriminated from the voice server 110 and generates a request signal corresponding to the discriminated voice command The home server 200 may further include a home appliance control server 130 that transmits a control signal based on a request signal received from the service server 120 and the connection service server 120 to the home appliance 200a.

The voice server 110 receives the voice data from the home appliance 200a, converts the received voice data into text data, and analyzes the text data to determine a voice command.

Further, the voice server 110 can transmit a signal corresponding to the voice command determined to the predetermined server.

The home appliance 200a can receive the voice command input uttered by the user and transmit the voice data based on the received voice command input to the voice server 110. [

The voice server 110 includes an Automatic Speech Recognition (ASR) server 111 that receives voice data from the home appliance 200a and converts the received voice data into text data, (Natural Language Processing: NLP) for receiving text data from the server 111, analyzing the received text data to determine a voice command, and transmitting a response signal based on the determined voice command to the home appliance 200a ) Server 112 and a home appliance 200a that receives a signal including a text corresponding to a response signal, converts the text included in the received signal into voice data, and transmits the voice data to the home appliance 200a And a Text to Speech (TTS) server 113.

The automatic speech recognition server 111 can perform speech recognition on the speech data received from the home appliance 200a to generate text data and transmit the text data to the natural language processing server 112. [

The natural language processing server 112 can analyze the text data received from the automatic speech recognition server 111 according to a natural language processing algorithm to determine a voice command.

The natural language processing server 112 can process a natural language that is a language that a person routinely uses according to a natural language processing algorithm and can analyze the intent of the user. The natural language processing server 112 can perform natural language processing on the text data received from the automatic speech recognition server 111 to determine a voice command that matches the user's intention.

Accordingly, the natural language processing server 112 can determine a voice command that matches the user's intention even if the user inputs a voice command in a daily use language.

The natural language processing server 112 can transmit a signal corresponding to the natural language processing result, that is, a signal corresponding to the discriminated voice command to the linkage service server 120. [

The linking service server 120 can receive the signal corresponding to the voice command discriminated by the voice server 110, particularly the natural language processing server 112, and generate the request signal corresponding to the discriminated voice command.

The connection service server 120 can receive a signal corresponding to the voice command determined by the natural language processing server 112. [

The connection service server 120 can perform a corresponding operation by communicating with the home appliance control server 130 if the determined voice command is related to the home appliance 200a.

Alternatively, if the determined voice command is not related to the home appliance 200a, the connection service server 120 can perform a corresponding operation by communicating with the external service 121.

For example, if the determined voice command is a command for requesting information such as weather, stock, news, etc., the connection service server 120 can request and receive the information from the server providing the service corresponding to the requested information have.

Also, the linking service server 120 may transmit the received information to the voice server 110, and the natural language processing server 112 may transmit the received information to the home appliance 200a.

If the determined voice command is related to the home appliance 200a, the connection service server 120 can generate a request signal corresponding to the determined voice command and transmit it to the home appliance control server 130. [

The home appliance control server 130 may transmit a control signal based on the request signal received from the associated service server 120 to the home appliance 200a.

For example, when a request to change the set temperature of the air conditioner 200a is received, the household appliance control server 130 may transmit a control signal for changing the set temperature to the air conditioner 200a.

Meanwhile, the home appliance 200a may perform a corresponding operation according to a control signal received from the household appliance control server 130. [

In addition, the home appliance 200a may transmit a signal to the home appliance control server 130 indicating that the home appliance 200a has performed the requested operation.

The home appliance control server 130 may receive a response signal to the control signal from the home appliance 200a and transmit the processing result information corresponding to the response signal to the linkage service server 120. [

The voice server 110 can transmit a response signal including the processing result information to the home appliance 200a.

In addition, the voice server 110 receives a signal including an output phrase text corresponding to the processing result information from the home appliance 200a, converts the received output phrase text into voice data, and transmits the voice data to the home appliance 200a .

In this case, the response signal based on the voice command determined by the natural language processing server 112 to be transmitted to the home appliance 200a may include processing result information.

On the other hand, the home appliance 200a can receive a response signal based on the voice command determined by the natural language processing server 112. [ Here, the text data of the response corresponding to the voice command that discriminated the response signal may be included.

For example, when the user inputs a voice command to change the set temperature of the air conditioner, the response signal may include text data indicating that the set temperature has been changed.

On the other hand, the home appliance 200a can transmit a signal including the text corresponding to the received response signal to the text / voice conversion server 113. [ Here, the signal including the text corresponding to the response signal may include an output phrase text corresponding to the processing result information.

On the other hand, the text-to-speech server 113 may convert the text included in the received signal into voice data and transmit the voice data to the home appliance 200a. The converted voice data may include a sound source file.

The home appliance 200a can output the voice guidance message based on the voice data received through the speaker.

On the other hand, the connection service server 120 requests the home appliance control server 130 from the state information of the home appliance 200a based on the signal corresponding to the determined voice command, and the appliance control server 130 requests the home appliance 200a To the link service server 120, status information of the service server 200a. If the state information of the home appliance 200a is not secured, the home appliance control server 130 may request and receive the state information from the home appliance 200a.

On the other hand, when it is possible to support the voice command determined based on the state information of the home appliance 200a, the connection service server 120 transmits a request signal corresponding to the voice command determined by the home appliance control server 130 can do.

Alternatively, when it is impossible to support the voice command determined based on the state information of the home appliance 200a, the linking service server 120 transmits a signal informing the natural language processing server 112 that the function is not supported in the current state Can be transmitted.

Also in this case, the home appliance 200a may request and receive voice data from the text-to-speech conversion server 113 and output a voice guidance message indicating that the voice data is not supported in the current state.

According to the embodiment, the voice server 110 can determine the supportability of the discriminated voice command. For example, the natural language processing server 112 that has analyzed the intention of the user's voice command can determine the supportability of the determined voice command.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the voice command determined by the natural language processing server 112 is not supported by the home appliance 200a It may be a signal informing that it is a non-function.

The voice server 110 and the voice recognition server system 100a including the voice server 110 according to an embodiment of the present invention can organically connect servers having various roles for natural voice processing.

The home appliance 200 performs operations from reception and preprocessing of voice commands to server transmission and the voice server 110 can perform a natural language process such as voice / text conversion, intent analysis, and command identification.

By performing the natural language processing by the voice server 110, burden on the CPU, memory, etc. of the embedded module in the home appliance can be reduced.

Meanwhile, the connection service server 120 may communicate with the external service and home appliance control server 130 to perform an operation based on the voice command of the user.

On the other hand, the home appliance 200 can receive voice data including a sound source file from the voice server 110 and output a voice guidance message to the voice to reply to the voice input of the user through auditory feedback.

The home appliance 200 receives the voice file streaming from the voice server 110 and reproduces and outputs the voice guidance message to the user. Accordingly, the home appliance 200 need not store various sound source files.

Meanwhile, it is possible to link with various external services without colliding with other servers through the connection service server 120. In addition, through the external service interworking server, it is possible to increase the success rate of the intention analysis by reflecting external information in the intention analysis.

The speech recognition server system 100a according to an embodiment of the present invention assures compatibility and connectivity through a plurality of servers and utilizes the home appliance control server 130 as a final control command, The collision between the home appliance control using the Wi-Fi communication through the server 130 and the home appliance control through the mobile terminal and the home appliance control by voice input through the home appliance 200 can be prevented.

The speech recognition server system 100a according to the embodiment of the present invention can reduce the load on a specific server depending on a certain server through an organic connection between the servers, If there is a problem with the server, it can be easily responded to by linking with other servers having the same role.

In addition, a plurality of servers can be independently updated from time to time, which is advantageous for performance improvement.

3B is another example of a speech recognition server system according to an embodiment of the present invention.

The voice recognition server system 100b illustrated in FIG. 3B improves the process of transmitting voice data for voice announcement message output to the home appliance 200a by the voice recognition server system illustrated in FIG. 3A, .

Therefore, the speech recognition server system illustrated in FIG. 3A and FIG. 3B can perform substantially the same operations except for the difference, and the same portions will be briefly described below.

3B, a speech recognition server system according to an embodiment of the present invention includes a voice server 110 that receives voice data from a home appliance 200a and analyzes voice data received to determine a voice command .

In addition, the speech recognition server system 100b according to the embodiment of the present invention receives a signal corresponding to the voice command discriminated from the voice server 110 and generates a request signal corresponding to the discriminated voice command The home server 200 may further include a home appliance control server 130 that transmits a control signal based on a request signal received from the service server 120 and the connection service server 120 to the home appliance 200a.

The voice recognition server system illustrated in FIG. 3B can transmit voice data including processing result information based on a voice command to the home appliance 200a without requiring a request of the home appliance 200a .

The voice server 110 includes an automatic voice recognition server 111 that receives voice data from the home appliance 200a and converts the received voice data into text data, A natural language processing server 112 that analyzes the received text data and determines a voice command, and a text-to-speech conversion server 112 that converts a response signal based on the voice command to voice data and transmits the voice data to the home appliance 200a (113).

Also in this embodiment, the home appliance control server 130 can receive the response signal to the control signal from the home appliance 200a and transmit the process result information corresponding to the response signal to the linkage service server 120. [

The linkage service server 120 can deliver the processing result information to the voice server 110, and more specifically to the natural language processing server 112. [

In this case, the voice data transmitted by the text-to-speech conversion server 113 to the home appliance 200a may include processing result information.

The association service server 120 also requests the home appliance control server for state information of the home appliance 200a on the basis of the signal corresponding to the voice command that has been discriminated. The home appliance control server transmits the state information of the home appliance 200a To the associated service server 120.

When it is possible to support the voice command determined based on the state information of the home appliance 200a, the connection service server 120 transmits a request signal corresponding to the voice command determined by the home appliance control server 130 can do.

Alternatively, when it is impossible to support the voice command determined based on the state information of the home appliance 200a, the connection service server 120 transmits a signal indicating that the voice command is not supported in the current state to the voice server 110 can do.

For example, the linkage service server 120 may send a signal to the natural language processing server 112 indicating that it is an unsupported function in the current state.

In addition, the natural language processing server 112 transmits a signal indicating that it is an unsupported function in the current state to the text-to-speech conversion server 113, and the text-to-speech conversion server 113 generates corresponding voice data and transmits it to the home appliance 200a ). ≪ / RTI >

The home appliance 200a receives the voice data from the text-to-speech conversion server 113 and outputs a voice guidance message indicating that the voice data is not supported in the current state.

According to the embodiment, the voice server 110 can determine the supportability of the discriminated voice command. For example, the natural language processing server 112 that has analyzed the intention of the user's voice command can determine the supportability of the determined voice command.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the voice command determined by the natural language processing server 112 is not supported by the home appliance 200a It may be a signal informing that it is a non-function.

When the home appliance 200a requests the announcement about the corresponding operation to the text-to-speech server 113 for voice guidance for the last time after the operation of the home appliance 200a, a time difference may occur between the operation and the announcement.

However, according to an embodiment of the present invention, when the intention analysis is completed and the operation request is transmitted from the natural language processing server 112, the text voice conversion server 113 can provide information at the same time.

In addition, the text-to-speech conversion server 113 can provide the announcement to the home appliance 200a on the basis of the time when the home appliance control server 130 issues a control command to the home appliance 200a.

Accordingly, the announcement can be made simultaneously or immediately with the operation of the home appliance 200a.

According to the present embodiment, by directly connecting the natural language processing server 112 and the text-to-speech conversion server 113, the time difference between the control command and the announcement through the home appliance control server 130 can be minimized.

3A and 3B, the air conditioner 200a is exemplified as the home appliance 200, but the present invention is not limited thereto. For example, the home appliance 200 may include a robot cleaner 200b, a refrigerator 200c, a washing machine 200d, a cooking device 200e, and the like in addition to the air conditioner 200a.

3A and 3B, an automatic speech recognition server 111, a natural language processing server 112, and a text-to-speech conversion server 113 for speech recognition and processing are integrated Server.

Also, according to an embodiment, the connection service server 120 and the home appliance control server 130 may be configured as one integrated server.

According to the present invention, since the home appliance operates according to the voice input, it is not necessary for the user to operate the remote control device such as the remote controller, the mobile terminal, etc., and the user convenience can be increased.

As described with reference to FIGS. 3A and 3B, the present invention recognizes a user's natural language voice command using a plurality of servers, and performs a corresponding control operation so that the system resources of the home appliance, Natural language can be recognized and processed efficiently without limitation.

FIGS. 4 to 6 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention, which illustrates a signal flow of a speech recognition server system illustrated in FIG. 3A.

4 illustrates signal flow in a typical situation in which the home appliance operates in response to a user's voice command.

Hereinafter, the air conditioner 200a will be described with reference to the home appliance 200, but the present invention is not limited thereto.

Referring to FIG. 4, the home appliance 200, for example, the air conditioner 200a according to the embodiment of the present invention can receive a voice command of a user (S410) Command to the voice server 110 (S420).

For example, when the user receives an instruction to change the temperature setting such as "LG Whishen, temperature 18 degrees ", the air conditioner 200a converts the received voice command into a digital Converted into voice data, and transmitted to the automatic voice recognition server 111.

On the other hand, after receiving the wake up signal including the caller, the air conditioner 200a can transmit a voice command input to the voice server 110 while waiting for command input.

Alternatively, the air conditioner 200a may receive continuous speech input including a caller and a voice command. In this case, the air conditioner 200a can recognize the caller and transmit the voice command to the voice server 110. [

Meanwhile, when communicating with each other in the system 10, signals transmitted and received include identification information (ID) of each device, a session value for a task to be performed, and the like, in addition to main data to be exchanged .

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S431), and transmits the text data to the natural language processing server 112 (S433).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S441).

For example, the natural language processing server 112 can determine the voice command of the intention to change the set temperature of the air conditioner 200a to 18 degrees at "LG Whishen, temperature 18 degrees Celsius ".

The natural language processing server 112 can transmit the signal corresponding to the discriminated voice command to the link service server 120 (S443).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S451, the home appliance control server 130 transmits the current state information of the air conditioner 200a (S453), and transmits the current status information of the air conditioner 200a to the connection service server 120 (S455).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a .

On the other hand, after receiving the status information, the connection service server 120 transmits a request signal to the home appliance control server 130 to change the set temperature of the corresponding air conditioner 200a by 18 degrees in accordance with the voice command that has been determined (S461).

The home appliance control server 130 generates a control signal based on the request signal and transmits the control signal to the air conditioner 200a to control the air conditioner 200a (S463).

After the control of the air conditioner 200a, the home appliance control server 130 receives a response signal to the control signal from the home appliance and transmits processing result information indicating that the operation for the request is successful to the connection service server 120 (S465).

The connection service server 120 can transmit a signal corresponding to the processing result information to the natural language processing server 112 (S470), such as "set the air condition temperature to 18 degrees" A response signal based on the user's voice command can be transmitted to the home appliance 200a (S481). Here, the response signal based on the voice command of the discriminating user may include the processing result information.

On the other hand, the home appliance 200a transmits a signal including a text (output phrase) corresponding to the response signal (S483), and the text-to-speech conversion server 113 receives the text included in the received signal as speech data (S485), and transmits it to the home appliance 200a (S487).

The home appliance 200a can output a voice guidance message such as "Set the air conditioner temperature to 18 degrees" based on the received voice data (S490).

FIG. 5 illustrates signal flow when requesting a non-serving function of the home appliance.

5, the air conditioner 200a according to the embodiment of the present invention receives a voice command of the user for a laundry function not supported by the air conditioner 200a such as "LG Whishen, (S510).

The air conditioner 200a can transmit the voice command of the received user to the voice server 110 (S520). The air conditioner 200a can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit it to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S531), and transmits the text data to the natural language processing server 112 (S533).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S541).

Further, the natural language processing server 112 can determine whether or not support of the discriminated voice command is possible. In this embodiment, the natural language processing server 112 can determine that the user has requested the laundry function not supported by the air conditioner 200a.

Thereafter, the natural language processing server 112 can transmit a response signal indicating that the voice command determined by the air conditioner 200a is a function not supported by the home appliance (S543).

On the other hand, the home appliance 200a transmits a signal including a text (output phrase) corresponding to the response signal (S551), and the text-to-speech conversion server 113 receives the text included in the received signal Converted into voice data (S553), and transmitted to the home appliance 200a (S555).

The home appliance 200a can output a voice guidance message such as "This is a function that is not supported" based on the received voice data (S560).

6 illustrates signal flow when requesting a non-serving function in the current operating mode of the home appliance.

Referring to FIG. 6, the air conditioner 200a according to an embodiment of the present invention receives a voice command of a user instructing a specific mode operation of the air conditioner 200a, such as "LG Whishen, (S610).

The air conditioner 200a can transmit the voice command of the received user to the voice server 110 (S620). The air conditioner 200a can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit it to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S631), and transmits the text data to the natural language processing server 112 (S633).

The natural language processing server 112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S641).

For example, the natural language processing server 112 can determine a voice command that the user intends to operate the air conditioner 200a in the cool power mode at "LG Whishen, CoolPower Startup ".

The natural language processing server 112 can transmit a signal corresponding to the identified voice command to the link service server 120 (S643).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S651, the home appliance control server 130 transmits the current state information of the air conditioner 200a (S653), and the current state information of the air conditioner 200a can be transmitted to the linked service server 120 (S655).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a.

Meanwhile, after receiving the status information, the connection service server 120 can determine whether or not the voice command that is determined based on the current status information of the air conditioner 200a can be supported (S657).

For example, when the current air conditioner 200a is operating in the dehumidification mode and the cool power mode is supported only in the cooling mode, the natural language processing server 112 sets the cool power mode, which is not supported in the current state, It can be determined that the request has been made.

Thereafter, the connection service server 120 can transmit a response signal indicating that the voice command determined by the natural language processing server 112 is a function that the home appliance 200a does not support in the present state (S660).

In addition, the natural language processing server 112 can transmit a response signal indicating that the determined voice command is a function that the home appliance 200a does not support in the current state (S671).

On the other hand, the home appliance 200a transmits a signal including a text (output phrase) corresponding to the response signal (S673), and the text-to-speech server 113 receives the text included in the received signal (S675), and can transmit the voice data to the home appliance 200a (S677).

The home appliance 200a can output a voice guidance message such as "Cool Power is supported only in the cooling mode" based on the received voice data (S680).

7 to 9 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention, and are a diagram illustrating a signal flow of a speech recognition server system illustrated in FIG. 3B.

7 illustrates a signal flow in a typical situation in which the home appliance operates according to a user's voice command.

7, the home appliance 200, for example, the air conditioner 200a according to an exemplary embodiment of the present invention can receive a voice command of a user (S710) To the voice server 110 (S720).

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S731), and transmits the text data to the natural language processing server 112 (S733).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S741).

For example, the natural language processing server 112 can determine a voice command that the user intends to change the set temperature of the air conditioner 200a to 18 degrees at "LG Whischen, temperature 18 degrees Celsius ".

The natural language processing server 112 can transmit a signal corresponding to the discriminated voice command to the link service server 120 (S743).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S751, the home appliance control server 130 inquires current state information of the air conditioner 200a (S753), and the current state information of the air conditioner 200a can be transmitted to the linking service server 120 (S755).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a.

On the other hand, upon receiving the status information, the connection service server 120 may transmit a request signal to the home appliance control server 130 to change the set temperature of the corresponding air conditioner 200a by 18 degrees according to the determined voice command ( S761).

The home appliance control server 130 generates a control signal based on the request signal and transmits it to the air conditioner 200a to control the air conditioner 200a (S763).

The home appliance control server 130 receives the response signal to the control signal from the home appliance after the control of the air conditioner 200a and transmits the processing result information indicating that the operation for the request is successful to the connection service server 120 (S765).

The linking service server 120 can transmit a signal corresponding to the processing result information to the natural language processing server 112 such as "set the air conditioning temperature to 18 degrees" (S770).

On the other hand, the natural language processing server 112 can transmit a response signal based on the voice command of the discriminating user to the text / voice conversion server 113 (S781). Here, the response signal based on the voice command of the discriminating user may include the processing result information.

On the other hand, the text-to-speech conversion server 113 converts the response signal based on the voice command into voice data (S783) and transmits the voice data to the home appliance 200a (S785).

The home appliance 200a can output a voice guidance message such as "Set the air conditioner temperature to 18 degrees" based on the received voice data (S790).

FIG. 8 illustrates a signal flow when requesting a non-supported function of the home appliance.

Referring to FIG. 8, the air conditioner 200a according to an embodiment of the present invention receives a user's voice command for a laundry function not supported by the air conditioner 200a, such as "LG Whishen, (S810).

The air conditioner 200a may transmit the voice command of the received user to the voice server 110 (S820). The air conditioner 200a may convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S831), and transmits the text data to the natural language processing server 112 (S833).

The natural language processing server 112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S841).

In addition, the natural language processing server 112 can determine the supportability of the discriminated voice command. In this embodiment, the natural language processing server 112 can determine that the user has requested the laundry function not supported by the air conditioner 200a.

Thereafter, the natural language processing server 112 can transmit a response signal indicating that the voice command determined by the text-to-speech conversion server 113 is a function not supported by the home appliance (S843).

The text-to-speech conversion server 113 converts the response signal based on the voice command into voice data (S845) and transmits it to the home appliance 200a (S847).

The home appliance 200a can output a voice guidance message such as "This is a function that is not supported" based on the received voice data (S850).

FIG. 9 illustrates signal flow when requesting a non-serving function in the current operating mode of the home appliance.

Referring to FIG. 9, the air conditioner 200a according to the embodiment of the present invention receives a voice command of a user instructing a specific mode operation of the air conditioner 200a, such as "LG Whishen, (S910).

The air conditioner 200a can transmit the voice command of the received user to the voice server 110 (S920). The air conditioner 200a may convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S931), and transmits the text data to the natural language processing server 112 (S933).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S941).

For example, the natural language processing server 112 can determine the voice command of the intention of the user to operate the air conditioner 200a in the cool power mode at "LG Whishen, CoolPower Startup ".

The natural language processing server 112 can transmit a signal corresponding to the identified voice command to the link service server 120 (S943).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S951, the home appliance control server 130 inquires current state information of the air conditioner 200a (S953), the current state information of the air conditioner 200a can be transmitted to the linking service server 120 (S955).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a.

On the other hand, the connection service server 120 receiving the status information can determine whether or not the voice command can be supported based on the current status information of the air conditioner 200a (S957). For example, when the current air conditioner 200a is operating in the dehumidification mode and the cool power mode is supported only in the cooling mode, the natural language processing server 112 requests the cool power mode, which is not supported in the current state, Can be determined.

Thereafter, the connection service server 120 may transmit a response signal indicating that the voice command determined by the natural language processing server 112 is a function that the home appliance 200a does not support in the present state (S960).

In addition, a response signal indicating that the voice command determined by the natural language processing server 112 is a function not supported by the text-to-speech conversion server 113 in the current state can be transmitted (S971).

On the other hand, the text-to-speech conversion server 113 converts the response signal based on the voice command into voice data (S973) and transmits the voice data to the home appliance 200a (S975).

The home appliance 200a can output a voice guidance message such as "Cool Power is supported only in cooling mode" based on the received voice data (S980).

According to the present invention, it is possible to implement a user experience that provides appropriate voice guidance for cases in which a command of a user is not understood or a function that can not be provided.

By providing an announcement tailored to each situation and time occurring during command processing, the inconvenience of the user can be minimized.

10 is a block diagram of an internal block diagram of a server according to an embodiment of the present invention. The server includes an automatic speech recognition server 111, a natural language processing server 112, a text-to-speech conversion server 113, A connection service server 120, and a home appliance control server 130.

Referring to FIG. 10, the server may include a communication module 1020, a storage unit 1030, and a processor 1010.

The processor 1010 can control the overall operation of the server.

The communication module 1020 can receive various data such as status information, operation information, operation information, voice data, and character data from a home appliance such as a mobile terminal, an air conditioner, or another server.

The communication module 1020 can transmit the data corresponding to the received various information as it is or after predetermined processing to a home appliance such as a mobile terminal, an air conditioner, or another server.

To this end, the communication module 1020 may include one or more communication modules such as an Internet module, a mobile communication module, and the like.

The storage unit 1030 may store the received information and may have data for generating the corresponding result information.

The storage unit 1030 may store data for operation of the server. For example, in the case of the automatic speech recognition server 111, an automatic speech recognition algorithm and the like are stored in the storage unit 1030. In the case of the home appliance control server 130, the product information of the home appliance, Can be stored.

Meanwhile, the server may be a server operated by a home appliance manufacturer such as an air conditioner or a server operated by a service provider, or may be a kind of a cloud server.

11 is a block diagram illustrating an example of an internal block diagram of a home appliance according to an embodiment of the present invention.

11, a home appliance 200 according to an exemplary embodiment of the present invention includes a camera 210, an audio input unit 220 for receiving a voice command of a user, an operation unit 230, a memory A communication unit 270 for wirelessly communicating with other electronic devices, a driver 280 for performing operations implemented in the respective home appliances, a display 292 for displaying predetermined information as images, An audio output unit 291, and a control unit 240 for controlling the overall operation.

The audio input unit 220 can receive external audio signals and user voice commands. To this end, the audio input unit 220 may include one or more microphones (MICs). In addition, the audio input unit 220 may include a plurality of microphones 221 and 222 in order to more accurately receive a user's voice command. The plurality of microphones 221 and 222 can be disposed at different positions and can acquire an external audio signal and process it as an electrical signal.

11 and the like, the audio input unit 220 includes two microphones including a first microphone 221 and a second microphone 222, but the present invention is not limited thereto.

The audio input unit 220 may include a processor for converting analog sound into digital data, or may be connected to a processing unit to convert user input voice commands into data to be recognized by the controller 240 or a predetermined server.

Meanwhile, the audio input unit 220 may use various noise reduction algorithms for eliminating noise generated in the process of receiving a voice command of a user.

The audio input unit 220 may include a filter for removing noise from an audio signal received from each of the microphones 221 and 222 and an amplifier for amplifying and outputting a signal output from the filter, .

The memory 250 records various kinds of information necessary for the operation of the home appliance, and may include a volatile or nonvolatile recording medium. The storage medium stores data that can be read by a microprocessor, and includes a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD- Tape, floppy disk, optical data storage, and the like.

Meanwhile, the memory 250 may store data for voice recognition, and the control unit 240 may process the voice input signal of the user received through the audio input unit 220 and perform a voice recognition process.

Meanwhile, a simple speech recognition may be performed by the home appliance 200, and a high-level speech recognition such as natural language processing may be performed in the speech recognition server system 100.

For example, in the case where a wake up voice signal including a preset caller is received, the home appliance 200 can be switched to a state for receiving a voice command. In this case, the home appliance 200 performs only the voice recognition process up to the voice input of the caller, and voice recognition for the subsequent voice input of the user can be performed through the voice recognition server system 100.

Home appliances Because there is a limit to these system resources, complex natural language recognition and processing can be performed through the speech recognition server system 100.

Limited data may be stored in the memory 250. [ For example, in the memory 250, data for recognizing a wake up voice signal including a preset caller may be stored. In this case, the control unit 240 can recognize a wake-up voice signal including a preset caller from the voice input signal of the user received through the audio input unit 220. [

On the other hand, the caller can be set by the manufacturer, and another caller can be set for each home appliance. For example, "LG whisen " in the case of an air conditioner and" LG dios "in the case of a refrigerator may be set as an invocation word.

In addition, the caller can be changed by the user.

The control unit 240 can control the voice recognition server system 100 to transmit the voice command of the user inputted after recognizing the wake up voice signal to the voice recognition server system 100 through the communication unit 270. [

The communication unit 270 includes one or more communication modules and can perform wireless communication with other electronic devices to exchange various signals. For example, the communication unit 270 can communicate with electronic devices inside / outside the mall home system 10. [

The communication unit 270 may communicate with the access point 300 and may access the wireless Internet network through the access point 300 to communicate with other devices.

The control unit 240 can also transmit the state information of the home appliance 200, voice commands of the user, and the like to the voice recognition server system 100 or the like through the communication unit 270.

Meanwhile, when a control signal is received through the communication unit 270, the control unit 240 may control the home appliance 200 to operate according to the received control signal.

The display 292 can display information corresponding to a command input by a user, a processing result corresponding to a command input by the user, an operation mode, an operation state, an error state, and the like.

According to an embodiment, the display 292 may be configured as a touch screen by forming a mutual layer structure with the touch pad. In this case, the display 292 may be used as an input device capable of inputting information by a user's touch in addition to the output device.

The audio output unit 291 outputs a notification message such as a warning sound, an operation mode, an operation state, an error state, etc., information corresponding to a command input by the user, a process corresponding to a command input by the user And output the result as audio.

On the other hand, the audio output unit 291 can convert the electrical signal from the control unit 240 into an audio signal and output it. For this purpose, a speaker or the like may be provided.

The driving unit 280 performs an operation implemented in the home appliance, and may be configured differently for each home appliance.

For example, when the home appliance is a refrigerator, the driving unit 280 includes a refrigerator compartment driving unit for operating a refrigerator compartment fan for supplying cooled air to the refrigerator compartment, a freezer compartment driving unit for operating a freezer compartment fan for supplying cooled air to the freezer compartment, A compressor driving unit for operating a compressor for compressing the refrigerant, and the like.

As another example, when the home appliance is a washing machine, the driving unit 280 may include a driving unit for driving the drum or the tub.

As another example, when the home appliance is an air conditioner, the driving unit 280 includes a compressor driving unit for driving the compressor in the outdoor unit, an outdoor fan driving unit for operating the outdoor fan for heat exchange, A fan drive unit, and the like.

As another example, when the home appliance is a cooker, the driving unit 280 may include a microwave driving unit that outputs microwaves into the cavity.

As another example, when the home appliance is a cleaner, the driving unit 280 may include a fan motor driving unit for air suction.

The home appliance 200 may further include an operation unit 230 for user input and a camera 210 for photographing a predetermined range around the home appliance 200.

The operation unit 230 may include a plurality of operation buttons, and may transmit a signal corresponding to the input button to the control unit 240.

The camera 210 photographs the surroundings of the home appliance 200, the external environment, and the like.

For example, the camera 210 may include at least one optical lens and an image sensor (e.g., an optical sensor) configured to include a plurality of photodiodes (e.g., pixels) that are imaged by light passing through the optical lens. A CMOS image sensor, and a digital signal processor (DSP) that forms an image based on signals output from the photodiodes. The digital signal processor is capable of generating moving images composed of still frames as well as still images.

Meanwhile, the image captured by the camera 210 may be stored in the memory 250.

FIG. 12 is a view showing a part of an internal block diagram of an air conditioner according to an embodiment of the present invention, and FIGS. 13 and 14 are views schematically showing an appearance of an air conditioner according to an embodiment of the present invention to be.

12 is a view showing a state in which the home appliance illustrated in Fig. 11 is the air conditioner 200a illustrated in Figs. 13 and 14, and the vane driver 200a included in the driving unit 280a of the air conditioner 200a, (1210) and a fan driving unit (1220).

FIG. 13 and FIG. 14 are views briefly showing an appearance of an indoor unit of an air conditioner according to an embodiment of the present invention.

11 to 14, an air conditioner 200a according to an embodiment of the present invention includes microphones 221 and 222 that receive voice commands of a user, a communication unit 270 that wirelessly communicates with other electronic devices, A control unit 240 for controlling the overall operation, and a vane driving unit 1210 for driving the vane under the control of the control unit 240.

In addition, the air conditioner 200a according to an embodiment of the present invention may further include a fan driving unit 1220 for driving the fan under the control of the control unit 240. [

The microphones 221 and 222 can receive external audio signals and user voice commands. Also, the microphones 221 and 222 can acquire external audio signals and user voice commands and process them as electrical signals.

The air conditioner 200a of the present embodiment includes a suction body 202 having an air inlet (not shown), a heat exchanger (not shown) through which the air sucked by the air inlet is passed, air sucked into the air inlet, And a discharge port 207R, 207U, 207D formed to discharge air back into the room.

The air outlets 207R, 207U, and 207D are provided with wind direction adjusting means such as louvers (not shown) and / or vanes 261R, 261L, 261U, and 261D that open / close the air outlets 190 to adjust the air- And the angle and direction of the wind direction adjusting means can be switched by driving the motor or the like under the control of the control unit 240. [ Accordingly, the airflow direction of the air discharged through the discharge ports 207R, 207U, and 207D can be adjusted. Further, by controlling the operation of the wind direction adjusting means, it is possible to adjust the blowing direction of the airflow, the blowing range, and the like.

For example, the vanes 261R, 261L, 261U, and 261D may be fixed in either direction so as to blow air in either direction, or an operation in which the direction of the vane continues to change within a set range (Hereinafter referred to as "swinging operation") is performed so that the blowing operation can be performed over a predetermined range in which the blowing direction is continuously changed within the set range. Further, by adjusting the angular range in which the swing motion of the vanes 261R, 261L, 261U, and 261D is performed, the range in which the blowing is performed can be further narrowed or widened.

Meanwhile, the inside of the air conditioner is provided with a fan for controlling the flow of indoor air sucked into the indoor air through the air outlets 207R, 207U, and 207D to the indoor space. The fan is driven by the fan driving unit 1220 And the operation of the fan driving unit 1220 is controlled by the control unit 240. [

Accordingly, the control unit 240 controls the vane driving unit 1210 and the fan driving unit 1220 to control the direction of the airflow (airflow) discharged from the air conditioner 200a. The controller 240 controls the speed of the fan motor to control the amount and speed of the airflow, and controls the direction of the airflow by controlling the louver, the vane, and the like.

On the other hand, the air conditioner may include a plurality of vanes 261R, 261L, 261U, and 261D. Also, at least some of the plurality of vanes 261R, 261L, 261U, 261D may operate in different ways.

For example, the upper vane 261U can be raised and lowered on the upper portion of the fan, and can be raised and lowered during operation. To this end, the air conditioner 200a may include a lifting mechanism 1211 for lifting the upper vane 261U.

The upper vane 261U may function as an upper discharge body for discharging at least a part of the air blown from the fan through the air outlet 207U to the room.

The suction body 202 may be installed above the base 201. The suction body 202 can form the outer surface of the rear side of the air conditioner together with the base 201. [ The suction body 202 can form the upper surface of the rear surface of the air conditioner. The suction body 202 may constitute a rear case of the air conditioner together with the base 201. The suction body 202 may be a rear upper case of the air conditioner, It may be a rear lower case.

A control unit 240 for controlling various electrical components of the air conditioner may be installed in the base 201. Here, various electric components of the air conditioner may include fans and the like. The base 201 may be provided with a base cover 225 disposed in front of the base 201.

The air conditioner may further include a purifying unit (not shown) for purifying the air. The purifying unit may be disposed in the suction body 202. The purifying unit may be disposed before the heat exchanger in the air flow direction. The purifying unit can be disposed between the suction body 202 and the heat exchanger, and is disposed behind the suction body 202. The purifying unit may include a filter for filtering foreign matter in the air. The purifying unit may include an ion generator for generating ions in the air. The purifying unit may include an electrostatic precipitator for discharging foreign matter in the air to collect the dust. The purification unit may include at least one of a filter, an ion generator, and an electrostatic precipitator.

The heat exchanger may be located in front of the air inlet. The heat exchanger can heat-exchange the air sucked into the air inlet with the refrigerant. The heat exchanger may be installed between the air inlet and the fan.

When the compressor installed in the outdoor unit is driven, the air conditioner can cool the low-temperature and low-pressure refrigerant through the heat exchanger, and the heat exchanger can cool the air passing through the air inlet. When the compressor is on, the heat exchanger can cool the air by exchanging heat between the refrigerant and the air, and the air conditioner can function as a cooler.

The fan may be located in front of the heat exchanger. The fan may be constituted by a centrifugal fan that sucks air in the rear and blows air in at least one of the upper, lower, left, and right directions. The fan can consist of a sirocco fan. The fan may be a sirocco fan that blows air in four directions: up, down, left, and right.

The fan may include a plurality of blowing fans. The plurality of blowing fans can be sequentially arranged in the vertical direction. Each of the plurality of blowing fans may be constituted by a sirocco fan. The upper vane 261U,

An upper front air outlet 207U may be formed on the front surface of the upper vane 261U. An air inlet (not shown) may be formed on the lower surface of the upper vane 261U to allow the air blown from the fan upward. The upper vane 261U can guide the air blown upward from the inner fan in the forward direction.

The upper vane 261U may be arranged to be raised and lowered above the fan. When the upper vane 261U rises, the upper front air outlet 207U can be raised to discharge air, and the upper front air outlet 207U can be concealed when the vane 261U is lowered.

The air conditioner may further include an elevation guide 208 for guiding the elevation of the upper vane 261U. The elevation guide 208 may be installed above the fan and heat exchanger. The upper vane 261U is positioned on the upper side of the elevation guide 208 to discharge air when the upper vane 261U rises and the upper front air discharge port 207U is positioned on the inner side of the elevation guide 208 And can be concealed.

The elevating mechanism 1211 may include a driving source such as a motor and a power transmitting member for raising and lowering the upper vane 261U when the driving source is driven. The power transmitting member may include a pinion installed on the drive source and a rack engaged with the pinion.

The lifting mechanism 1211 may be raised to a different height depending on the operation mode. The control unit 240 can control the lifting mechanism 1211 according to the selection of the operation mode of the user.

For example, the control unit 240 may raise the upper vane 261U to the maximum opening height at which the upper front air outlet 207U is maximally opened, or only a part of the upper front air outlet 207U may be opened So that the upper vane 261U can be raised.

A side air outlet 207R through which the air blown in the lateral direction from the fan passes may be formed on the side surface of the air conditioner 200a.

Side vanes 261R and 261L can be disposed on the side surface of the air conditioner, which can control the direction of the air blown from the fan to the side and open and close the left air outlet and the right air outlet 207R. The side vanes 261R and 261L may include a left vane 261L and a right vane 261R.

The side vanes 261R and 261L may be rotatably installed. The air conditioner may include side driving mechanisms 1212 and 1213 for rotating the side vanes 261R and 261L. The side drive mechanisms 1212 and 1213 may include a left vane drive mechanism 1212 and a right vane drive mechanism 1213. [

The side driving mechanisms 1212 and 1213 may include a driving source such as a motor. The side drive mechanisms 1212 and 1213 may include at least one power transmitting member such as a link or a gear that is connected to the drive source and rotates the side vanes 261R and 261L when the drive source is driven.

The side drive mechanisms 1212 and 1213 can be controlled by the control unit 240 in the open mode during the cooling operation. The side drive mechanisms 1212 and 1213 can rotate the left vane 261L and the right vane 261R at a predetermined opening angle under the control of the control unit 240. [

Thus, the blowing direction can be controlled, and blowing can be performed in a range set in a manner that continuously changes the blowing direction within the set range by causing the swinging operation to be performed. In addition, by adjusting the angle range in which the swing motion is performed, the range in which the blowing is performed can be further narrowed or broadened.

The air conditioner may further include a lower vane 261D having a lower front air outlet 207D formed therein.

The lower vane 261D can discharge the air blown downward from the fan in the forward direction. The lower vane 261D may have a passage through which air flows. A lower front air discharge port 207D for discharging air to the outside may be formed on the front surface of the lower vane 261D. .

The air conditioner may further include an opening / closing mechanism 1214 for opening / closing the lower front air outlet 207D. The opening and closing mechanism 1214 may include a moving kit (not shown) for moving the lower vane 261D to open and close the lower front air outlet 207D. The moving kit may include a driving source such as a motor, a moving kit carrier on which the moving kit is placed, and at least one power transmitting member for moving the moving kit carrier when the driving source is driven.

The lower vane 261D is advanced to cover the lower front air outlet 207D and can be retracted to open the lower front air outlet 207D.

The opening / closing mechanism 1214 can be controlled to an open mode in which the lower front air outlet 207D is opened during operation in a predetermined mode.

The air conditioner may further include a blower cover 282 disposed in front of the fan, and the blower cover 282 may form an upper front surface of the air conditioner. The blower cover 282 can be disposed on the upper side of the base cover 225 and can form an outer appearance of the front side of the air conditioner together with the base cover 225. The blower cover 282 can constitute the front cover of the air conditioner together with the base cover 225. The blower cover 282 may be a front upper cover of the air conditioner, and the base cover 225 may be a front lower cover of the air conditioner.

The air conditioner may be provided with a display 292 for displaying various information. The air conditioner may further include an audio output unit 291 for outputting an audio signal, and a speaker of the audio output unit 291 may be disposed on a front surface of the air conditioner or at an appropriate position.

  In addition, the air conditioner may include an operation unit 230 having a plurality of buttons for inputting various commands, and a camera 210 capable of photographing a predetermined range around the home appliance 200.

According to one aspect of the present invention, a front panel 1300 is disposed on the front surface of the blower cover 282 or the base cover 225, and a display 292, an audio output unit 291, Speakers, and operation buttons of the operation unit 230 can be disposed.

 The air conditioner can be operated according to a plurality of operation modes. The control unit 240 can control the vane driver 1210, the fan driver 1220, and the like according to the selected operation mode.

For example, in the predetermined operation mode, the control unit 240 can control the plurality of vanes 261R, 261L, 261U, and 261D to open all the discharge ports.

Or in the predetermined operation mode, the control unit 240 can control the specific vane to be closed without opening the discharge port. For example, in the predetermined operation mode, the controller 240 can control the lower vane 261D to be closed.

In addition, the controller 240 can adjust the opening angle of the upper vane 261R and the left and right vanes 261R and 261L in accordance with the operation mode.

In addition, the control unit 240 can adjust the air volume by controlling the rotation speed of the fan according to the operation mode.

On the other hand, the appearance and structure of the air conditioner illustrated in Figs. 13 and 14 are illustrative, and the present invention is not limited thereto. For example, the positions, numbers, structures, and the like of the microphones 221 and 222, the camera 210, the audio output unit 291, and the vanes 261R, 261L, 261U, and 261D may vary according to design specifications.

15 is a flowchart illustrating an operation method of a home appliance according to the present invention.

Referring to FIG. 15, the home appliance 200 can activate the voice recognition function by user input (S1510). The control unit 240 of the home appliance 200 can activate the microphones 221 and 222 according to user input.

Alternatively, the home appliance 200 may automatically activate the voice recognition function according to the setting for activating the voice recognition function.

For example, when the power is turned on, the home appliance 200 can automatically activate the microphones 221 and 222 and activate the voice recognition function.

When a voice input is received from the user while the microphones 221 and 222 of the home appliance are activated, the microphones 221 and 222 receive the input voice and can transmit the input voice to the control unit 240.

Meanwhile, the home appliance 200 may enter a wake up signal standby mode for inputting a wake up voice signal including a preset caller (S1515).

If a wake-up voice signal including a predetermined caller is received via the microphones 221 and 222 (S1520), the home appliance 200 switches to a command standby mode for receiving a voice command (S1525).

If the home appliance 200 always waits for a natural language command, the power consumed by the voice recognition function, the CPU occupation rate, and the load on the server of the voice recognition server system are burdensome.

Therefore, the home appliance 200 can transmit only the voice signal coming in the standby state of the command to the server.

In addition, the home appliance 200 provides a condition at a time of waiting for an instruction, and when receiving an instruction within a time, the home appliance 200 can receive a sound until the completion of the instruction and transmit the sound to the server.

According to one aspect of the present invention, the home appliance 200 performs only a voice recognition process up to whether a caller voice is input, and voice recognition for a subsequent user voice input can be performed through the voice recognition server system 100 .

On the other hand, the caller can be set by the manufacturer, and another caller can be set for each home appliance. For example, "LG Whishen" for an air conditioner, "LG Dios" for a refrigerator, and "LGTorm" for a washing machine can be set as an invocation word. On the other hand, the caller can be changed by the user.

On the other hand, the control unit 240 can control the voice recognition server system 100 to transmit the voice command of the user inputted after recognizing the wake up voice signal to the voice recognition server system 100 through the communication unit 270 S1530).

On the other hand, waiting indefinitely for a user's voice command is wasteful of system resources and does not match the intention of a user who does not input a command. Therefore, in the command standby mode, only voice commands input during a predetermined elapsed time can be set to be processed ).

In this case, the control unit 240 may control to transmit the voice data including the voice command received within a predetermined elapsed time to the voice server 110 (S1530).

On the other hand, if no voice command is received within a preset elapsed time (S1527), the control unit 240 can control to switch to the wake-up signal standby mode again.

According to an embodiment, when a voice command is received within a preset elapsed time (S1527), the controller 240 performs a feedback operation corresponding to reception of the command to notify the user that the home appliance 200 has received the command (S1529).

In this case, according to the control of the control unit 240, the driving unit 280 can perform a preset operation.

For example, when the home appliance 200 is the air conditioner 200a, the driving unit 280 may include a vane driving unit 1210, a fan driving unit 1220, and the like.

As voice commands are received within a predetermined elapsed time, the vane driver 1210 may drive one or more vanes 261R, 261L, 261U, and 261D to perform at least one of elevating, moving, rotating, have.

For example, the lifting mechanism 1211 can lift the upper vane 261U. In a state in which the upper vane 261U is closed without opening the discharge port 207U, the lifting mechanism 1211 can raise the upper vane 261U to a predetermined height.

The left vane drive mechanism 1212 and the right vane drive mechanism 1213 can rotate the left vane 261L and the right vane 261R by a predetermined angle under the control of the control unit 240. [

The left vane drive mechanism 1212 and the right vane drive mechanism 1213 can also be controlled to perform a swing operation in which the left vane 261L and the right vane 261R repeatedly rotate within a predetermined range.

Further, the opening / closing mechanism 1214 can advance the lower vane 261D inwards to open the lower front air outlet 207D.

According to an embodiment of the present invention, when a voice command is received within a preset elapsed time, the vanes 261R, 261L, 261U, and 261D are moved to intuitively inform the user of the reception of the command, .

When the user inputs voice commands to the air conditioner 200a, since most of the cases are intended to operate the air conditioner 200a, the vanes 261R, 261L, 261U, and 261D are moved preliminarily, The user can respond to the voice command more quickly.

On the other hand, the fan driving unit 1220 can drive the fan as the voice command is received within a preset elapsed time.

For example, the fan driving unit 1220 can rotate the stopped fan. Or the fan driving unit 1220 can lower or stop the rotational speed of the rotating fan.

Meanwhile, the voice server 110 and the voice recognition server system 100 including the voice server 110 recognize and process voice data including voice commands received from the home appliance 200, as described with reference to FIGS. 1 to 9 .

Accordingly, when the communication unit 270 receives the control signal based on the voice command from the home appliance control server 130 (S1540), the control unit 240 controls the home appliance 200 to operate in accordance with the received control signal (S1545).

When the communication unit 270 receives a response signal based on the voice command from the voice server 110 in step S1550, the control unit 240 controls the audio output unit 291 to output the voice guidance message corresponding to the received response signal, (S1570).

The control unit 240 requests the voice server 110 to send voice data in step S1565 and transmits the voice data requested by the voice server 110 to the voice server 110. [ Can be controlled.

On the other hand, according to the speech recognition result, the signal corresponding to the speech recognition failure can be received from the speech server 110 through the communication unit 270. In this case, the control unit 240 may control the audio output unit 291 to output a voice guidance message requesting re-input of the voice command, and to switch to the command standby mode again.

In accordance with the discrimination of supportability of the discriminated voice command, a signal indicating that the voice command is not supported from the voice server 110 through the communication unit 270 can be received (S1535). In this case, the control unit 240 can control the audio output unit 291 to output a voice guidance message informing that the voice command is related to the unsupported function.

In this case, the control unit 240 can control to switch to the wake-up signal standby mode.

Alternatively, the control unit 240 can again control to switch to the command standby mode.

According to the present invention, by providing a voice guidance message for each situation, it is possible to accurately grasp at which stage a voice control command is not normally controlled. In addition, the degree of freedom of commands for controlling the product is high, and usability is improved.

16 is a flowchart illustrating an operation method of a smart home system including a speech recognition server system and a home appliance according to the present invention.

16, the home appliance 200 activates the voice recognition function (S1611) to enter a wake-up signal standby mode for inputting a wake-up voice signal including a preset caller (S1612).

When the preset callers such as " LG Whishen ", "LG Dios "," LG Tromm ", and "LG Signature" are input through the microphones 221 and 222 (S1613), the home appliance 200 receives (S1614). ≪ / RTI >

In the command standby mode, it is possible to set to process only voice commands input during a predetermined elapsed time (S1615). For example, an elapsed time of 6 seconds may be set, and in this case, the control unit 240 may control to transmit the voice data including the voice command received within 6 seconds to the voice server 110 ( S1621).

On the other hand, if no voice command is received within a preset elapsed time (S1621), the control unit 240 can control to switch to the wake-up signal standby mode again.

According to one aspect of the present invention, the home appliance 200 performs only a voice recognition process up to whether a caller voice is input, and voice recognition for a subsequent user voice input can be performed through the voice recognition server system 100 .

The voice server 110 may analyze the intention of the user and discriminate the voice command by performing the natural language processing (S1621) when the voice data including the voice command is received from the home appliance 200 (S1621).

If the voice command is not normally analyzed (S1623), the voice server 110 notifies the home appliance 200 of the voice command analysis failure, and the home appliance 200 transmits a voice guidance message including the re- It can fire (S1662).

In this case, the re-order request and the re-order analysis process may be set to be performed only a predetermined number of times (S1661).

For example, if the normal analysis fails three times or more, the control unit 240 can control to switch to the wake-up signal standby mode again without requesting re-ordering.

On the other hand, if the voice command is normally analyzed (S1623), the voice server 110 can transmit the voice command to the signal connection service server 120 corresponding to the voice command determined.

On the other hand, the connection service server 120 can determine whether or not the identified voice command can be supported.

For example, the connection service server 120 can determine whether the determined voice command is a function supported by the home appliance 200 (S1631).

The connection service server 120 may determine whether the determined voice command is a function supported in the current state of the home appliance 200, a function provided as a voice command, or the like (S1632).

If the identified voice command is not a function that can be supported by the voice command, as described above with reference to FIGS. 1 to 9, the connection service server 120 can support the home appliance 200 via the voice server 110 It is possible to transmit a response signal indicating that it is not a function.

Accordingly, the home appliance 200 can output a voice guidance message such as 'a function that is not supported' or 'a function that does not support voice' (S1671, S1672).

Also, the control unit 240 can control to switch to the wake-up signal standby mode.

 The connection service server 120 may perform a corresponding operation by communicating with the home appliance control server 130 if the determined voice command is related to the home appliance 200. [

Alternatively, if the determined voice command is not related to the home appliance 200, the associated service server 120 may perform a corresponding operation by communicating with an external service.

The connection service server 120 can generate a request signal corresponding to the identified voice command and transmit it to the home appliance control server 130 if the determined voice command controls the home appliance 200. [

The home appliance control server 130 may receive a request signal from the linkage service server 120 and transmit a control signal based on the request signal to the home appliance 200.

For example, when a request to change the set temperature of the air conditioner 200a is received, the household appliance control server 130 may transmit a control signal for changing the set temperature to the air conditioner 200a.

Meanwhile, the home appliance 200 may perform a corresponding operation according to the control signal received from the home appliance control server 130 (S1640).

In addition, the home appliance 200 may transmit a signal to the home appliance control server 130 indicating that the home appliance 200 has performed the requested operation.

The home appliance control server 130 may receive a response signal to the control signal from the home appliance 200 and may transmit processing result information indicating that the operation for the request is successful to the linkage service server 120. [

The connection service server 120 can transmit a signal corresponding to the processing result information to the natural language processing server 112 such as "set the air condition temperature to 18 degrees ", and the natural language processing server 112 can transmit the user's voice It is possible to transmit a response signal based on the command to the home appliance 200. [

On the other hand, the home appliance 200 may generate a voice guidance message including an announcement such as "set the air conditioner temperature at 18 degrees" based on the voice data received from the voice server 110 (S1650).

17 to 21 are views referred to in explaining various operations of the speech recognition server system and the home appliance according to the present invention.

The home appliance 200 according to an exemplary embodiment of the present invention may perform a feedback operation corresponding to reception of a command in order to notify a user that a voice command has been received within a predetermined elapsed time.

17 and 18 illustrate feedback operations performed when the home appliance 200 is the air conditioner 200a.

17, when a voice command is received within the set elapsed time through the microphones 221 and 222 of the air conditioner 200a, the vane driver 1210 may raise the upper vane 261U to a predetermined height .

In addition, the vane driver 1210 can rotate the left vane 261L and the right vane 261R at a predetermined angle.

In addition, the vane driver 1210 may move the lower vane 261D inwards to open the lower front air outlet 207D.

When the voice command is received when the air conditioner 200a is not operating in the specific operation mode and the air outlets are closed, the vane driver 1210 controls the vanes 261R , 261L, 261U, and 261D can be driven.

Alternatively, the vane driver 1210 may drive some of the plurality of vanes 261R, 261L, 261U, and 261D.

18, when a voice command is received within the set elapsed time through the microphones 221 and 222, the vane driver 1210 controls the left vane 261L and the right vane 261R under the control of the controller 240 And can be rotated at a predetermined angle.

In addition, the vane driver 1210 can control the swing operation in which the left vane 261L and the right vane 261R repeatedly rotate within a predetermined range.

According to an embodiment of the present invention, when a voice command is received within a preset elapsed time, the vanes 261R, 261L, 261U, and 261D are moved to intuitively inform the user of the reception of the command, .

When the user inputs voice commands to the air conditioner 200a, since most of the cases are intended to operate the air conditioner 200a, the vanes 261R, 261L, 261U, and 261D are moved preliminarily, The user can respond to the voice command more quickly.

19 to 21 show various examples in which the air conditioner performs a corresponding operation in response to a user's natural language voice command input.

Referring to Fig. 19, the user can input a voice command 1910 in a natural language such as "Deodorize ". The air conditioner 200a receiving the voice command 1910 of the user through the microphones 221 and 222 can transmit the voice command 1910 to the voice recognition system 100. [

The speech recognition system 100 may analyze the received voice command 1910 to determine the intent of the user for the air cleaning function. Accordingly, the speech recognition system 100 can transmit a control signal to the air conditioner 200a to operate the air cleaning function and a response signal corresponding to the operation.

The air conditioner 200a drives the air cleaning function and can output a voice guidance message 1920 such as "drive the air cleaning function ".

Referring to FIG. 20, the user can input a voice command 2010 in a natural language such as "turn on the power save function ". The air conditioner 200a receiving the voice command 2010 of the user through the microphones 221 and 222 can deliver the voice command 2010 to the voice recognition system 100. [

The voice recognition system 100 may analyze the received voice command 2010 to determine the intention of the user who desires the air cleaning function. Accordingly, the speech recognition system 100 can transmit a control signal to the air conditioner 200a to operate the air cleaning function and a response signal corresponding to the operation.

The air conditioner 200a drives the power saving function and can output a voice guidance message 2020 such as "start power saving function ".

Meanwhile, the voice recognition system 100 according to an embodiment of the present invention may perform a corresponding operation by communicating with the external service 121, if the voice command is not related to the home appliance 200a.

Referring to FIG. 21, the user may enter a voice command 2110 in a natural language such as "Today's weather." The air conditioner 200a receiving the voice command 2110 of the user through the microphones 221 and 222 can deliver the voice command 2110 to the voice recognition system 100. [

The speech recognition system 100 may analyze the received voice command 2110 to determine the intent of the user for weather information. Accordingly, the speech recognition system 100 can access an external service or an Internet network that provides weather information, and can request and receive weather information.

Further, the voice recognition system 100 can transmit data based on the received weather information to the home appliance 200a.

The air conditioner 200a can output a voice guidance message 2120 including weather information such as "Seoul is raining from afternoon" based on the received data.

22 is a diagram showing an example of a platform structure in the control unit of FIG.

The control unit 240 may control the camera 210, the communication unit 270, the audio input unit 220, and the audio output unit 291 shown in FIG.

Meanwhile, the control unit 240 may include a platform as shown in the figure for controlling the home appliance.

In the figure, the OS kernel 2100, a hardware abstraction library (HAL) 2111, 2121 on the OS kernel 2100, a first library 2112 on the first HAL 2111, A second library 2122 on the second HAL 2121, a UART framework 2114 for communication on the first library 2112 and a CLIENT framework for communication on the first library 2112. [ A VISION framework 2124 for controlling the camera 210 on the second library 2122 and an audio input or output on the second library 2122 to the SOUND framework 2126. [ , A VISION framework 2124 and an application 2128 on a SOUND framework 2126. [

The VISION framework 2124 and the SOUND framework 2126 are disposed on the common second library 2122 so that the camera operation, the audio input unit 220, the audio output unit A problem may arise in allocating resources for the operation of the UEs (e.g., 281).

According to the platform in the controller 240, a UART framework 2114, a CLIENT framework 2116, a VISION framework, and the like are provided for communication with the server system 100. [ An application 2124, a SOUND framework 2126, an application 2128, etc. may operate to provide respective communication services, camera services, and sound services.

In this case, each service such as a communication service, a camera service, and a sound service tries to communicate with an external server system 100, so that there is a high possibility that data collision between the respective services occurs during data communication.

In addition, since the state of each service such as a communication service, a camera service, and a sound service can not be confirmed, a factor such as a waste of communication resources such as a redundancy in communication with an external server system 100 .

Accordingly, the present invention proposes a method for efficiently performing communication with the server system 100 for speech recognition, particularly natural language speech recognition.

Further, in the present invention, it is possible to reduce the possibility of data collision by a plurality of units when communicating with the server system 100 for speech recognition, particularly natural language speech recognition. This will be described with reference to FIG. 23 and the following figures.

23 is a diagram showing an example of the platform structure in the control unit according to the embodiment of the present invention.

The control unit 240 may control the camera 210, the communication unit 270, the audio input unit 220, and the audio output unit 291 shown in FIG.

Meanwhile, the control unit 240 may include a platform as shown in the figure for controlling the home appliance.

In the figure, the OS kernel 2100, hardware abstraction libraries (HAL) 2131, 2131, and 2151 on the OS kernel 2100, a first library 2132 on the first HAL 2131, A second library 2142 on the second HAL 2141, a third library 2152 on the third HAL 2151, a VISION framework for controlling the camera 210 on the first library 2132 2134), a UART framework 2144 for communication on the second library 2142, a CLIENT framework 2146 for communicating on the second library 2142, a third library 2152, A second application 2148 on the SOUND framework 2154, a first application 2138 on the VISION framework 2134, a UART framework 2144 and a CLIENT framework 2146, , And a third application 2158 on the SOUND framework 2154.

Meanwhile, the libraries 2132, 2142, and 2152 may include a runtime having a core Java library and a virtual machine (VM). These runtimes form the basis of the framework along with the libraries.

The virtual machine (VM) can be a plurality of instances, that is, a virtual machine that can perform multitasking. On the other hand, each virtual machine (VM) can be allocated and executed according to each application in the applications 2138, 2148, 2158, at which time the OS kernel 2100, for scheduling or interconnecting among a plurality of instances, A binder driver (not shown) may be operated.

Binder drivers and runtime, on the other hand, can link Java-based applications with C-based libraries.

The first HAL 2131, the first library 2132, the VISION framework 2134 and the first application 2138 provide a vision service or a camera service 2130 for operating the camera 210 Lt; / RTI >

Meanwhile, the second HAL 2141, the second library 2142, the UART framework 2144, the CLIENT framework 2146, and the second application 2148 perform the operation of the communication unit 270 For example, to provide communication services 2140.

The third HAL 2151, the third library 2152, the SOUND framework 2154 and the third application 2158 are used for the audio input unit 220 and the audio output unit 281, Lt; RTI ID = 0.0 > 2150 < / RTI >

That is, each of the vision service or the camera service 2130, the communication service 2140, and the sound service 2150 can be allocated to the HAL, the library, the framework, the application, and the like, respectively. Thus, the resource allocation can be stably allocated.

Meanwhile, the control unit 240 sets a communication service 2140 among the vision service or the camera service 2130, the communication service 2140, and the sound service 2150 as a master, and sets the vision service or the camera service 2130 ) And the sound service 2150 as a slave.

That is, the control unit 240 sets the communication unit 270 as a master, sets the audio input unit 220 and the camera 210 as slaves, and uses the communication unit 270 to transmit audio from the audio input unit 220 Data or the video data from the camera 210 to the server system 100. [ Accordingly, communication can be efficiently performed during CLIENT communication with the server system 100 for voice recognition.

That is, the control unit 240 controls the vision service, the camera service 2130, the sound service 2150, and the like, which are set as slaves, to perform communication with the server system 100 alone, It is possible to reduce the possibility of data collision by a plurality of units when communicating with the server system 100 for voice recognition.

The communication service 2140 in the control unit 240 can perform status confirmation of the vision service or the camera service 2130 and the sound service 2150. The status of each service can be checked by the communication unit 270 The amount of communication data that can be provided can be adjusted.

Similarly, the control unit 240 sets the communication unit 270 as a master, sets the audio input unit 220 and the camera 210 as slaves, and uses the communication unit 270 to transmit audio data from the audio input unit 220 Or the video data from the camera 210, to the driving unit 280. [0064] Accordingly, communication can be efficiently performed during UART communication with the driving unit 280 for voice recognition.

That is, the control unit 240 prevents the vision service or the camera service 2130, the sound service 2150, and the like set as slaves from performing communication with the driving unit 280 alone, as shown in FIG. 22 , It is possible to reduce the possibility of data collision by a plurality of units when communicating with the driving unit 280 for voice recognition.

The communication service 2140 in the control unit 240 can perform status confirmation of the vision service or the camera service 2130 and the sound service 2150. The status of each service can be checked by the communication unit 270 The amount of communication data that can be provided can be adjusted.

FIG. 24 is a flowchart illustrating an operation method of a home appliance according to an embodiment of the present invention, and FIGS. 25A to 25C are diagrams referencing an operation method description of FIG.

Referring to the drawing, the audio input unit 220 of the home appliance 200 can receive a user's voice, and can convert voice into an electric signal to output voice data (S2310).

The voice of the user can be composed of a call word such as "LG Whishen ", and a natural language, as described above.

For example, the natural language may be a natural language such as "remove deodorant" (1910), a natural language (2010) such as "turn on power saving function", or a natural language (2110) such as "

When the voice recognition mode is activated, the control unit 240 of the home appliance 200 activates the audio input unit 220, the communication unit 210, and the like, and outputs the voice data output from the audio input unit 220 to the internal The buffer or the memory 250, as shown in FIG.

For example, when the voice recognition mode is activated, the control unit 240 of the home appliance 200 transmits voice data output from the audio input unit 220 to the internal buffer or the memory 250 .

When the user's voice is uttered, the control unit 240 of the home appliance 200 deletes the previous voice data and adds the transmission data to the voice data including the user voice (S2315) .

The transmission data may be data associated with the WiFi communication when the communication unit 270 and the server system 100 communicate with each other via data such as WiFi communication as data corresponding to the communication standard.

Alternatively, the data for transmission may include an error correction code.

23, etc., the control unit 240 sets the communication unit 270 as a master, sets the audio input unit 220 and the camera 210 as slaves, and outputs a voice from the audio input unit 220 It is possible to control to add the transmission data of the communication unit 270 to the video data from the data or the camera 210. [ Accordingly, communication can be efficiently performed when communicating with the server system 100 for voice recognition. In particular, when communicating with the server system 100 for speech recognition, it is possible to reduce the possibility of data collision by a plurality of units.

For example, when transmitting audio data from the audio input unit 220, the control unit 240 can control to add the transmission data of the communication unit 270 to the audio data from the audio input unit 220 .

As another example, when transmitting video data from the camera 210, the control unit 240 can control to add the transmission data of the communication unit 270 to the video data from the camera 210. [

Meanwhile, the control unit 240 of the home appliance 200 can receive the result data corresponding to the voice data transmitted from the server system 100 (S2235).

The received result data may be voice data for speech transmitted from the server system 100 in correspondence with the transmitted voice data.

On the other hand, the received result data may further include operation data related to the operation of the home appliance corresponding to the speech data for speech transmitted from the server system 100, in addition to the speech data for speech transmitted from the server system 100 have.

Accordingly, the control unit 240 of the home appliance 200 can control to output, through the audio output unit 281, a sound corresponding to the received result data, based on the received result data.

Accordingly, speech data for speech corresponding to the user's natural speech can be output through the home appliance 200, thereby making it possible to increase the convenience for the user.

On the other hand, when receiving the operation data related to the operation of the home appliance as the received result data, the control unit 240 of the home appliance 200 controls the driving unit 280 to operate based on the operation data related to the operation of the home appliance And so on.

For example, when air cleaning operation data is received from the server system 100 in response to a natural language 1910 such as "remove odor ", the control unit of the air conditioner 200a controls air It is possible to control to output the air cleaning operation related sound 1920 while driving the internal fan motor so that the clean operation is performed.

As another example, when the power saving operation data is received from the server system 100 in response to the natural language 2010 such as "power save function ", the control unit of the air conditioner 200a performs the power saving operation , It is possible to control to output the sound 2020 related to the power saving operation while controlling the sound 2020 to be performed. For example, the control unit of the air conditioner 200a can control the number of switching operations of the inverter 420 in the outdoor unit that drives the compressor to be small.

As another example, when the operation data is not received from the server system 100 but the voice data for conversation is received in response to the natural language 2110 such as "Today's weather, " 200a can control so that conversation voice data is output.

23 and the like, the control unit 240 of the home appliance 200 may be configured to include a library, a framework, and an application for driving the communication unit 270, the audio input unit 220, and the camera 210, respectively Can be controlled to be driven.

The control unit 240 of the home appliance 200 transmits the audio data from the audio input unit 220 or the video data from the camera 210 to the server system 100 through the application for the communication unit 270 .

The control unit 240 of the home appliance 200 includes a communication unit 270 for driving the communication unit 270, an audio service for driving the audio input unit 220, a camera 210 service for driving the camera 210, And control so that audio data from the audio input unit 220 or video data from the camera 210 are transmitted to the server system 100 based on execution of the communication unit 270 service .

The control unit 240 of the home appliance 200 controls the communication unit 270 to transmit the audio data from the audio input unit 220 and the video data from the camera 210 to the server system 100 And controls the driving unit 280 to perform the predetermined operation based on the operation control signal from the server system 100. [

On the other hand, the control unit 240 of the home appliance 200 controls the sound output corresponding to the result data to be output. After the sound is output, based on the operation control signal from the server system 100, (280).

25A shows an example in which when the natural language 1910 such as "Deodorize" is ignited, the air conditioner 200a sets the data 2414 to which the transmission data 2414 is added in the audio data 2412 corresponding to the natural language 1910 (2410) to the server system (100).

 Then, receiving the result data 2418 from the server system 100 is exemplified.

 Upon receipt of the result data 2418, the control unit of the air conditioner 200a can control to output the air cleaning operation related sound 1920 while driving the internal fan motor so that the air cleaning operation is performed .

25B shows an example in which when the air conditioner 200a receives the transmission data 2424 in the speech data 2422 corresponding to the natural language 2010 at the time of speech of the natural language 2010 such as " Data 2420 to the server system 100. As shown in FIG.

 Then, receiving the result data 2428 from the server system 100 is exemplified.

 Upon reception of the result data 2428, the control unit of the air conditioner 200a can control to output the sound 2020 related to the power saving operation while controlling the power saving operation to be performed.

25B, when the angle of the wind direction of the air conditioner 200a is &thetas; a, the control unit of the air conditioner 200a controls the angle of the wind direction of the air conditioner 200a such that the power saving operation is performed, Can be controlled to be? B smaller than? A. Thus, the power saving operation can be performed.

On the other hand, when the natural language 2010 such as "power save function" is uttered, the control unit 240 of the air conditioner 200a outputs the audio data 2422 corresponding to the natural language 2010, , It is possible to further drive the camera 210 to control the video data acquired by the camera 210 to be transmitted to the server system 100. [

The server system 100 can perform voice recognition for the natural language 2010 such as "power save function ", and transmit result data for intermittent operation.

At this time, the server system 100 can add the wind direction angle data to the result data and transmit it, based on the video data acquired by the camera 210. [ In particular, the server system 100 can set the wind angle to include the area where the user is located, thereby enabling the power saving mode to be performed.

Alternatively, the control unit 240 of the air conditioner 200a may transmit the video data acquired by the camera 210 and the current operation state data to the server system (not shown) in addition to the audio data 2422 and the transmission data 2424 100).

At this time, the server system 100 can add the wind direction angle data to the result data and transmit it, based on the video data acquired by the camera 210 and the current operation state data. Thus, the power saving mode can be performed.

26 is a view showing another example of an internal block diagram of a home appliance according to an embodiment of the present invention.

Referring to the drawings, a home appliance 200 includes a camera 210, an audio input unit 220 for receiving a user's voice command, an operation unit 230, a memory 250 for storing various data, A display unit 292 for displaying predetermined information as an image, an audio output unit 291 for outputting predetermined information as audio, and a display unit 292 for displaying predetermined information, A control unit 240 for controlling the overall operation, and a processor 260.

The internal block diagram of the home appliance 200 of FIG. 26 is similar to that of FIG. 11 except that a processor 260 is further provided and includes an audio input unit 220, an audio output unit 291, a communication unit 270, a camera 210 And the processor 260 are provided in the voice recognition module 205, which is one single module.

The processor 260 may control the audio input unit 220, the audio output unit 291, the communication unit 270, the camera 210, and the like.

Hereinafter, the difference from Fig. 11 will be mainly described.

The processor 260 processes the voice input signal of the user received through the audio input unit 220 and performs a voice recognition process.

For example, when a wake up voice signal is received that includes a preset caller, the processor 260 may transition to a state for receiving voice commands. In this case, the processor 260 performs only a voice recognition process up to the voice input of the caller, and voice recognition for the subsequent voice input of the user can be performed through the voice recognition server system 100.

The processor 260 can control the voice recognition server system 100 to transmit the voice command of the user inputted after the recognition of the wake up voice signal to the voice recognition server system 100 through the communication unit 270. [

The processor 260 may transmit the status information of the home appliance 200, voice commands of the user, and the like to the voice recognition server system 100 or the like through the communication unit 270.

When the control signal is received through the communication unit 270, the processor 260 transmits a control signal to the control unit 240, and the control unit 240 controls the home appliance 200 to operate according to the received control signal. can do.

Eventually, through the voice recognition module 205, it becomes possible to perform voice data acquisition, communication with the server system 100, and corresponding sound output.

On the other hand, the voice recognition module 205 can be attached to various electronic devices in addition to the home appliances shown in Fig. Or may be used as a separate device without being attached to another electronic device.

27 is a diagram illustrating an example of a platform structure in a processor according to an embodiment of the present invention.

Referring to the drawings, the platform of Fig. 27 is the same as the platform of the control unit of Fig. However, the difference is that the platform 260 is provided with the platform, not the control unit 240.

In the figure, the OS kernel 2100, hardware abstraction libraries (HAL) 2131, 2131, and 2151 on the OS kernel 2100, a first library 2132 on the first HAL 2131, A second library 2142 on the second HAL 2141, a third library 2152 on the third HAL 2151, a VISION framework for controlling the camera 210 on the first library 2132 2134), a UART framework 2144 for communication on the second library 2142, a CLIENT framework 2146 for communicating on the second library 2142, a third library 2152, A second application 2148 on the SOUND framework 2154, a first application 2138 on the VISION framework 2134, a UART framework 2144 and a CLIENT framework 2146, , And a third application 2158 on the SOUND framework 2154.

Meanwhile, the processor 260 sets the communication service 2140 among the vision service or camera service 2130, the communication service 2140, and the sound service 2150 as a master, and the vision service or camera service 2130 ) And the sound service 2150 as a slave.

That is, the processor 260 sets the communication unit 270 as a master, sets the audio input unit 220 and the camera 210 as slaves, and uses the communication unit 270 to transmit audio from the audio input unit 220 Data or the video data from the camera 210 to the server system 100. [ Accordingly, communication can be efficiently performed during CLIENT communication with the server system 100 for voice recognition.

That is, the processor 260 may be configured to prevent the vision service or the camera service 2130, the sound service 2150, and the like, which are set as slaves, from performing communication with the server system 100 alone, It is possible to reduce the possibility of data collision by a plurality of units when communicating with the server system 100 for voice recognition.

The communication service 2140 in the processor 260 may perform a status check for the vision service or the camera service 2130 and the sound service 2150. The status of each service may be checked by the communication unit 270 The amount of communication data that can be provided can be adjusted.

Similarly, the processor 260 sets the communication unit 270 as a master, sets the audio input unit 220 and the camera 210 as slaves, and uses the communication unit 270 to transmit audio data from the audio input unit 220 Or the video data from the camera 210, to the driving unit 280. [0064] Accordingly, communication can be efficiently performed during UART communication with the driving unit 280 for voice recognition.

In other words, the processor 260 prevents the vision service or the camera service 2130, the sound service 2150, and the like, which are set as slaves, from performing communication with the driver 280 alone, , It is possible to reduce the possibility of data collision by a plurality of units when communicating with the driving unit 280 for voice recognition.

The communication service 2140 in the processor 260 may perform a status check for the vision service or the camera service 2130 and the sound service 2150. The status of each service may be checked by the communication unit 270 The amount of communication data that can be provided can be adjusted.

The processor 260 can transmit audio data from the audio input unit 220 or video data from the camera 210 to the server system 100 using the communication unit 270. [

The processor 260 sets the communication unit 270 as a master and sets the audio input unit 220 and the camera 210 as slaves so that audio data from the audio input unit 220 or audio data from the camera 210 It is possible to control to add the transmission data of the communication unit 270 to the video data.

On the other hand, the processor 260 can control the audio data from the audio input unit 220 or the video data from the camera 210 to be transmitted to the server system 100 through the application for the communication unit 270

The processor 260 controls the communication unit 270 to operate the communication unit 270, the audio service to operate the audio input unit 220 and the camera 210 to operate the camera 210, , It is possible to control the audio data from the audio input unit 220 or the video data from the camera 210 to be transmitted to the server system 100 based on the execution of the communication unit 270 service

On the other hand, the processor 260 can control to output the sound corresponding to the result data using the communication unit 270

The processor 260 can control the audio data from the audio input unit 220 and the video data from the camera 210 to be transmitted to the server system 100 using the communication unit 270. [

On the other hand, the driving unit 280 described in FIG. 11 or FIG. 27 or the like may be a motor driving unit, and may be hereinafter referred to as a motor driving unit.

FIG. 28 illustrates an example of an internal block diagram of a motor driving apparatus according to an embodiment of the present invention, and FIG. 29 illustrates an example of an internal circuit diagram of the motor driving apparatus of FIG.

The motor driving apparatus 280 according to the embodiment of the present invention drives the motor in a sensorless manner and may include an inverter 420 and an inverter control unit 430 have.

The motor driving apparatus 280 according to the embodiment of the present invention may include a converter 410, a dc voltage detection unit B, a smoothing capacitor C, and an output current detection unit E. The driving unit 280 may further include an input current detection unit A, a reactor L, and the like.

Hereinafter, the operation of each of the constituent units in the motor driving apparatus 280 of Fig. 28 and Fig. 29 will be described.

The reactor L is disposed between the commercial AC power source 405 (v _s ) and the converter 410, and performs a power factor correcting or boosting operation. The reactor L may also function to limit the harmonic current due to the fast switching of the converter 410.

The input current detection section A can detect the input current (i _s ) input from the commercial AC power source 405. To this end, a current transformer (CT), a shunt resistor, or the like may be used as the input current detector A. The detected input current i _s can be input to the inverter control unit 430 as a discrete signal in the form of a pulse.

The converter 410 converts the commercial AC power source 405, which has passed through the reactor L, into DC power and outputs the DC power. Although the commercial AC power source 405 is shown as a single-phase AC power source in the figure, it may be a three-phase AC power source. The internal structure of the converter 410 also changes depending on the type of the commercial AC power source 405.

Meanwhile, the converter 410 may include a diode without a switching element, and may perform a rectifying operation without a separate switching operation.

For example, in the case of a single-phase AC power source, four diodes may be used in the form of a bridge, and in the case of a three-phase AC power source, six diodes may be used in the form of a bridge.

On the other hand, the converter 410 may be, for example, a half-bridge type converter in which two switching elements and four diodes are connected, and in the case of a three-phase AC power source, six switching elements and six diodes may be used .

When the converter 410 includes a switching element, the boosting operation, the power factor correction, and the DC power conversion can be performed by the switching operation of the switching element.

The smoothing capacitor C, also referred to as a dc-stage capacitor, smoothes the input power supply and stores it. In the drawing, one element is exemplified by the smoothing capacitor C, but a plurality of elements are provided so that the element stability can be ensured.

For example, when a direct current power from the solar cell is supplied to the smoothing capacitor C (not shown), the direct current power is supplied to the smoothing capacitor C It may be input directly or may be DC / DC converted and input. Hereinafter, the portions illustrated in the drawings are mainly described.

On the other hand, both ends of the smoothing capacitor C are referred to as a dc stage or a dc stage because the dc power source is stored.

The dc voltage detection unit B can detect the dc voltage Vdc at both ends of the smoothing capacitor C. [ For this purpose, the dc voltage detection unit B may include a resistance element, an amplifier, and the like. The detected dc voltage source Vdc can be input to the inverter control unit 430 as a discrete signal in the form of a pulse.

The inverter 420 includes a plurality of inverter switching elements and converts the smoothed DC power supply Vdc into a three-phase AC power supply va, vb, vc having a predetermined frequency by on / off operation of the switching element, And outputs it to the synchronous motor 530.

The inverter 420 includes a pair of upper arm switching elements Sa, Sb and Sc and lower arm switching elements S'a, S'b and S'c serially connected to each other, The switching elements are connected to each other in parallel (Sa & S a, Sb & S'b, Sc & S'c). Diodes are connected in anti-parallel to each switching element Sa, S'a, Sb, S'b, Sc, S'c.

The switching elements in the inverter 420 perform ON / OFF operations of the respective switching elements based on the inverter switching control signal Sic from the inverter controller 430. [ Thereby, the three-phase AC power source having the predetermined frequency is outputted to the three-phase synchronous motor 530.

The inverter control unit 430 can control the switching operation of the inverter 420 based on the sensorless method. To this end, the drive controller 430, and can receive the output current (i _o) detected by the output current detector (E).

The inverter control unit 430 outputs the inverter switching control signal Sic to the inverter 420 to control the switching operation of the inverter 420. [ Inverter switching control signal (Sic) is output is generated by a switching control signal of a pulse width modulation (PWM), based on the output current (i _o) detected by the output current detector (E). Detailed operation of the output of the inverter switching control signal Sic in the inverter control unit 430 will be described later with reference to FIG.

The output current detection section E detects the output current i _o flowing between the inverter 420 and the three-phase motor 530. That is, the current flowing in the motor 530 is detected. The output current detection unit E can detect all of the output currents ia, ib, ic of each phase or can detect the output currents of two phases using the three-phase balance.

The output current detection unit E may be located between the inverter 420 and the motor 530. In order to detect the current, a current transformer (CT), a shunt resistor, or the like may be used.

When a shunt resistor is used, three shunt resistors are placed between the inverter 420 and the synchronous motor 530, or three lower arm switching elements S'a, S'b, S'c To be connected to each other. On the other hand, it is also possible to use two shunt resistors using three phase equilibrium.

On the other hand, when one shunt resistor is used, the shunt resistor may be disposed between the capacitor C and the inverter 420 described above.

The detected output current (i _o) are, as discrete signals (discrete signal) of the pulse type, may be applied to the inverter controller 430, the inverter switching control signal (Sic) based on the detected output current (i _o) Is generated. The output current (i _o) detected in the following may be written in parallel to the three-phase output currents (ia, ib, ic) of the.

On the other hand, the three-phase motor 530 has a stator and a rotor, and each phase alternating current power of a predetermined frequency is applied to the coils of the stator of each phase (a, b, c phase) .

The motor 530 may be, for example, a Surface Mounted Permanent Magnet Synchronous Motor (SMPMSM), an Interior Permanent Magnet Synchronous Motor (IPMSM) A synchronous motor (Synchronous Reluctance Motor; Synrm), and the like. Among them, SMPMSM and IPMSM are permanent magnet applied Permanent Magnet Synchronous Motor (PMSM), and Synrm is characterized by having no permanent magnet.

30 is an internal block diagram of the inverter control unit of FIG. 29;

30, the inverter control unit 430 includes an axis conversion unit 310, a speed calculation unit 320, a current command generation unit 330, a voltage command generation unit 340, an axis conversion unit 350, And a switching control signal output unit 360.

The axial conversion unit 310 receives the three-phase output currents ia, ib, ic detected by the output current detection unit E and converts the three-phase output currents ia, ib, ic into the two-phase currents iα, iβ in the stationary coordinate system.

On the other hand, the axis converting unit 310 can convert the two-phase current i ?, i? Of the still coordinate system into the two-phase current id, iq of the rotating coordinate system.

)와 연산된 속도(

)를 출력할 수 있다.Based on the two-phase current (i?, I?) Of the stationary coordinate system changed in the axis by the axis converting unit 310, the speed calculating unit 320 calculates the speed

) And the calculated speed (

Can be output.

)와 속도 지령치(ω^* _r)에 기초하여, 전류 지령치(i^* _q)를 생성한다. 예를 들어, 전류 지령 생성부(330)는, 연산 속도(

)와 속도 지령치(ω^* _r)의 차이에 기초하여, PI 제어기(335)에서 PI 제어를 수행하며, 전류 지령치(i^* _q)를 생성할 수 있다. 도면에서는, 전류 지령치로, q축 전류 지령치(i^* _q)를 예시하나, 도면과 달리, d축 전류 지령치(i^* _d)를 함께 생성하는 것도 가능하다. 한편, d축 전류 지령치(i^* _d)의 값은 0으로 설정될 수도 있다. On the other hand, the current command generation unit 330 generates the current command

(I ^* _q ) on the basis of the speed command value? ^* _R and the speed command value? ^* _R. For example, the current command generation section 330 generates the current command

The PI controller 335 performs the PI control based on the difference between the speed command value? ^* _R and the speed command value? ^* _R , and generates the current command value i ^* _q . In the figure, the q-axis current command value (i ^* _q ) is exemplified by the current command value, but it is also possible to generate the d-axis current command value (i ^* _d ) unlike the figure. On the other hand, the value of the d-axis current command value i ^* _d may be set to zero.

On the other hand, the current command generation section 330 may further include a limiter (not shown) for limiting the current command value (i ^* _q ) so that the current command value (i ^* _q ) does not exceed the allowable range.

Next, the voltage command generating unit 340 generates the voltage command generating unit 340 with the d-axis and q-axis currents (i _d , i _q ) axially transformed into the two-phase rotational coordinate system in the axial converting unit and the current command value based on ^{_{i * d, i * q)}} , and generates a d-axis, q-axis voltage command value ^{_{(v * d, v * q}} ). For example, the voltage command generation unit 340 performs PI control in the PI controller 344 based on the difference between the q-axis current (i _q ) and the q-axis current command value (i ^* _q ) It is possible to generate the axial voltage command value v ^* _q . The voltage command generation unit 340 performs PI control in the PI controller 348 based on the difference between the d-axis current i _d and the d-axis current command value i ^* _d , It is possible to generate the command value v ^* _d . The voltage command generator 340 may further include a limiter (not shown) for limiting the level of the d-axis and q-axis voltage command values v ^* _d and v ^* _q so as not to exceed the permissible range .

On the other hand, the generated d-axis and q-axis voltage command values (v ^* _d and v ^* _q ) are input to the axial conversion unit 350.

)와, d축, q축 전압 지령치(v^* _d,v^* _q)를 입력받아, 축변환을 수행한다.The axis transforming unit 350 transforms the position calculated by the velocity calculating unit 320

) And the d-axis and q-axis voltage command values (v ^* _d , v ^* _q ).

)가 사용될 수 있다.First, the axis converting unit 350 performs conversion from a two-phase rotating coordinate system to a two-phase stationary coordinate system. At this time, the position calculated by the speed calculator 320 (

) Can be used.

Then, the axial conversion unit 350 performs conversion from the two-phase stationary coordinate system to the three-phase stationary coordinate system. Through this conversion, the axial conversion unit 1050 outputs the three-phase output voltage instruction values v ^* a, v ^* b, v ^* c.

The switching control signal output section 360 generates the switching control signal Sic for inverter according to the pulse width modulation (PWM) method based on the three-phase output voltage instruction values v ^* a, v ^* b and v ^* And outputs it.

The output inverter switching control signal Sic may be converted into a gate driving signal in a gate driving unit (not shown) and input to the gate of each switching element in the inverter 420. As a result, the switching elements Sa, S'a, Sb, S'b, Sc, and S'c in the inverter 420 perform the switching operation.

The configuration and method of the embodiments described above are not limited to be applied to the home appliance and the voice recognition module according to the embodiment of the present invention, All or some of them may be selectively combined.

Meanwhile, the method of operating the home appliance or the method of operating the voice recognition module of the present invention can be implemented as a processor-readable code on a processor-readable recording medium provided in the home appliance or the voice recognition module. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (16)

A driving unit having an inverter for outputting AC power;
An audio input unit for acquiring audio;
camera;
A communication unit for transmitting voice data from the audio input unit and receiving result data on the voice data from the server system, the server system performing voice recognition processing; And
And a controller for controlling the driving unit, the audio input unit, the camera, and the communication unit,
Wherein,
And controls to transmit the audio data from the audio input unit or the video data from the camera to the server system using the communication unit. The method according to claim 1,
Wherein,
The control unit sets the communication unit as a master and controls the audio input unit and the camera to be slaves so as to add transmission data of the communication unit to audio data from the audio input unit or video data from the camera. Home appliances. The method according to claim 1,
Wherein,
And controls to drive a library, a framework, and an application for driving the communication unit, the audio input unit, and the camera, respectively. The method of claim 3,
Wherein,
Wherein the control unit controls the audio data from the audio input unit or the video data from the camera to be transmitted to the server system through an application related to the communication unit. The method according to claim 1,
Wherein,
A communication service for driving the communication unit, an audio service for driving the audio input unit, and a camera service for driving the camera,
And controls so that audio data from the audio input unit or video data from the camera is transmitted to the server system based on execution of the communication unit service. The method according to claim 1,
And an audio output unit,
Wherein,
And controls to output a sound corresponding to the result data by using the communication unit. The method according to claim 1,
Wherein,
And controls the driving unit based on an operation control signal received from the server system. The method according to claim 1,
Wherein,
Controls to transmit the audio data from the audio input unit and the video data from the camera to the server system using the communication unit,
And controls the driving unit to perform a predetermined operation based on an operation control signal from the server system. 9. The method of claim 8,
And an audio output unit,
Wherein,
And controls the driving unit to perform a predetermined operation based on an operation control signal from the server system after the sound is output. An audio input unit for acquiring audio;
camera;
A communication unit for transmitting voice data from the audio input unit and receiving result data on the voice data from the server system, the server system performing voice recognition processing; And
And a processor for controlling the audio input unit, the camera, and the communication unit,
The processor comprising:
And controls the communication unit to transmit the audio data from the audio input unit or the video data from the camera to the server system. 11. The method of claim 10,
The processor comprising:
The control unit sets the communication unit as a master and controls the audio input unit and the camera to be slaves so as to add transmission data of the communication unit to audio data from the audio input unit or video data from the camera. Speech recognition module. 11. The method of claim 10,
The processor comprising:
And controls to drive a library, a framework, and an application for driving the communication unit, the audio input unit, and the camera, respectively. 13. The method of claim 12,
The processor comprising:
And controls the audio data from the audio input unit or the video data from the camera to be transmitted to the server system through an application related to the communication unit. 11. The method of claim 10,
The processor comprising:
A communication service for driving the communication unit, an audio service for driving the audio input unit, and a camera service for driving the camera,
Wherein the control unit controls so that audio data from the audio input unit or video data from the camera is transmitted to the server system based on execution of the communication unit service. 11. The method of claim 10,
And an audio output unit,
The processor comprising:
And a sound corresponding to the result data is output using the communication unit. 11. The method of claim 10,
The processor comprising:
And controls to transmit the audio data from the audio input unit and the video data from the camera to the server system using the communication unit.

Images