KR20180110978A - Air conditioner, and home appliance - Google Patents

Abstract

The present invention relates to an air conditioner and a home appliance. According to an embodiment of the present invention, the air conditioner comprises: a fan driving unit driving a fan; an audio input unit obtaining voices; a communications unit transmitting voice data from the audio input unit and receiving result data with respect to the voice data from a server system as the server system for performing voice recognition processing; and a control unit controlling the fan driving unit, the audio input unit, and the communications unit. Moreover, the control unit controls a rotational speed of the fan in operation to be lower than before inputting the voices when the voices are input through the audio input unit during operation of the fan. Accordingly, noises can be reduced in a voice recognition mode.

Description

Air conditioners, and home appliances.

The present invention relates to an air conditioner and a home appliance, and more particularly, to an air conditioner and a home appliance capable of reducing noises in a voice recognition mode.

Home appliances such as an air conditioner, a washing machine, a vacuum cleaner, and the like used in a predetermined space such as a home or an office have performed unique functions and operations according to user's operations, respectively.

For example, the air conditioner includes a compressor for compressing the refrigerant, a condenser for condensing the compressed refrigerant, an expansion valve for expanding the condensed refrigerant, and an evaporator for exchanging the expanded refrigerant with the room air, The device performs the function of adjusting the room temperature.

The refrigerator stores food, the washing machine processes the laundry, the cleaner performs the cleaning function, and the cooking device performs the cooking function.

In order to operate the home appliances such as the air conditioner, the user can use a remote control device such as a remote controller to avoid the inconvenience of manually operating buttons or the like provided on the home appliance main body or moving to the main body every time .

However, even when a remote controller is used, the user has to select and input an operation key for each function, which is inconvenient to use, and when the room is dark, separate illumination for identifying the remote controller and the operation key is required .

Therefore, there is an increasing research on a method of controlling a home appliance using speech recognition technology.

Prior Art 1 (Laid-Open Patent Publication No. 10-1999-00069703) discloses a remote controller for an air conditioner having an audio input unit and a signal processing unit to generate and transmit an operation signal according to voice recognition.

In the conventional art 2 (Japanese Unexamined Patent Publication (Kokai) No. 10-2006-0015092), an input voice signal is converted into a digital signal and text, and it is checked whether there is a control command in the database. And if there is no matching control command, extracts the keyword and controls each device in the air conditioner according to the associated control command.

However, there is a limit to the system resources that individual devices such as remote controllers and air conditioners can have. Especially, it is difficult to realize embedded modules that are installed in individual devices because it requires a high computation amount to recognize natural words rather than only a few words.

Therefore, the speech recognition technology of the related art 1 and the conventional art 2 has a limitation in recognizing and processing various natural language voice commands of users all over the world.

Therefore, there is a need for a method that can recognize and process natural language without restriction of the system resources of the individual devices, and can conveniently control the home appliance.

Also, in order to improve usability and satisfaction, it is necessary to provide a user experience (UX) considering various situations that may occur during a speech recognition process and a home appliance control process.

An object of the present invention is to provide an air conditioner and a home appliance capable of reducing noise in a voice recognition mode.

It is another object of the present invention to provide an air conditioner and a home appliance capable of improving the accuracy of speech recognition by reducing noise in a voice recognition mode.

According to an aspect of the present invention, there is provided an air conditioner including a fan driving unit for driving a fan, an audio input unit for acquiring a voice, and a server system for performing a voice recognition process, And a control unit for controlling the fan driving unit, the audio inputting unit, and the communication unit, wherein the control unit controls the fan driving unit so that, during operation of the fan, , The control is performed such that the rotational speed of the fan in operation is lower than before the input of the voice.

According to another aspect of the present invention, there is provided an air conditioner including a motor driving unit for driving a motor, an audio input unit for acquiring a voice, and a server system for performing a voice recognition process, And a control unit for controlling the motor drive unit, the audio input unit, and the communication unit, wherein the control unit controls the motor drive unit to transmit the voice data through the audio input unit, Is controlled so that the rotational speed of the motor in operation becomes lower than that before the input of the sound.

According to another aspect of the present invention, there is provided a home appliance including a motor driving unit for driving a motor, an audio input unit for acquiring a voice, and a server system for performing a voice recognition process, And a control unit for controlling the motor drive unit, the audio input unit, and the communication unit, wherein the control unit controls the motor drive unit so that, during the operation of the motor, the sound is input through the audio input unit , The rotational speed of the motor in operation is controlled to be lower than before the input of the voice.

According to another aspect of the present invention, there is provided a home appliance including a motor driving unit for driving a motor, an audio input unit for acquiring a voice, and a server system for performing a voice recognition process, And a control unit for controlling the motor drive unit, the audio input unit, and the communication unit, wherein the control unit controls the voice recognition mode in which the voice recognition mode is activated during the operation of the motor , It is controlled so that the rotational speed of the motor in operation becomes lower than that before activation of the voice recognition mode.

An air conditioner according to an embodiment of the present invention includes a fan driving unit that drives a fan, an audio input unit that acquires voice, and a server system that performs voice recognition processing, and transmits voice data from an audio input unit, And a control unit for controlling the fan driving unit, the audio inputting unit, and the communication unit. When a voice is input through the audio input unit during the operation of the fan, It is possible to reduce the noise in the voice recognition mode by controlling the rotation speed of the voice recognition device to be lower than that before the voice input. Thus, the accuracy of speech recognition can be improved.

Particularly, by controlling the rotational speed of the operating fan to be lower than that before the input of voice when the input voice is a call through the audio input unit, noise can be reduced . Therefore, the accuracy of natural language speech recognition can be improved.

On the other hand, when voice data corresponding to the natural language voice is controlled to be transmitted to the server system, and sound data based on the result data is output when the result data is received from the server system, natural language voice recognition can be performed easily and accurately .

On the other hand, after the sound output based on the result data, the rotational speed of the fan is increased again, so that the operation state of the air conditioner can be restored as it is.

On the other hand, when the natural language voice is input after the rotation speed of the fan is lowered, the voice data corresponding to the natural voice is controlled to be transmitted to the server system, and after the voice data transmission, When the result data is received from the system, control is performed so that the rotation speed of the fan is decreased again, and sound based on the result data is output so that the natural operation of the air conditioner is maintained, It is possible to reduce noise at the time of natural language speech data acquisition and at the time of sound output, and thus the user's convenience of use can be increased.

According to another aspect of the present invention, there is provided an air conditioner comprising: a motor driving unit for driving a motor; an audio input unit for acquiring voice; and a server system for performing voice recognition processing, And a control unit for controlling the motor driving unit, the audio input unit, and the communication unit. The control unit controls the operation of the motor when the voice is inputted through the audio input unit during the operation of the motor, It is possible to reduce the noise in the voice recognition mode by controlling the rotation speed of the motor to be lower than before the voice input. Thus, the accuracy of speech recognition can be improved.

On the other hand, when voice data corresponding to the natural language voice is controlled to be transmitted to the server system, and sound data based on the result data is output when the result data is received from the server system, natural language voice recognition can be performed easily and accurately .

On the other hand, after the sound output based on the result data, the rotational speed of the fan is increased again, so that the operation state of the air conditioner can be restored as it is.

On the other hand, when the natural language voice is input after the rotation speed of the fan is lowered, the voice data corresponding to the natural voice is controlled to be transmitted to the server system, and after the voice data transmission, When the result data is received from the system, control is performed so that the rotation speed of the fan is decreased again, and sound based on the result data is output so that the natural operation of the air conditioner is maintained, It is possible to reduce noise at the time of natural language speech data acquisition and at the time of sound output, and thus the user's convenience of use can be increased.

Meanwhile, a home appliance according to an embodiment of the present invention includes a motor driving unit for driving a motor, an audio input unit for acquiring a voice, and a server system for performing voice recognition processing. The home appliance transmits voice data from an audio input unit, And a control unit for controlling the motor drive unit, the audio input unit, and the communication unit. The control unit controls the motor drive unit, the audio input unit, It is possible to reduce the noise in the voice recognition mode by controlling the rotation speed of the motor to be lower than before the input of the voice. Thus, the accuracy of speech recognition can be improved.

Particularly, by controlling the rotation speed of the motor in operation to be lower than that before the input of voice when the input voice is a call through the audio input unit, noise can be reduced . Therefore, the accuracy of natural language speech recognition can be improved.

On the other hand, when voice data corresponding to the natural language voice is controlled to be transmitted to the server system, and sound data based on the result data is output when the result data is received from the server system, natural language voice recognition can be performed easily and accurately .

On the other hand, since the rotation speed of the motor is increased again after the sound output based on the result data, the operation state of the home appliance can be restored as it is.

On the other hand, when the natural language voice is input after the rotation speed of the motor is lowered, the voice data corresponding to the natural voice is controlled to be transmitted to the server system, When the result data is received from the system, control is performed so that the rotational speed of the motor is reduced again, and the sound based on the result data is output so that the natural operation of the air conditioner is maintained, It is possible to reduce the noise at the time of natural language speech data acquisition and at the time of sound output by lowering the rotation speed of the motor only.

According to another aspect of the present invention, there is provided a home appliance including a motor driving unit for driving a motor, an audio input unit for acquiring a voice, and a server system for performing a voice recognition process. The home appliance transmits voice data from an audio input unit, And a control unit for controlling the motor drive unit, the audio input unit, and the communication unit, wherein when the voice recognition mode is activated during operation of the motor, It is possible to reduce the noise in the voice recognition mode by controlling the rotation speed to be lower than that before activation of the voice recognition mode. Thus, the accuracy of speech recognition can be improved.

On the other hand, when voice data corresponding to the natural language voice is controlled to be transmitted to the server system, and sound data based on the result data is output when the result data is received from the server system, natural language voice recognition can be performed easily and accurately .

On the other hand, since the rotation speed of the motor is increased again after the sound output based on the result data, the operation state of the home appliance can be restored as it is.

On the other hand, when the natural language voice is input after the rotation speed of the motor is lowered, the voice data corresponding to the natural voice is controlled to be transmitted to the server system, When the result data is received from the system, control is performed so that the rotational speed of the motor is reduced again, and the sound based on the result data is output so that the natural operation of the air conditioner is maintained, It is possible to reduce the noise at the time of natural language speech data acquisition and at the time of sound output by lowering the rotation speed of the motor only.

1 is a view illustrating a smart home system including a voice recognition server system and a home appliance according to an embodiment of the present invention.
2 is a diagram illustrating various examples of home appliances.
3A is an example of a speech recognition server system according to an embodiment of the present invention.
3B is another example of a speech recognition server system according to an embodiment of the present invention.
4 to 6 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention.
7 to 9 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention.
FIG. 10 is a diagram showing an example of an internal block diagram of a server according to an embodiment of the present invention.
11 is a block diagram illustrating an example of an internal block diagram of a home appliance according to an embodiment of the present invention.
12 is a view showing a part of an internal block diagram of an air conditioner according to an embodiment of the present invention.
13 and 14 are views showing an outline of an air conditioner according to an embodiment of the present invention.
15 is a flowchart illustrating an operation method of a home appliance according to the present invention.
16 is a flowchart illustrating an operation method of a smart home system including a speech recognition server system and a home appliance according to the present invention.
17 to 21 are views referred to in explaining various operations of the speech recognition server system and the home appliance according to the present invention.
22 is a flowchart illustrating an operation method of an air conditioner according to an embodiment of the present invention.
23A to 23D are views referred to in the description of the operation method of FIG.
24 is a flowchart illustrating an operation method of an air conditioner according to another embodiment of the present invention.
25A to 25E are diagrams referred to in the description of the operation method of FIG.
26 is a flowchart illustrating an operation method of a home appliance according to an embodiment of the present invention.
27A to 27D are views referred to in the description of the operation method of Fig.
28 is a flowchart illustrating an operation method of an air conditioner according to another embodiment of the present invention.
29A to 29E are diagrams referred to in the description of the operation method of FIG.
30 is a diagram showing another example of an internal block diagram of a home appliance according to an embodiment of the present invention.
Fig. 31 illustrates an example of an internal block diagram of the driving unit of Fig.
32 is an example of an internal circuit diagram of the motor driving apparatus of Fig.
FIG. 33 is an internal block diagram of the inverter control unit of FIG. 32; FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, it is needless to say that the present invention is not limited to these embodiments and can be modified into various forms.

In the drawings, the same reference numerals are used for the same or similar parts throughout the specification.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description and do not give special significance or role in themselves. Thus, "module" and "part" may be used interchangeably.

FIG. 1 is a schematic view of a smart home system including a speech recognition server system and a home appliance according to an embodiment of the present invention. FIG. 2 is a view for explaining various examples of a home appliance.

Referring to FIG. 1, a smart home system 10 according to an embodiment of the present invention includes a home appliance 200 having a communication module (not shown) and capable of communicating with other devices or connecting to a network, , A voice recognition server system 100 including a plurality of servers for voice recognition and home appliance control.

2, the home appliance 200 may include an air conditioner 200a having a communication module, a robot cleaner 200b, a refrigerator 200c, a washing machine 200d, and a cooking device 200e. have.

In addition, the smart home system 10 according to an embodiment of the present invention may include a mobile terminal (not shown) such as a smart phone, a tablet PC, and the like.

The home appliance 200 may include a communication module to communicate with electronic devices inside / outside the smart home system 10.

The smart home system 10 according to an embodiment of the present invention may further include an access point 300 and the home appliance 200 may be connected to the access point 300 through the access point 300 It can access the wireless Internet network and communicate with other devices.

The access point device 300 can allocate a wired or wireless channel according to a predetermined communication method to the electronic devices in the smart home system 10 and perform wireless data communication through the corresponding channel.

Here, the predetermined communication method may be a Wi-Fi communication method. Correspondingly, the communication module included in the home appliance 200 may be a Wi-Fi communication module, but the present invention is not limited to the communication method.

Alternatively, the home appliance 200 may include other types of communication modules or a plurality of communication modules. For example, the home appliance 200 may include an NFC module, a zigbee communication module, a Bluetooth communication module, and the like.

The home appliance 200 can be connected to a server included in the voice recognition server system 100 or a predetermined external server or a user's mobile terminal through a wi-fi communication module or the like, Smart function can be supported.

The user can check information on the home appliance 200 in the smart home system 10 or control the home appliance 200 through the mobile terminal.

On the other hand, it may be inconvenient for a user to use the mobile terminal even when the user wants to control the home appliance 200 or confirm certain information in the home.

For example, it is more efficient to have a means to control the home appliance 200 in other ways when the user does not know the current location of the mobile terminal or is in another place.

The home appliance 200 according to an embodiment of the present invention can receive a user's voice input and the voice recognition server system 100 recognizes and analyzes the voice input of the user to control the home appliance 200 .

Accordingly, the user can control the home appliance 200 without operating the mobile terminal or the remote control device.

At least some of the servers included in the voice recognition server system 100 may be a server operated by a manufacturer of a home appliance or a sales company, or a server operated by a manufacturer or a company entrusted with a service by a sales company .

3A is an example of a speech recognition server system according to an embodiment of the present invention.

3A, a voice recognition server system 100a according to an embodiment of the present invention includes a voice server 200a for receiving voice data from a home appliance 200a and analyzing voice data received to determine a voice command 110, an associated service server 120, and a home appliance control server 130.

The voice recognition server system 100a according to the embodiment of the present invention receives a signal corresponding to the voice command discriminated from the voice server 110 and generates a request signal corresponding to the discriminated voice command The home server 200 may further include a home appliance control server 130 that transmits a control signal based on a request signal received from the service server 120 and the connection service server 120 to the home appliance 200a.

The voice server 110 receives the voice data from the home appliance 200a, converts the received voice data into text data, and analyzes the text data to determine a voice command.

Further, the voice server 110 can transmit a signal corresponding to the voice command determined to the predetermined server.

The home appliance 200a can receive the voice command input uttered by the user and transmit the voice data based on the received voice command input to the voice server 110. [

The voice server 110 includes an Automatic Speech Recognition (ASR) server 111 that receives voice data from the home appliance 200a and converts the received voice data into text data, (Natural Language Processing: NLP) for receiving text data from the server 111, analyzing the received text data to determine a voice command, and transmitting a response signal based on the determined voice command to the home appliance 200a ) Server 112 and a home appliance 200a that receives a signal including a text corresponding to a response signal, converts the text included in the received signal into voice data, and transmits the voice data to the home appliance 200a And a Text to Speech (TTS) server 113.

The automatic speech recognition server 111 can perform speech recognition on the speech data received from the home appliance 200a to generate text data and transmit the text data to the natural language processing server 112. [

The natural language processing server 112 can analyze the text data received from the automatic speech recognition server 111 according to a natural language processing algorithm to determine a voice command.

The natural language processing server 112 can process a natural language that is a language that a person routinely uses according to a natural language processing algorithm and can analyze the intent of the user. The natural language processing server 112 can perform natural language processing on the text data received from the automatic speech recognition server 111 to determine a voice command that matches the user's intention.

Accordingly, the natural language processing server 112 can determine a voice command that matches the user's intention even if the user inputs a voice command in a daily use language.

The natural language processing server 112 can transmit a signal corresponding to the natural language processing result, that is, a signal corresponding to the discriminated voice command to the linkage service server 120. [

The linking service server 120 can receive the signal corresponding to the voice command discriminated by the voice server 110, particularly the natural language processing server 112, and generate the request signal corresponding to the discriminated voice command.

The connection service server 120 can receive a signal corresponding to the voice command determined by the natural language processing server 112. [

The connection service server 120 can perform a corresponding operation by communicating with the home appliance control server 130 if the determined voice command is related to the home appliance 200a.

Alternatively, if the determined voice command is not related to the home appliance 200a, the connection service server 120 can perform a corresponding operation by communicating with the external service 121.

For example, if the determined voice command is a command for requesting information such as weather, stock, news, etc., the connection service server 120 can request and receive the information from the server providing the service corresponding to the requested information have.

Also, the linking service server 120 may transmit the received information to the voice server 110, and the natural language processing server 112 may transmit the received information to the home appliance 200a.

If the determined voice command is related to the home appliance 200a, the connection service server 120 can generate a request signal corresponding to the determined voice command and transmit it to the home appliance control server 130. [

The home appliance control server 130 may transmit a control signal based on the request signal received from the associated service server 120 to the home appliance 200a.

For example, when a request to change the set temperature of the air conditioner 200a is received, the household appliance control server 130 may transmit a control signal for changing the set temperature to the air conditioner 200a.

Meanwhile, the home appliance 200a may perform a corresponding operation according to a control signal received from the household appliance control server 130. [

In addition, the home appliance 200a may transmit a signal to the home appliance control server 130 indicating that the home appliance 200a has performed the requested operation.

The home appliance control server 130 may receive a response signal to the control signal from the home appliance 200a and transmit the processing result information corresponding to the response signal to the linkage service server 120. [

The voice server 110 can transmit a response signal including the processing result information to the home appliance 200a.

In addition, the voice server 110 receives a signal including an output phrase text corresponding to the processing result information from the home appliance 200a, converts the received output phrase text into voice data, and transmits the voice data to the home appliance 200a .

In this case, the response signal based on the voice command determined by the natural language processing server 112 to be transmitted to the home appliance 200a may include processing result information.

On the other hand, the home appliance 200a can receive a response signal based on the voice command determined by the natural language processing server 112. [ Here, the text data of the response corresponding to the voice command that discriminated the response signal may be included.

For example, when the user inputs a voice command to change the set temperature of the air conditioner, the response signal may include text data indicating that the set temperature has been changed.

On the other hand, the home appliance 200a can transmit a signal including the text corresponding to the received response signal to the text / voice conversion server 113. [ Here, the signal including the text corresponding to the response signal may include an output phrase text corresponding to the processing result information.

On the other hand, the text-to-speech server 113 may convert the text included in the received signal into voice data and transmit the voice data to the home appliance 200a. The converted voice data may include a sound source file.

The home appliance 200a can output the voice guidance message based on the voice data received through the speaker.

On the other hand, the connection service server 120 requests the home appliance control server 130 from the state information of the home appliance 200a based on the signal corresponding to the determined voice command, and the appliance control server 130 requests the home appliance 200a To the link service server 120, status information of the service server 200a. If the state information of the home appliance 200a is not secured, the home appliance control server 130 may request and receive the state information from the home appliance 200a.

On the other hand, when it is possible to support the voice command determined based on the state information of the home appliance 200a, the connection service server 120 transmits a request signal corresponding to the voice command determined by the home appliance control server 130 can do.

Alternatively, when it is impossible to support the voice command determined based on the state information of the home appliance 200a, the linking service server 120 transmits a signal informing the natural language processing server 112 that the function is not supported in the current state Can be transmitted.

Also in this case, the home appliance 200a may request and receive voice data from the text-to-speech conversion server 113 and output a voice guidance message indicating that the voice data is not supported in the current state.

According to the embodiment, the voice server 110 can determine the supportability of the discriminated voice command. For example, the natural language processing server 112 that has analyzed the intention of the user's voice command can determine the supportability of the determined voice command.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the voice command determined by the natural language processing server 112 is not supported by the home appliance 200a It may be a signal informing that it is a non-function.

The voice server 110 and the voice recognition server system 100a including the voice server 110 according to an embodiment of the present invention can organically connect servers having various roles for natural voice processing.

The home appliance 200 performs operations from reception and preprocessing of voice commands to server transmission and the voice server 110 can perform a natural language process such as voice / text conversion, intent analysis, and command identification.

By performing the natural language processing by the voice server 110, burden on the CPU, memory, etc. of the embedded module in the home appliance can be reduced.

Meanwhile, the connection service server 120 may communicate with the external service and home appliance control server 130 to perform an operation based on the voice command of the user.

On the other hand, the home appliance 200 can receive voice data including a sound source file from the voice server 110 and output a voice guidance message to the voice to reply to the voice input of the user through auditory feedback.

The home appliance 200 receives the voice file streaming from the voice server 110 and reproduces and outputs the voice guidance message to the user. Accordingly, the home appliance 200 need not store various sound source files.

Meanwhile, it is possible to link with various external services without colliding with other servers through the connection service server 120. In addition, through the external service interworking server, it is possible to increase the success rate of the intention analysis by reflecting external information in the intention analysis.

The speech recognition server system 100a according to an embodiment of the present invention assures compatibility and connectivity through a plurality of servers and utilizes the home appliance control server 130 as a final control command, The collision between the home appliance control using the Wi-Fi communication through the server 130 and the home appliance control through the mobile terminal and the home appliance control by voice input through the home appliance 200 can be prevented.

The speech recognition server system 100a according to the embodiment of the present invention can reduce the load on a specific server depending on a certain server through an organic connection between the servers, If there is a problem with the server, it can be easily responded to by linking with other servers having the same role.

In addition, a plurality of servers can be independently updated from time to time, which is advantageous for performance improvement.

3B is another example of a speech recognition server system according to an embodiment of the present invention.

The voice recognition server system 100b illustrated in FIG. 3B improves the process of transmitting voice data for voice announcement message output to the home appliance 200a by the voice recognition server system illustrated in FIG. 3A, .

Therefore, the speech recognition server system illustrated in FIG. 3A and FIG. 3B can perform substantially the same operations except for the difference, and the same portions will be briefly described below.

3B, a speech recognition server system according to an embodiment of the present invention includes a voice server 110 that receives voice data from a home appliance 200a and analyzes voice data received to determine a voice command .

In addition, the speech recognition server system 100b according to the embodiment of the present invention receives a signal corresponding to the voice command discriminated from the voice server 110 and generates a request signal corresponding to the discriminated voice command The home server 200 may further include a home appliance control server 130 that transmits a control signal based on a request signal received from the service server 120 and the connection service server 120 to the home appliance 200a.

The voice recognition server system illustrated in FIG. 3B can transmit voice data including processing result information based on a voice command to the home appliance 200a without requiring a request of the home appliance 200a .

The voice server 110 includes an automatic voice recognition server 111 that receives voice data from the home appliance 200a and converts the received voice data into text data, A natural language processing server 112 that analyzes the received text data and determines a voice command, and a text-to-speech conversion server 112 that converts a response signal based on the voice command to voice data and transmits the voice data to the home appliance 200a (113).

Also in this embodiment, the home appliance control server 130 can receive the response signal to the control signal from the home appliance 200a and transmit the process result information corresponding to the response signal to the linkage service server 120. [

The linkage service server 120 can deliver the processing result information to the voice server 110, and more particularly to the natural language processing server 112. [

In this case, the voice data transmitted by the text-to-speech conversion server 113 to the home appliance 200a may include processing result information.

The association service server 120 also requests the home appliance control server for state information of the home appliance 200a on the basis of the signal corresponding to the voice command that has been discriminated. The home appliance control server transmits the state information of the home appliance 200a To the associated service server 120.

When it is possible to support the voice command determined based on the state information of the home appliance 200a, the connection service server 120 transmits a request signal corresponding to the voice command determined by the home appliance control server 130 can do.

Alternatively, when it is impossible to support the voice command determined based on the state information of the home appliance 200a, the connection service server 120 transmits a signal indicating that the voice command is not supported in the current state to the voice server 110 can do.

For example, the linkage service server 120 may send a signal to the natural language processing server 112 indicating that it is an unsupported function in the current state.

In addition, the natural language processing server 112 transmits a signal indicating that it is an unsupported function in the current state to the text-to-speech conversion server 113, and the text-to-speech conversion server 113 generates corresponding voice data and transmits it to the home appliance 200a ). ≪ / RTI >

The home appliance 200a receives the voice data from the text-to-speech conversion server 113 and outputs a voice guidance message indicating that the voice data is not supported in the current state.

According to the embodiment, the voice server 110 can determine the supportability of the discriminated voice command. For example, the natural language processing server 112 that has analyzed the intention of the user's voice command can determine the supportability of the determined voice command.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the voice command determined by the natural language processing server 112 is not supported by the home appliance 200a It may be a signal informing that it is a non-function.

When the home appliance 200a requests the announcement about the corresponding operation to the text-to-speech server 113 for voice guidance for the last time after the operation of the home appliance 200a, a time difference may occur between the operation and the announcement.

However, according to an embodiment of the present invention, when the intention analysis is completed and the operation request is transmitted from the natural language processing server 112, the text voice conversion server 113 can provide information at the same time.

In addition, the text-to-speech conversion server 113 can provide the announcement to the home appliance 200a on the basis of the time when the home appliance control server 130 issues a control command to the home appliance 200a.

Accordingly, the announcement can be made simultaneously or immediately with the operation of the home appliance 200a.

According to the present embodiment, by directly connecting the natural language processing server 112 and the text-to-speech conversion server 113, the time difference between the control command and the announcement through the home appliance control server 130 can be minimized.

3A and 3B, the air conditioner 200a is exemplified as the home appliance 200, but the present invention is not limited thereto. For example, the home appliance 200 may include a robot cleaner 200b, a refrigerator 200c, a washing machine 200d, a cooking device 200e, and the like in addition to the air conditioner 200a.

3A and 3B, an automatic speech recognition server 111, a natural language processing server 112, and a text-to-speech conversion server 113 for speech recognition and processing are integrated Server.

Also, according to an embodiment, the connection service server 120 and the home appliance control server 130 may be configured as one integrated server.

According to the present invention, since the home appliance operates according to the voice input, it is not necessary for the user to operate the remote control device such as the remote controller, the mobile terminal, etc., and the user convenience can be increased.

As described with reference to FIGS. 3A and 3B, the present invention recognizes a user's natural language voice command using a plurality of servers, and performs a corresponding control operation so that the system resources of the home appliance, Natural language can be recognized and processed efficiently without limitation.

FIGS. 4 to 6 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention, which illustrates a signal flow of a speech recognition server system illustrated in FIG. 3A.

4 illustrates signal flow in a typical situation in which the home appliance operates in response to a user's voice command.

Hereinafter, the air conditioner 200a will be described with reference to the home appliance 200, but the present invention is not limited thereto.

Referring to FIG. 4, the home appliance 200, for example, the air conditioner 200a according to the embodiment of the present invention can receive a voice command of a user (S410) Command to the voice server 110 (S420).

For example, when the user receives an instruction to change the temperature setting such as "LG Whishen, temperature 18 degrees ", the air conditioner 200a converts the received voice command into a digital Converted into voice data, and transmitted to the automatic voice recognition server 111.

On the other hand, after receiving the wake up signal including the caller, the air conditioner 200a can transmit a voice command input to the voice server 110 while waiting for command input.

Alternatively, the air conditioner 200a may receive continuous speech input including a caller and a voice command. In this case, the air conditioner 200a can recognize the caller and transmit the voice command to the voice server 110. [

Meanwhile, when communicating with each other in the system 10, signals transmitted and received include identification information (ID) of each device, a session value for a task to be performed, and the like, in addition to main data to be exchanged .

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S431), and transmits the text data to the natural language processing server 112 (S433).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S441).

For example, the natural language processing server 112 can determine the voice command of the intention to change the set temperature of the air conditioner 200a to 18 degrees at "LG Whishen, temperature 18 degrees Celsius ".

The natural language processing server 112 can transmit the signal corresponding to the discriminated voice command to the link service server 120 (S443).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S451, the home appliance control server 130 transmits the current state information of the air conditioner 200a (S453), and transmits the current status information of the air conditioner 200a to the connection service server 120 (S455).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a .

On the other hand, after receiving the status information, the connection service server 120 transmits a request signal to the home appliance control server 130 to change the set temperature of the corresponding air conditioner 200a by 18 degrees in accordance with the voice command that has been determined (S461).

The home appliance control server 130 generates a control signal based on the request signal and transmits the control signal to the air conditioner 200a to control the air conditioner 200a (S463).

After the control of the air conditioner 200a, the home appliance control server 130 receives a response signal to the control signal from the home appliance and transmits processing result information indicating that the operation for the request is successful to the connection service server 120 (S465).

The connection service server 120 can transmit a signal corresponding to the processing result information to the natural language processing server 112 (S470), such as "set the air condition temperature to 18 degrees" A response signal based on the user's voice command can be transmitted to the home appliance 200a (S481). Here, the response signal based on the voice command of the discriminating user may include the processing result information.

On the other hand, the home appliance 200a transmits a signal including a text (output phrase) corresponding to the response signal (S483), and the text-to-speech conversion server 113 receives the text included in the received signal as speech data (S485), and transmits it to the home appliance 200a (S487).

The home appliance 200a can output a voice guidance message such as "Set the air conditioner temperature to 18 degrees" based on the received voice data (S490).

FIG. 5 illustrates signal flow when requesting a non-serving function of the home appliance.

5, the air conditioner 200a according to the embodiment of the present invention receives a voice command of the user for a laundry function not supported by the air conditioner 200a such as "LG Whishen, (S510).

The air conditioner 200a can transmit the voice command of the received user to the voice server 110 (S520). The air conditioner 200a can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit it to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S531), and transmits the text data to the natural language processing server 112 (S533).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S541).

Further, the natural language processing server 112 can determine whether or not support of the discriminated voice command is possible. In this embodiment, the natural language processing server 112 can determine that the user has requested the laundry function not supported by the air conditioner 200a.

Thereafter, the natural language processing server 112 can transmit a response signal indicating that the voice command determined by the air conditioner 200a is a function not supported by the home appliance (S543).

On the other hand, the home appliance 200a transmits a signal including a text (output phrase) corresponding to the response signal (S551), and the text-to-speech conversion server 113 receives the text included in the received signal Converted into voice data (S553), and transmitted to the home appliance 200a (S555).

The home appliance 200a can output a voice guidance message such as "This is a function that is not supported" based on the received voice data (S560).

6 illustrates signal flow when requesting a non-serving function in the current operating mode of the home appliance.

Referring to FIG. 6, the air conditioner 200a according to an embodiment of the present invention receives a voice command of a user instructing a specific mode operation of the air conditioner 200a, such as "LG Whishen, (S610).

The air conditioner 200a can transmit the voice command of the received user to the voice server 110 (S620). The air conditioner 200a can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit it to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S631), and transmits the text data to the natural language processing server 112 (S633).

The natural language processing server 112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S641).

For example, the natural language processing server 112 can determine a voice command that the user intends to operate the air conditioner 200a in the cool power mode at "LG Whishen, CoolPower Startup ".

The natural language processing server 112 can transmit a signal corresponding to the identified voice command to the link service server 120 (S643).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S651, the home appliance control server 130 transmits the current state information of the air conditioner 200a (S653), and the current state information of the air conditioner 200a can be transmitted to the linked service server 120 (S655).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a.

Meanwhile, after receiving the status information, the connection service server 120 can determine whether or not the voice command that is determined based on the current status information of the air conditioner 200a can be supported (S657).

For example, when the current air conditioner 200a is operating in the dehumidification mode and the cool power mode is supported only in the cooling mode, the natural language processing server 112 sets the cool power mode, which is not supported in the current state, It can be determined that the request has been made.

Thereafter, the connection service server 120 can transmit a response signal indicating that the voice command determined by the natural language processing server 112 is a function that the home appliance 200a does not support in the present state (S660).

In addition, the natural language processing server 112 can transmit a response signal indicating that the determined voice command is a function that the home appliance 200a does not support in the current state (S671).

On the other hand, the home appliance 200a transmits a signal including a text (output phrase) corresponding to the response signal (S673), and the text-to-speech server 113 receives the text included in the received signal (S675), and can transmit the voice data to the home appliance 200a (S677).

The home appliance 200a can output a voice guidance message such as "Cool Power is supported only in the cooling mode" based on the received voice data (S680).

7 to 9 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention, and are a diagram illustrating a signal flow of a speech recognition server system illustrated in FIG. 3B.

7 illustrates a signal flow in a typical situation in which the home appliance operates according to a user's voice command.

7, the home appliance 200, for example, the air conditioner 200a according to an exemplary embodiment of the present invention can receive a voice command of a user (S710) To the voice server 110 (S720).

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S731), and transmits the text data to the natural language processing server 112 (S733).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S741).

For example, the natural language processing server 112 can determine a voice command that the user intends to change the set temperature of the air conditioner 200a to 18 degrees at "LG Whischen, temperature 18 degrees Celsius ".

The natural language processing server 112 can transmit a signal corresponding to the discriminated voice command to the link service server 120 (S743).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S751, the home appliance control server 130 inquires current state information of the air conditioner 200a (S753), and the current state information of the air conditioner 200a can be transmitted to the linking service server 120 (S755).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a.

On the other hand, upon receiving the status information, the connection service server 120 may transmit a request signal to the home appliance control server 130 to change the set temperature of the corresponding air conditioner 200a by 18 degrees according to the determined voice command ( S761).

The home appliance control server 130 generates a control signal based on the request signal and transmits it to the air conditioner 200a to control the air conditioner 200a (S763).

The home appliance control server 130 receives the response signal to the control signal from the home appliance after the control of the air conditioner 200a and transmits the processing result information indicating that the operation for the request is successful to the connection service server 120 (S765).

The linking service server 120 can transmit a signal corresponding to the processing result information to the natural language processing server 112 such as "set the air conditioning temperature to 18 degrees" (S770).

On the other hand, the natural language processing server 112 can transmit a response signal based on the voice command of the discriminating user to the text / voice conversion server 113 (S781). Here, the response signal based on the voice command of the discriminating user may include the processing result information.

On the other hand, the text-to-speech conversion server 113 converts the response signal based on the voice command into voice data (S783) and transmits the voice data to the home appliance 200a (S785).

The home appliance 200a can output a voice guidance message such as "Set the air conditioner temperature to 18 degrees" based on the received voice data (S790).

FIG. 8 illustrates a signal flow when requesting a non-supported function of the home appliance.

Referring to FIG. 8, the air conditioner 200a according to an embodiment of the present invention receives a user's voice command for a laundry function not supported by the air conditioner 200a, such as "LG Whishen, (S810).

The air conditioner 200a may transmit the voice command of the received user to the voice server 110 (S820). The air conditioner 200a may convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S831), and transmits the text data to the natural language processing server 112 (S833).

The natural language processing server 112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S841).

In addition, the natural language processing server 112 can determine the supportability of the discriminated voice command. In this embodiment, the natural language processing server 112 can determine that the user has requested the laundry function not supported by the air conditioner 200a.

Thereafter, the natural language processing server 112 can transmit a response signal indicating that the voice command determined by the text-to-speech conversion server 113 is a function not supported by the home appliance (S843).

The text-to-speech conversion server 113 converts the response signal based on the voice command into voice data (S845) and transmits it to the home appliance 200a (S847).

The home appliance 200a can output a voice guidance message such as "This is a function that is not supported" based on the received voice data (S850).

FIG. 9 illustrates signal flow when requesting a non-serving function in the current operating mode of the home appliance.

Referring to FIG. 9, the air conditioner 200a according to the embodiment of the present invention receives a voice command of a user instructing a specific mode operation of the air conditioner 200a, such as "LG Whishen, (S910).

The air conditioner 200a can transmit the voice command of the received user to the voice server 110 (S920). The air conditioner 200a may convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S931), and transmits the text data to the natural language processing server 112 (S933).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S941).

For example, the natural language processing server 112 can determine the voice command of the intention of the user to operate the air conditioner 200a in the cool power mode at "LG Whishen, CoolPower Startup ".

The natural language processing server 112 can transmit a signal corresponding to the identified voice command to the link service server 120 (S943).

When the connection service server 120 requests the current state information of the air conditioner 200a to the home appliance control server 130 in step S951, the home appliance control server 130 inquires current state information of the air conditioner 200a (S953), the current state information of the air conditioner 200a can be transmitted to the linking service server 120 (S955).

If the home appliance control server 130 does not have the current state information of the air conditioner 200a, the home appliance control server 130 can request and receive current state information from the air conditioner 200a.

On the other hand, the connection service server 120 receiving the status information can determine whether or not the voice command can be supported based on the current status information of the air conditioner 200a (S957). For example, when the current air conditioner 200a is operating in the dehumidification mode and the cool power mode is supported only in the cooling mode, the natural language processing server 112 requests the cool power mode, which is not supported in the current state, Can be determined.

Thereafter, the connection service server 120 may transmit a response signal indicating that the voice command determined by the natural language processing server 112 is a function that the home appliance 200a does not support in the present state (S960).

In addition, a response signal indicating that the voice command determined by the natural language processing server 112 is a function not supported by the text-to-speech conversion server 113 in the current state can be transmitted (S971).

On the other hand, the text-to-speech conversion server 113 converts the response signal based on the voice command into voice data (S973) and transmits the voice data to the home appliance 200a (S975).

The home appliance 200a can output a voice guidance message such as "Cool Power is supported only in cooling mode" based on the received voice data (S980).

According to the present invention, it is possible to implement a user experience that provides appropriate voice guidance for cases in which a command of a user is not understood or a function that can not be provided.

By providing an announcement tailored to each situation and time occurring during command processing, the inconvenience of the user can be minimized.

10 is a block diagram of an internal block diagram of a server according to an embodiment of the present invention. The server includes an automatic speech recognition server 111, a natural language processing server 112, a text-to-speech conversion server 113, A connection service server 120, and a home appliance control server 130.

Referring to FIG. 10, the server may include a communication module 1020, a storage unit 1030, and a processor 1010.

The processor 1010 can control the overall operation of the server.

The communication module 1020 can receive various data such as status information, operation information, operation information, voice data, and character data from a home appliance such as a mobile terminal, an air conditioner, or another server.

The communication module 1020 can transmit the data corresponding to the received various information as it is or after predetermined processing to a home appliance such as a mobile terminal, an air conditioner, or another server.

To this end, the communication module 1020 may include one or more communication modules such as an Internet module, a mobile communication module, and the like.

The storage unit 1030 may store the received information and may have data for generating the corresponding result information.

The storage unit 1030 may store data for operation of the server. For example, in the case of the automatic speech recognition server 111, an automatic speech recognition algorithm and the like are stored in the storage unit 1030. In the case of the home appliance control server 130, the product information of the home appliance, Can be stored.

Meanwhile, the server may be a server operated by a home appliance manufacturer such as an air conditioner or a server operated by a service provider, or may be a kind of a cloud server.

11 is a block diagram illustrating an example of an internal block diagram of a home appliance according to an embodiment of the present invention.

11, a home appliance 200 according to an exemplary embodiment of the present invention includes a camera 210, an audio input unit 220 for receiving a voice command of a user, an operation unit 230, a memory A communication unit 270 for wirelessly communicating with other electronic devices, a driver 280 for performing operations implemented in the respective home appliances, a display 292 for displaying predetermined information as images, An audio output unit 291, and a control unit 240 for controlling the overall operation.

The audio input unit 220 can receive external audio signals and user voice commands. To this end, the audio input unit 220 may include one or more microphones (MICs). In addition, the audio input unit 220 may include a plurality of microphones 221 and 222 in order to more accurately receive a user's voice command. The plurality of microphones 221 and 222 can be disposed at different positions and can acquire an external audio signal and process it as an electrical signal.

11 and the like, the audio input unit 220 includes two microphones including a first microphone 221 and a second microphone 222, but the present invention is not limited thereto.

The audio input unit 220 may include a processor for converting analog sound into digital data, or may be connected to a processing unit to convert user input voice commands into data to be recognized by the controller 240 or a predetermined server.

Meanwhile, the audio input unit 220 may use various noise reduction algorithms for eliminating noise generated in the process of receiving a voice command of a user.

The audio input unit 220 may include a filter for removing noise from an audio signal received from each of the microphones 221 and 222 and an amplifier for amplifying and outputting a signal output from the filter, .

The memory 250 records various kinds of information necessary for the operation of the home appliance, and may include a volatile or nonvolatile recording medium. The storage medium stores data that can be read by a microprocessor, and includes a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD- Tape, floppy disk, optical data storage, and the like.

Meanwhile, the memory 250 may store data for voice recognition, and the control unit 240 may process the voice input signal of the user received through the audio input unit 220 and perform a voice recognition process.

Meanwhile, a simple speech recognition may be performed by the home appliance 200, and a high-level speech recognition such as natural language processing may be performed in the speech recognition server system 100.

For example, in the case where a wake up voice signal including a preset caller is received, the home appliance 200 can be switched to a state for receiving a voice command. In this case, the home appliance 200 performs only the voice recognition process up to the voice input of the caller, and voice recognition for the subsequent voice input of the user can be performed through the voice recognition server system 100.

Home appliances Because there is a limit to these system resources, complex natural language recognition and processing can be performed through the speech recognition server system 100.

Limited data may be stored in the memory 250. [ For example, in the memory 250, data for recognizing a wake up voice signal including a preset caller may be stored. In this case, the control unit 240 can recognize a wake-up voice signal including a preset caller from the voice input signal of the user received through the audio input unit 220. [

On the other hand, the caller can be set by the manufacturer, and another caller can be set for each home appliance. For example, "LG whisen " in the case of an air conditioner and" LG dios "in the case of a refrigerator may be set as an invocation word.

In addition, the caller can be changed by the user.

The control unit 240 can control the voice recognition server system 100 to transmit the voice command of the user inputted after recognizing the wake up voice signal to the voice recognition server system 100 through the communication unit 270. [

The communication unit 270 includes one or more communication modules and can perform wireless communication with other electronic devices to exchange various signals. For example, the communication unit 270 can communicate with electronic devices inside / outside the mall home system 10. [

The communication unit 270 may communicate with the access point 300 and may access the wireless Internet network through the access point 300 to communicate with other devices.

The control unit 240 can also transmit the state information of the home appliance 200, voice commands of the user, and the like to the voice recognition server system 100 or the like through the communication unit 270.

Meanwhile, when a control signal is received through the communication unit 270, the control unit 240 may control the home appliance 200 to operate according to the received control signal.

The display 292 can display information corresponding to a command input by a user, a processing result corresponding to a command input by the user, an operation mode, an operation state, an error state, and the like.

According to an embodiment, the display 292 may be configured as a touch screen by forming a mutual layer structure with the touch pad. In this case, the display 292 may be used as an input device capable of inputting information by a user's touch in addition to the output device.

The audio output unit 291 outputs a notification message such as a warning sound, an operation mode, an operation state, an error state, etc., information corresponding to a command input by the user, a process corresponding to a command input by the user And output the result as audio.

On the other hand, the audio output unit 291 can convert the electrical signal from the control unit 240 into an audio signal and output it. For this purpose, a speaker or the like may be provided.

The driving unit 280 performs an operation implemented in the home appliance, and may be configured differently for each home appliance.

For example, when the home appliance is a refrigerator, the driving unit 280 includes a refrigerator compartment driving unit for operating a refrigerator compartment fan for supplying cooled air to the refrigerator compartment, a freezer compartment driving unit for operating a freezer compartment fan for supplying cooled air to the freezer compartment, A compressor driving unit for operating a compressor for compressing the refrigerant, and the like.

As another example, when the home appliance is a washing machine, the driving unit 280 may include a driving unit for driving the drum or the tub.

As another example, when the home appliance is an air conditioner, the driving unit 280 includes a compressor driving unit for driving the compressor in the outdoor unit, an outdoor fan driving unit for operating the outdoor fan for heat exchange, A fan drive unit, and the like.

As another example, when the home appliance is a cooker, the driving unit 280 may include a microwave driving unit that outputs microwaves into the cavity.

As another example, when the home appliance is a cleaner, the driving unit 280 may include a fan motor driving unit for air suction.

The home appliance 200 may further include an operation unit 230 for user input and a camera 210 for photographing a predetermined range around the home appliance 200.

The operation unit 230 may include a plurality of operation buttons, and may transmit a signal corresponding to the input button to the control unit 240.

The camera 210 photographs the surroundings of the home appliance 200, the external environment, and the like.

For example, the camera 210 may include at least one optical lens and an image sensor (e.g., an optical sensor) configured to include a plurality of photodiodes (e.g., pixels) that are imaged by light passing through the optical lens. A CMOS image sensor, and a digital signal processor (DSP) that forms an image based on signals output from the photodiodes. The digital signal processor is capable of generating moving images composed of still frames as well as still images.

Meanwhile, the image captured by the camera 210 may be stored in the memory 250.

FIG. 12 is a view showing a part of an internal block diagram of an air conditioner according to an embodiment of the present invention, and FIGS. 13 and 14 are views schematically showing an appearance of an air conditioner according to an embodiment of the present invention to be.

12 is a view showing a state in which the home appliance illustrated in Fig. 11 is the air conditioner 200a illustrated in Figs. 13 and 14, and the vane driver 200a included in the driving unit 280a of the air conditioner 200a, (1210) and a fan driving unit (1220).

FIG. 13 and FIG. 14 are views briefly showing an appearance of an indoor unit of an air conditioner according to an embodiment of the present invention.

11 to 14, an air conditioner 200a according to an embodiment of the present invention includes microphones 221 and 222 that receive voice commands of a user, a communication unit 270 that wirelessly communicates with other electronic devices, A control unit 240 for controlling the overall operation, and a vane driving unit 1210 for driving the vane under the control of the control unit 240.

In addition, the air conditioner 200a according to an embodiment of the present invention may further include a fan driving unit 1220 for driving the fan under the control of the control unit 240. [

The microphones 221 and 222 can receive external audio signals and user voice commands. Also, the microphones 221 and 222 can acquire external audio signals and user voice commands and process them as electrical signals.

The air conditioner 200a of the present embodiment includes a suction body 202 having an air inlet (not shown), a heat exchanger (not shown) through which the air sucked by the air inlet is passed, air sucked into the air inlet, And a discharge port 207R, 207U, 207D formed to discharge air back into the room.

The air outlets 207R, 207U, and 207D are provided with wind direction adjusting means such as louvers (not shown) and / or vanes 261R, 261L, 261U, and 261D that open / close the air outlets 190 to adjust the air- And the angle and direction of the wind direction adjusting means can be switched by driving the motor or the like under the control of the control unit 240. [ Accordingly, the airflow direction of the air discharged through the discharge ports 207R, 207U, and 207D can be adjusted. Further, by controlling the operation of the wind direction adjusting means, it is possible to adjust the blowing direction of the airflow, the blowing range, and the like.

For example, the vanes 261R, 261L, 261U, and 261D may be fixed in either direction so as to blow air in either direction, or an operation in which the direction of the vane continues to change within a set range (Hereinafter referred to as "swinging operation") is performed so that the blowing operation can be performed over a predetermined range in which the blowing direction is continuously changed within the set range. Further, by adjusting the angular range in which the swing motion of the vanes 261R, 261L, 261U, and 261D is performed, the range in which the blowing is performed can be further narrowed or widened.

Meanwhile, the inside of the air conditioner is provided with a fan for controlling the flow of indoor air sucked into the indoor air through the air outlets 207R, 207U, and 207D to the indoor space. The fan is driven by the fan driving unit 1220 And the operation of the fan driving unit 1220 is controlled by the control unit 240. [

Accordingly, the control unit 240 controls the vane driving unit 1210 and the fan driving unit 1220 to control the direction of the airflow (airflow) discharged from the air conditioner 200a. The controller 240 controls the speed of the fan motor to control the amount and speed of the airflow, and controls the direction of the airflow by controlling the louver, the vane, and the like.

On the other hand, the air conditioner may include a plurality of vanes 261R, 261L, 261U, and 261D. Also, at least some of the plurality of vanes 261R, 261L, 261U, 261D may operate in different ways.

For example, the upper vane 261U can be raised and lowered on the upper portion of the fan, and can be raised and lowered during operation. To this end, the air conditioner 200a may include a lifting mechanism 1211 for lifting the upper vane 261U.

The upper vane 261U may function as an upper discharge body for discharging at least a part of the air blown from the fan through the air outlet 207U to the room.

The suction body 202 may be installed above the base 201. The suction body 202 can form the outer surface of the rear side of the air conditioner together with the base 201. [ The suction body 202 can form the upper surface of the rear surface of the air conditioner. The suction body 202 may constitute a rear case of the air conditioner together with the base 201. The suction body 202 may be a rear upper case of the air conditioner, It may be a rear lower case.

A control unit 240 for controlling various electrical components of the air conditioner may be installed in the base 201. Here, various electric components of the air conditioner may include fans and the like. The base 201 may be provided with a base cover 225 disposed in front of the base 201.

The air conditioner may further include a purifying unit (not shown) for purifying the air. The purifying unit may be disposed in the suction body 202. The purifying unit may be disposed before the heat exchanger in the air flow direction. The purifying unit can be disposed between the suction body 202 and the heat exchanger, and is disposed behind the suction body 202. The purifying unit may include a filter for filtering foreign matter in the air. The purifying unit may include an ion generator for generating ions in the air. The purifying unit may include an electrostatic precipitator for discharging foreign matter in the air to collect the dust. The purification unit may include at least one of a filter, an ion generator, and an electrostatic precipitator.

The heat exchanger may be located in front of the air inlet. The heat exchanger can heat-exchange the air sucked into the air inlet with the refrigerant. The heat exchanger may be installed between the air inlet and the fan.

When the compressor installed in the outdoor unit is driven, the air conditioner can cool the low-temperature and low-pressure refrigerant through the heat exchanger, and the heat exchanger can cool the air passing through the air inlet. When the compressor is on, the heat exchanger can cool the air by exchanging heat between the refrigerant and the air, and the air conditioner can function as a cooler.

The fan may be located in front of the heat exchanger. The fan may be constituted by a centrifugal fan that sucks air in the rear and blows air in at least one of the upper, lower, left, and right directions. The fan can consist of a sirocco fan. The fan may be a sirocco fan that blows air in four directions: up, down, left, and right.

The fan may include a plurality of blowing fans. The plurality of blowing fans can be sequentially arranged in the vertical direction. Each of the plurality of blowing fans may be constituted by a sirocco fan. The upper vane 261U,

An upper front air outlet 207U may be formed on the front surface of the upper vane 261U. An air inlet (not shown) may be formed on the lower surface of the upper vane 261U to allow the air blown from the fan upward. The upper vane 261U can guide the air blown upward from the inner fan in the forward direction.

The upper vane 261U may be arranged to be raised and lowered above the fan. When the upper vane 261U rises, the upper front air outlet 207U can be raised to discharge air, and the upper front air outlet 207U can be concealed when the vane 261U is lowered.

The air conditioner may further include an elevation guide 208 for guiding the elevation of the upper vane 261U. The elevation guide 208 may be installed above the fan and heat exchanger. The upper vane 261U is positioned on the upper side of the elevation guide 208 to discharge air when the upper vane 261U rises and the upper front air discharge port 207U is positioned on the inner side of the elevation guide 208 And can be concealed.

The elevating mechanism 1211 may include a driving source such as a motor and a power transmitting member for raising and lowering the upper vane 261U when the driving source is driven. The power transmitting member may include a pinion installed on the drive source and a rack engaged with the pinion.

The lifting mechanism 1211 may be raised to a different height depending on the operation mode. The control unit 240 can control the lifting mechanism 1211 according to the selection of the operation mode of the user.

For example, the control unit 240 may raise the upper vane 261U to the maximum opening height at which the upper front air outlet 207U is maximally opened, or only a part of the upper front air outlet 207U may be opened So that the upper vane 261U can be raised.

A side air outlet 207R through which the air blown in the lateral direction from the fan passes may be formed on the side surface of the air conditioner 200a.

Side vanes 261R and 261L can be disposed on the side surface of the air conditioner, which can control the direction of the air blown from the fan to the side and open and close the left air outlet and the right air outlet 207R. The side vanes 261R and 261L may include a left vane 261L and a right vane 261R.

The side vanes 261R and 261L may be rotatably installed. The air conditioner may include side driving mechanisms 1212 and 1213 for rotating the side vanes 261R and 261L. The side drive mechanisms 1212 and 1213 may include a left vane drive mechanism 1212 and a right vane drive mechanism 1213. [

The side driving mechanisms 1212 and 1213 may include a driving source such as a motor. The side drive mechanisms 1212 and 1213 may include at least one power transmitting member such as a link or a gear that is connected to the drive source and rotates the side vanes 261R and 261L when the drive source is driven.

The side drive mechanisms 1212 and 1213 can be controlled by the control unit 240 in the open mode during the cooling operation. The side drive mechanisms 1212 and 1213 can rotate the left vane 261L and the right vane 261R at a predetermined opening angle under the control of the control unit 240. [

Thus, the blowing direction can be controlled, and blowing can be performed in a range set in a manner that continuously changes the blowing direction within the set range by causing the swinging operation to be performed. In addition, by adjusting the angle range in which the swing motion is performed, the range in which the blowing is performed can be further narrowed or broadened.

The air conditioner may further include a lower vane 261D having a lower front air outlet 207D formed therein.

The lower vane 261D can discharge the air blown downward from the fan in the forward direction. The lower vane 261D may have a passage through which air flows. A lower front air discharge port 207D for discharging air to the outside may be formed on the front surface of the lower vane 261D. .

The air conditioner may further include an opening / closing mechanism 1214 for opening / closing the lower front air outlet 207D. The opening and closing mechanism 1214 may include a moving kit (not shown) for moving the lower vane 261D to open and close the lower front air outlet 207D. The moving kit may include a driving source such as a motor, a moving kit carrier on which the moving kit is placed, and at least one power transmitting member for moving the moving kit carrier when the driving source is driven.

The lower vane 261D is advanced to cover the lower front air outlet 207D and can be retracted to open the lower front air outlet 207D.

The opening / closing mechanism 1214 can be controlled to an open mode in which the lower front air outlet 207D is opened during operation in a predetermined mode.

The air conditioner may further include a blower cover 282 disposed in front of the fan, and the blower cover 282 may form an upper front surface of the air conditioner. The blower cover 282 can be disposed on the upper side of the base cover 225 and can form an outer appearance of the front side of the air conditioner together with the base cover 225. The blower cover 282 can constitute the front cover of the air conditioner together with the base cover 225. The blower cover 282 may be a front upper cover of the air conditioner, and the base cover 225 may be a front lower cover of the air conditioner.

The air conditioner may be provided with a display 292 for displaying various information. The air conditioner may further include an audio output unit 291 for outputting an audio signal, and a speaker of the audio output unit 291 may be disposed on a front surface of the air conditioner or at an appropriate position.

  In addition, the air conditioner may include an operation unit 230 having a plurality of buttons for inputting various commands, and a camera 210 capable of photographing a predetermined range around the home appliance 200.

According to one aspect of the present invention, a front panel 1300 is disposed on the front surface of the blower cover 282 or the base cover 225, and a display 292, an audio output unit 291, Speakers, and operation buttons of the operation unit 230 can be disposed.

 The air conditioner can be operated according to a plurality of operation modes. The control unit 240 can control the vane driver 1210, the fan driver 1220, and the like according to the selected operation mode.

For example, in the predetermined operation mode, the control unit 240 can control the plurality of vanes 261R, 261L, 261U, and 261D to open all the discharge ports.

Or in the predetermined operation mode, the control unit 240 can control the specific vane to be closed without opening the discharge port. For example, in the predetermined operation mode, the controller 240 can control the lower vane 261D to be closed.

In addition, the controller 240 can adjust the opening angle of the upper vane 261R and the left and right vanes 261R and 261L in accordance with the operation mode.

In addition, the control unit 240 can adjust the air volume by controlling the rotation speed of the fan according to the operation mode.

On the other hand, the appearance and structure of the air conditioner illustrated in Figs. 13 and 14 are illustrative, and the present invention is not limited thereto. For example, the positions, numbers, structures, and the like of the microphones 221 and 222, the camera 210, the audio output unit 291, and the vanes 261R, 261L, 261U, and 261D may vary according to design specifications.

15 is a flowchart illustrating an operation method of a home appliance according to the present invention.

Referring to FIG. 15, the home appliance 200 can activate the voice recognition function by user input (S1510). The control unit 240 of the home appliance 200 can activate the microphones 221 and 222 according to user input.

Alternatively, the home appliance 200 may automatically activate the voice recognition function according to the setting for activating the voice recognition function.

For example, when the power is turned on, the home appliance 200 can automatically activate the microphones 221 and 222 and activate the voice recognition function.

When a voice input is received from the user while the microphones 221 and 222 of the home appliance are activated, the microphones 221 and 222 receive the input voice and can transmit the input voice to the control unit 240.

Meanwhile, the home appliance 200 may enter a wake up signal standby mode for inputting a wake up voice signal including a preset caller (S1515).

If a wake-up voice signal including a predetermined caller is received via the microphones 221 and 222 (S1520), the home appliance 200 switches to a command standby mode for receiving a voice command (S1525).

If the home appliance 200 always waits for a natural language command, the power consumed by the voice recognition function, the CPU occupation rate, and the load on the server of the voice recognition server system are burdensome.

Therefore, the home appliance 200 can transmit only the voice signal coming in the standby state of the command to the server.

In addition, the home appliance 200 provides a condition at a time of waiting for an instruction, and when receiving an instruction within a time, the home appliance 200 can receive a sound until the completion of the instruction and transmit the sound to the server.

According to one aspect of the present invention, the home appliance 200 performs only a voice recognition process up to whether a caller voice is input, and voice recognition for a subsequent user voice input can be performed through the voice recognition server system 100 .

On the other hand, the caller can be set by the manufacturer, and another caller can be set for each home appliance. For example, "LG Whishen" for an air conditioner, "LG Dios" for a refrigerator, and "LGTorm" for a washing machine can be set as an invocation word. On the other hand, the caller can be changed by the user.

On the other hand, the control unit 240 can control the voice recognition server system 100 to transmit the voice command of the user inputted after recognizing the wake up voice signal to the voice recognition server system 100 through the communication unit 270 S1530).

On the other hand, waiting indefinitely for a user's voice command is wasteful of system resources and does not match the intention of a user who does not input a command. Therefore, in the command standby mode, only voice commands input during a predetermined elapsed time can be set to be processed ).

In this case, the control unit 240 may control to transmit the voice data including the voice command received within a predetermined elapsed time to the voice server 110 (S1530).

On the other hand, if no voice command is received within a preset elapsed time (S1527), the control unit 240 can control to switch to the wake-up signal standby mode again.

According to an embodiment, when a voice command is received within a preset elapsed time (S1527), the controller 240 performs a feedback operation corresponding to reception of the command to notify the user that the home appliance 200 has received the command (S1529).

In this case, according to the control of the control unit 240, the driving unit 280 can perform a preset operation.

For example, when the home appliance 200 is the air conditioner 200a, the driving unit 280 may include a vane driving unit 1210, a fan driving unit 1220, and the like.

As voice commands are received within a predetermined elapsed time, the vane driver 1210 may drive one or more vanes 261R, 261L, 261U, and 261D to perform at least one of elevating, moving, rotating, have.

For example, the lifting mechanism 1211 can lift the upper vane 261U. In a state in which the upper vane 261U is closed without opening the discharge port 207U, the lifting mechanism 1211 can raise the upper vane 261U to a predetermined height.

The left vane drive mechanism 1212 and the right vane drive mechanism 1213 can rotate the left vane 261L and the right vane 261R by a predetermined angle under the control of the control unit 240. [

The left vane drive mechanism 1212 and the right vane drive mechanism 1213 can also be controlled to perform a swing operation in which the left vane 261L and the right vane 261R repeatedly rotate within a predetermined range.

Further, the opening / closing mechanism 1214 can advance the lower vane 261D inwards to open the lower front air outlet 207D.

According to an embodiment of the present invention, when a voice command is received within a preset elapsed time, the vanes 261R, 261L, 261U, and 261D are moved to intuitively inform the user of the reception of the command, .

When the user inputs voice commands to the air conditioner 200a, since most of the cases are intended to operate the air conditioner 200a, the vanes 261R, 261L, 261U, and 261D are moved preliminarily, The user can respond to the voice command more quickly.

On the other hand, the fan driving unit 1220 can drive the fan as the voice command is received within a preset elapsed time.

For example, the fan driving unit 1220 can rotate the stopped fan. Or the fan driving unit 1220 can lower or stop the rotational speed of the rotating fan.

Meanwhile, the voice server 110 and the voice recognition server system 100 including the voice server 110 recognize and process voice data including voice commands received from the home appliance 200, as described with reference to FIGS. 1 to 9 .

Accordingly, when the communication unit 270 receives the control signal based on the voice command from the home appliance control server 130 (S1540), the control unit 240 controls the home appliance 200 to operate in accordance with the received control signal (S1545).

When the communication unit 270 receives a response signal based on the voice command from the voice server 110 in step S1550, the control unit 240 controls the audio output unit 291 to output the voice guidance message corresponding to the received response signal, (S1570).

The control unit 240 requests the voice server 110 to send voice data in step S1565 and transmits the voice data requested by the voice server 110 to the voice server 110. [ Can be controlled.

On the other hand, according to the speech recognition result, the signal corresponding to the speech recognition failure can be received from the speech server 110 through the communication unit 270. In this case, the control unit 240 may control the audio output unit 291 to output a voice guidance message requesting re-input of the voice command, and to switch to the command standby mode again.

In accordance with the discrimination of supportability of the discriminated voice command, a signal indicating that the voice command is not supported from the voice server 110 through the communication unit 270 can be received (S1535). In this case, the control unit 240 can control the audio output unit 291 to output a voice guidance message informing that the voice command is related to the unsupported function.

In this case, the control unit 240 can control to switch to the wake-up signal standby mode.

Alternatively, the control unit 240 can again control to switch to the command standby mode.

According to the present invention, by providing a voice guidance message for each situation, it is possible to accurately grasp at which stage a voice control command is not normally controlled. In addition, the degree of freedom of commands for controlling the product is high, and usability is improved.

16 is a flowchart illustrating an operation method of a smart home system including a speech recognition server system and a home appliance according to the present invention.

16, the home appliance 200 activates the voice recognition function (S1611) to enter a wake-up signal standby mode for inputting a wake-up voice signal including a preset caller (S1612).

When the preset callers such as " LG Whishen ", "LG Dios "," LG Tromm ", and "LG Signature" are input through the microphones 221 and 222 (S1613), the home appliance 200 receives (S1614). ≪ / RTI >

In the command standby mode, it is possible to set to process only voice commands input during a predetermined elapsed time (S1615). For example, an elapsed time of 6 seconds may be set, and in this case, the control unit 240 may control to transmit the voice data including the voice command received within 6 seconds to the voice server 110 ( S1621).

On the other hand, if no voice command is received within a preset elapsed time (S1621), the control unit 240 can control to switch to the wake-up signal standby mode again.

According to one aspect of the present invention, the home appliance 200 performs only a voice recognition process up to whether a caller voice is input, and voice recognition for a subsequent user voice input can be performed through the voice recognition server system 100 .

The voice server 110 may analyze the intention of the user and discriminate the voice command by performing the natural language processing (S1621) when the voice data including the voice command is received from the home appliance 200 (S1621).

If the voice command is not normally analyzed (S1623), the voice server 110 notifies the home appliance 200 of the voice command analysis failure, and the home appliance 200 transmits a voice guidance message including the re- It can fire (S1662).

In this case, the re-order request and the re-order analysis process may be set to be performed only a predetermined number of times (S1661).

For example, if the normal analysis fails three times or more, the control unit 240 can control to switch to the wake-up signal standby mode again without requesting re-ordering.

On the other hand, if the voice command is normally analyzed (S1623), the voice server 110 can transmit the voice command to the signal connection service server 120 corresponding to the voice command determined.

On the other hand, the connection service server 120 can determine whether or not the identified voice command can be supported.

For example, the connection service server 120 can determine whether the determined voice command is a function supported by the home appliance 200 (S1631).

The connection service server 120 may determine whether the determined voice command is a function supported in the current state of the home appliance 200, a function provided as a voice command, or the like (S1632).

If the identified voice command is not a function that can be supported by the voice command, as described above with reference to FIGS. 1 to 9, the connection service server 120 can support the home appliance 200 via the voice server 110 It is possible to transmit a response signal indicating that it is not a function.

Accordingly, the home appliance 200 can output a voice guidance message such as 'a function that is not supported' or 'a function that does not support voice' (S1671, S1672).

Also, the control unit 240 can control to switch to the wake-up signal standby mode.

 The connection service server 120 may perform a corresponding operation by communicating with the home appliance control server 130 if the determined voice command is related to the home appliance 200. [

Alternatively, if the determined voice command is not related to the home appliance 200, the associated service server 120 may perform a corresponding operation by communicating with an external service.

The connection service server 120 can generate a request signal corresponding to the identified voice command and transmit it to the home appliance control server 130 if the determined voice command controls the home appliance 200. [

The home appliance control server 130 may receive a request signal from the linkage service server 120 and transmit a control signal based on the request signal to the home appliance 200.

For example, when a request to change the set temperature of the air conditioner 200a is received, the household appliance control server 130 may transmit a control signal for changing the set temperature to the air conditioner 200a.

Meanwhile, the home appliance 200 may perform a corresponding operation according to the control signal received from the home appliance control server 130 (S1640).

In addition, the home appliance 200 may transmit a signal to the home appliance control server 130 indicating that the home appliance 200 has performed the requested operation.

The home appliance control server 130 may receive a response signal to the control signal from the home appliance 200 and may transmit processing result information indicating that the operation for the request is successful to the linkage service server 120. [

The connection service server 120 can transmit a signal corresponding to the processing result information to the natural language processing server 112 such as "set the air condition temperature to 18 degrees ", and the natural language processing server 112 can transmit the user's voice It is possible to transmit a response signal based on the command to the home appliance 200. [

On the other hand, the home appliance 200 may generate a voice guidance message including an announcement such as "set the air conditioner temperature at 18 degrees" based on the voice data received from the voice server 110 (S1650).

17 to 21 are views referred to in explaining various operations of the speech recognition server system and the home appliance according to the present invention.

The home appliance 200 according to an exemplary embodiment of the present invention may perform a feedback operation corresponding to reception of a command in order to notify a user that a voice command has been received within a predetermined elapsed time.

17 and 18 illustrate feedback operations performed when the home appliance 200 is the air conditioner 200a.

17, when a voice command is received within the set elapsed time through the microphones 221 and 222 of the air conditioner 200a, the vane driver 1210 may raise the upper vane 261U to a predetermined height .

In addition, the vane driver 1210 can rotate the left vane 261L and the right vane 261R at a predetermined angle.

In addition, the vane driver 1210 may move the lower vane 261D inwards to open the lower front air outlet 207D.

When the voice command is received when the air conditioner 200a is not operating in the specific operation mode and the air outlets are closed, the vane driver 1210 controls the vanes 261R , 261L, 261U, and 261D can be driven.

Alternatively, the vane driver 1210 may drive some of the plurality of vanes 261R, 261L, 261U, and 261D.

18, when a voice command is received within the set elapsed time through the microphones 221 and 222, the vane driver 1210 controls the left vane 261L and the right vane 261R under the control of the controller 240 And can be rotated at a predetermined angle.

In addition, the vane driver 1210 can control the swing operation in which the left vane 261L and the right vane 261R repeatedly rotate within a predetermined range.

According to an embodiment of the present invention, when a voice command is received within a preset elapsed time, the vanes 261R, 261L, 261U, and 261D are moved to intuitively inform the user of the reception of the command, .

When the user inputs voice commands to the air conditioner 200a, since most of the cases are intended to operate the air conditioner 200a, the vanes 261R, 261L, 261U, and 261D are moved preliminarily, The user can respond to the voice command more quickly.

19 to 21 show various examples in which the air conditioner performs a corresponding operation in response to a user's natural language voice command input.

Referring to Fig. 19, the user can input a voice command 1910 in a natural language such as "Deodorize ". The air conditioner 200a receiving the voice command 1910 of the user through the microphones 221 and 222 can transmit the voice command 1910 to the voice recognition system 100. [

The speech recognition system 100 may analyze the received voice command 1910 to determine the intent of the user for the air cleaning function. Accordingly, the speech recognition system 100 can transmit a control signal to the air conditioner 200a to operate the air cleaning function and a response signal corresponding to the operation.

The air conditioner 200a drives the air cleaning function and can output a voice guidance message 1920 such as "drive the air cleaning function ".

Referring to FIG. 20, the user can input a voice command 2010 in a natural language such as "turn on the power save function ". The air conditioner 200a receiving the voice command 2010 of the user through the microphones 221 and 222 can deliver the voice command 2010 to the voice recognition system 100. [

The voice recognition system 100 may analyze the received voice command 2010 to determine the intention of the user who desires the air cleaning function. Accordingly, the speech recognition system 100 can transmit a control signal to the air conditioner 200a to operate the air cleaning function and a response signal corresponding to the operation.

The air conditioner 200a drives the power saving function and can output a voice guidance message 2020 such as "start power saving function ".

Meanwhile, the voice recognition system 100 according to an embodiment of the present invention may perform a corresponding operation by communicating with the external service 121, if the voice command is not related to the home appliance 200a.

Referring to FIG. 21, the user may enter a voice command 2110 in a natural language such as "Today's weather." The air conditioner 200a receiving the voice command 2110 of the user through the microphones 221 and 222 can deliver the voice command 2110 to the voice recognition system 100. [

The speech recognition system 100 may analyze the received voice command 2110 to determine the intent of the user for weather information. Accordingly, the speech recognition system 100 can access an external service or an Internet network that provides weather information, and can request and receive weather information.

Further, the voice recognition system 100 can transmit data based on the received weather information to the home appliance 200a.

The air conditioner 200a can output a voice guidance message 2120 including weather information such as "Seoul is raining from afternoon" based on the received data.

On the other hand, when the microphones 221 and 222 are used in the audio input unit 220 for voice recognition, noise is generated due to operation of the fan or the like, so that the accuracy of speech recognition may be lowered. The present invention proposes a method for reducing the noise when the fan of the air conditioner 200a is in operation and improving the accuracy of speech recognition. This will be described with reference to FIG. 22 and the following figures.

FIG. 22 is a flowchart illustrating an operation method of an air conditioner according to an embodiment of the present invention, and FIGS. 23A to 23D are views referred to the description of the operation method of FIG.

Referring to the drawing, the controller 240 of the air conditioner 200a can determine whether the fan is operating (S2210).

For example, the controller 240 of the air conditioner 200a can determine that the fan is operating when the fan of the indoor unit is operating, either during cooling or during air cleaning.

Next, the control unit 240 of the air conditioner 200a can determine whether or not voice is input (S2215).

For example, when the user speaks a voice, the audio input unit 220 can receive the user's voice, thereby converting the voice into an electric signal and outputting the voice data.

On the other hand, the control unit 240 of the air conditioner 200a controls the rotation speed of the operating fan to be lower than that before the input of the voice when the voice is inputted through the audio input unit 220 during the operation of the fan (S2220).

For example, when the voice in step 2215 (S2215) is the same call as the "LG whishen" 2102 as shown in FIG. 23A, the control unit 240 of the air conditioner 200a controls the fan 299, It is possible to control the fan driving unit 1220 such that the rotational speed of the fan in operation is lowered for noise reduction of the fan. Accordingly, the noise of the fan reaching the audio input unit 220 can be reduced.

Fig. 23A illustrates wa as the rotational speed of the fan 299 before the voice input, and Fig. 23B illustrates wb lower than wa as the rotational speed of the fan 299 after the voice input.

The control unit 240 of the air conditioner 200a controls the open angle of the vanes 261R, 261L, 261U, and 261D when the sound is input through the audio input unit 220 during operation of the fan 299, Can be controlled to be larger than that before the input of the voice (S2225). When the open angle of the vanes 261R, 261L, 261U, and 261D is larger, the noise of the fan reaching the audio input unit 220 can be further reduced.

On the other hand, the control unit 240 of the air conditioner 200a controls the control unit 240 so that the sound data corresponding to the natural voice is transmitted to the server system 100 when the natural voice is inputted after the rotation speed of the fan 299 is lowered (S2230). When the result data is received from the server system 100 (S2235), it is possible to control to output a sound based on the result data (S2240). As a result, natural language speech recognition can be performed easily and accurately.

On the other hand, when the operation data of the air conditioner 200a is included in the result data received from the server system 100 in addition to the voice data, the control unit 240 of the air conditioner 200a determines that the operation data So as to perform an operation.

On the other hand, the control unit 240 of the air conditioner 200a can control the fan rotation speed to increase again after the sound is output (S2245).

On the other hand, after the sound is output, the rotational speed of the fan at the time of increasing the rotational speed of the fan may be the same as the rotational speed of the fan before the audio input. Accordingly, the operation state of the air conditioner can be restored as it is.

On the other hand, when there is no additional voice input such as natural language for a predetermined time after the voice input in operation 2215 (S2215), the control unit 240 can control the rotation speed of the fan to increase again.

That is, when the voice is not generated for a predetermined period of time, the control unit 240 terminates the voice recognition mode and controls the rotation speed of the fan to increase again.

On the other hand, unlike the drawing, the control unit 240 controls to transmit the voice data corresponding to the natural voice to the server system 100 when the natural voice is input after the rotation speed of the fan is lowered, Controls the rotation speed of the fan to increase again, controls the rotation speed of the fan to decrease again when the result data is received from the server system 100, and controls to output sound based on the resultant data. According to this, it is possible to reduce noises at the time of natural language speech data acquisition and at the time of sound output, so that the user's convenience of use can be increased.

Fig. 23A illustrates wa as a rotational speed of the fan 299 before voice input, and illustrates that the opening angle of the vane is? 1 and the wind direction angle is? A.

At this time, when the caller such as "LG whishen" 2102 is ignited, the control unit 240 of the air conditioner 200a controls the rotation of the fan in operation The fan driving unit 1220 can be controlled so that the speed is lowered.

23B illustrates that the rotational speed of the fan 299 is lowered after the voice input.

23B illustrates wb smaller than wa as the rotational speed of the fan 299. It is illustrated that the opening angle of the vane is? 2 larger than? 1 and the angle of the air is? B larger than? A.

As shown in FIG. 23B, since the rotational speed of the fan 299 is lowered after the voice input, the noise reaching the audio input unit 220 is reduced.

On the other hand, as shown in FIG. 23B, since the opening angle of the vane increases after the voice input, the noise reaching the audio input unit 220 is further reduced.

On the other hand, when the natural language 2110 such as "Today's weather forecast" is further ignited as shown in FIG. 23B, the control unit 240 of the air conditioner 200a outputs the sound data 2414 corresponding to the natural language voice Server system 100, and receive result data 2418 from the server system 100. The server system 100 may be configured to receive the result data 2418 from the server system 100. [

The control unit 240 of the air conditioner 200a controls the sound 2120 based on the resultant data while the rotational speed of the fan 299 is wb and the opening angle of the vane is? Can be controlled. In the figure, an audio announcement message including weather information such as "Seoul is raining from afternoon" is exemplified as an output sound.

As described above, by reducing the rotation speed of the fan and increasing the opening angle of the vane until the sound 2120 based on the result data is outputted, noise reduction is realized, and accordingly, smooth speech recognition and corresponding sound output Lt; / RTI >

On the other hand, after the sound 2120 output based on the result data is output, the control unit 240 of the air conditioner 200a increases the rotational speed of the fan 299 to wa as shown in Fig. 23D, can be controlled to be smaller by? 1. Accordingly, the operating state of the air conditioner 200a can be restored to a state prior to the voice recognition mode.

FIG. 24 is a flowchart illustrating an operation method of an air conditioner according to another embodiment of the present invention, and FIGS. 25A to 25E are views referred to the description of the operation method of FIG.

Referring to the drawing, the controller 240 of the air conditioner 200a can determine whether the fan is operating (S2410).

For example, the controller 240 of the air conditioner 200a can determine that the fan is operating when the fan of the indoor unit is operating, either during cooling or during air cleaning.

Fig. 25A illustrates wa as a rotational speed of the fan 299 before activating the voice recognition mode, and illustrates that the opening angle of the vane is? 1 and the wind direction angle is? A.

Next, the control unit 240 of the air conditioner 200a determines whether or not the voice recognition mode is activated (S2415).

25B, when the voice recognition mode button 231 in the operation unit 230 of the air conditioner 200a is operated, the control unit 240 of the air conditioner 200a determines whether the voice recognition mode is activated .

On the other hand, when the voice recognition mode is activated, the control unit 240 of the air conditioner 200a can control the rotational speed of the operating fan to be lower than before the input of the voice (S2420).

When the rotational speed of the operating fan is lowered, the noise of the fan reaching the audio input unit 220 can be reduced.

On the other hand, when the voice recognition mode is activated, the control unit 240 of the air conditioner 200a can control the open angle of the vanes 261R, 261L, 261U, and 261D to be larger than before the voice input (S2425). When the open angle of the vanes 261R, 261L, 261U, and 261D is larger, the noise of the fan reaching the audio input unit 220 can be further reduced.

Fig. 25A illustrates wa as a rotational speed of the fan 299 before the voice input, and illustrates that the opening angle of the vane is? 1 and the wind direction angle is? A.

25A, the control unit 240 of the air conditioner 200a controls the rotation of the fan in operation to reduce the noise of the fan 299. In this case, The fan driving unit 1220 can be controlled so that the speed is lowered.

25B illustrates that the rotational speed of the fan 299 is lowered after the voice input.

25B illustrates wb smaller than wa as the rotational speed of the fan 299, and exemplifies that the opening angle of the vane is? 2 that is larger than? 1 and the angle of the air is? B that is larger than? A.

As shown in FIG. 25B, since the rotational speed of the fan 299 is lowered after the voice input, the noise reaching the audio input unit 220 is reduced.

On the other hand, as shown in FIG. 25B, since the opening angle of the vane increases after the voice input, the noise reaching the audio input unit 220 is further reduced.

Next, the control unit 240 of the air conditioner 200a can determine whether or not voice is input (S2427).

For example, when the user speaks a voice, the audio input unit 220 can receive the user's voice, thereby converting the voice into an electric signal and outputting the voice data.

The user's voice may be a voice word such as "LG whishen" 2102, or a natural word after the voice word.

On the other hand, the control unit 240 of the air conditioner 200a controls the control unit 240 so that the sound data corresponding to the natural voice is transmitted to the server system 100 when the natural voice is inputted after the rotation speed of the fan 299 is lowered (S2430). When the result data is received from the server system 100 (S2435), it is possible to control to output a sound based on the result data (S2440). As a result, natural language speech recognition can be performed easily and accurately.

On the other hand, when the operation data of the air conditioner 200a is included in the result data received from the server system 100 in addition to the voice data, the control unit 240 of the air conditioner 200a determines that the operation data So as to perform an operation.

On the other hand, when the natural language 2413 such as "24 degrees of cooling operation" as shown in Fig. 25C is ignited, the control unit 240 of the air conditioner 200a generates a sound To transmit data 2514 to server system 100 and to receive result data 2518 from server system 100. [

On the other hand, when audio data is not received in the result data from the server system 100 but only operation data is received, the control unit 240 of the air conditioner 200a can control the operation corresponding to the operation data have.

Fig. 25D illustrates performing the refrigeration operation at the rotational speed of the fan of wb according to the operation corresponding to the operation data.

On the other hand, the control unit 240 of the air conditioner 200a determines whether or not the voice recognition mode is ended after the sound is outputted (S2443). If the voice recognition mode is ended or deactivated, (S2445).

On the other hand, after the sound is output, the rotational speed of the fan at the time of increasing the rotational speed of the fan may be the same as the rotational speed of the fan before the audio input. Accordingly, the operation state of the air conditioner can be restored as it is.

On the other hand, when the voice recognition mode is ended or deactivated, the control unit 240 of the air conditioner 200a increases the rotational speed of the fan 299 to wa, and the open angle of the vane is θ1 Can be controlled to be small. Accordingly, the operating state of the air conditioner 200a can be restored to a state prior to the voice recognition mode.

On the other hand, if there is no additional voice input such as natural language for a predetermined time after the voice input in operation 2427 (S2427), the control unit 240 can control the rotation speed of the fan to increase again.

That is, when the voice is not generated for a predetermined period of time, the control unit 240 terminates the voice recognition mode and controls the rotation speed of the fan to increase again.

On the other hand, unlike the drawing, the control unit 240 controls to transmit the voice data corresponding to the natural voice to the server system 100 when the natural voice is input after the rotation speed of the fan is lowered, Controls the rotation speed of the fan to increase again, controls the rotation speed of the fan to decrease again when the result data is received from the server system 100, and controls to output sound based on the resultant data. According to this, it is possible to reduce noises at the time of natural language speech data acquisition and at the time of sound output, so that the user's convenience of use can be increased.

FIG. 26 is a flowchart illustrating an operation method of a home appliance according to an embodiment of the present invention, and FIGS. 27A to 27D are diagrams referencing an operation method description of FIG.

Referring to FIG. 5, the control unit 240 of the home appliance 200 can determine whether the motor is in operation (S2610).

For example, the control unit 240 of the home appliance 200 can detect the output current flowing through the motor 530 to determine whether the motor is operating.

Next, the control unit 240 of the home appliance 200 can determine whether a voice is input (S2615).

For example, when the user speaks a voice, the audio input unit 220 can receive the user's voice, thereby converting the voice into an electric signal and outputting the voice data.

The control unit 240 of the home appliance 200 controls the rotation speed of the motor during operation to be lower than that before the input of the sound through the audio input unit 220 during the operation of the motor (S2620).

For example, if the voice in step 2615 (S2615) is an idle call such as "LGTM" 2702 as shown in FIG. 27A, the home appliance 200, particularly the controller 240 of the washing machine 200d, , It is possible to control the motor driving unit 1220 such that the rotational speed of the motor in operation is lowered for noise reduction of the motor 530. [ Thus, the noise of the motor reaching the audio input unit 220 can be reduced.

Fig. 27A illustrates wa as the rotational speed of the motor 530 before voice input, and Fig. 27B illustrates wb lower than wa as the rotational speed of the motor 530 after voice input.

The control unit 240 of the home appliance 200 controls to transmit the voice data corresponding to the natural voice to the server system 100 when the natural voice is input after the rotational speed of the motor 530 is lowered (S2630). When the result data is received from the server system 100 (S2635), the sound based on the result data may be output (S2640). As a result, natural language speech recognition can be performed easily and accurately.

On the other hand, when the result data received from the server system 100 includes operation data of the home appliance 200 in addition to the voice data, the control unit 240 of the home appliance 200 performs an operation corresponding to the operation data Can be controlled.

On the other hand, the control unit 240 of the home appliance 200 can control the rotation speed of the motor to increase again after the sound is output (S2645).

On the other hand, after the sound is output, the rotational speed of the motor at the time of increasing the rotational speed of the motor may be the same as the rotational speed of the motor before the sound input. Accordingly, the operation state of the home appliance can be restored as it is.

On the other hand, when there is no additional voice input such as natural language for a predetermined time after the voice input in operation 2215 (S2615), the controller 240 controls the rotation speed of the motor to increase again.

That is, when the voice is not ignited for a predetermined time, the control unit 240 can end the voice recognition mode and control the rotation speed of the motor to increase again.

On the other hand, unlike the drawing, the control unit 240 controls to transmit voice data corresponding to a natural voice to the server system 100 when natural voice is inputted after the rotation speed of the motor is lowered, And controls the rotation speed of the motor to increase again. When the result data is received from the server system 100, it is possible to control the rotation speed of the motor to decrease again, and to output sound based on the result data. According to this, it is possible to reduce noises at the time of natural language speech data acquisition and at the time of sound output, so that the user's convenience of use can be increased.

27A illustrates wa as the rotational speed of the motor 530 before the voice input.

27A, when the caller such as "LG Tromm" 2702 is ignited, the control unit 240 of the home appliance 200 controls the rotation speed of the motor in operation It is possible to control the motor driving unit 1220 such that the motor driving unit 1220 is lowered.

27B illustrates that the rotational speed of the motor 530 is lowered after the voice input.

That is, Fig. 27B illustrates wb smaller than wa as the rotational speed of the motor 530. Fig.

As shown in FIG. 27B, since the rotational speed of the motor 530 is lowered after the voice input, the noise reaching the audio input unit 220 is reduced.

On the other hand, when the natural language 2110 such as "Today's Weather" is further uttered as shown in Fig. 27B, the control unit 240 of the home appliance 200 transmits the voice data 2414 corresponding to the natural language voice To the system 100 and to receive the result data 2418 from the server system 100. [

The control unit 240 of the home appliance 200 can control to output the sound 2120 based on the result data while the rotational speed of the motor 530 is wb as shown in Fig. 27C. In the figure, an audio announcement message including weather information such as "Seoul is raining from afternoon" is exemplified as an output sound.

As described above, by reducing the rotation speed of the motor until the sound 2120 based on the result data is output, noise reduction is realized, thereby enabling smooth speech recognition and corresponding sound output.

On the other hand, after the sound 2120 based on the result data is output, the control unit 240 of the home appliance 200 can control the rotational speed of the motor 530 to increase to wa as shown in FIG. 27D. Accordingly, the operating state of the home appliance 200 can be restored to a state prior to the voice recognition mode.

FIG. 28 is a flowchart illustrating an operation method of an air conditioner according to another embodiment of the present invention, and FIGS. 29A to 29E are views referred to in the description of the operation method of FIG.

Referring to FIG. 5, the control unit 240 of the home appliance 200 can determine whether the motor 530 is operating (S2810).

For example, the control unit 240 of the home appliance 200 can detect the output current flowing through the motor 530 to determine whether the motor is operating.

29A illustrates that the rotation speed of the motor 530 is wa before the voice recognition mode is activated.

Next, the control unit 240 of the home appliance 200 determines whether or not the voice recognition mode is activated (S2815).

29B, when the voice recognition mode button 231 in the operation unit 230 of the home appliance 200, particularly the washing machine 200d, is operated, the control unit 240 of the home appliance 200, for example, The voice recognition mode can be controlled to be activated.

On the other hand, the control unit 240 of the home appliance 200 can control the rotation speed of the motor 530 in operation to be lower than that before the voice input when the voice recognition mode is activated (S2820).

When the rotational speed of the motor 530 in operation is lowered, the noise of the motor 530 reaching the audio input unit 220 can be reduced.

29A illustrates wa as the rotational speed of the motor 530 before the voice input.

29A, the control unit 240 of the home appliance 200 controls the operation of the motor 530 in order to reduce the noise of the motor 530. In this case, It is possible to control the driving unit 1220 of the motor 530 so that the rotational speed of the motor 530 is lowered.

FIG. 29B illustrates that the rotational speed of the motor 530 is lowered after the voice input.

That is, Fig. 29B illustrates wb smaller than wa as the rotational speed of the motor 530. Fig.

As shown in FIG. 29B, since the rotation speed of the motor 530 is lowered after the voice input, the noise reaching the audio input unit 220 is reduced.

Next, the control unit 240 of the home appliance 200 can determine whether a voice is input (S2827).

For example, when the user speaks a voice, the audio input unit 220 can receive the user's voice, thereby converting the voice into an electric signal and outputting the voice data.

The user's voice may be a voice word such as "LG Tromp" 2702, or a natural word after the voice call.

The control unit 240 of the home appliance 200 controls to transmit the voice data corresponding to the natural voice to the server system 100 when the natural voice is input after the rotational speed of the motor 530 is lowered (S2830). When the result data is received from the server system 100 (S2835), it is possible to control to output a sound based on the result data (S2840). As a result, natural language speech recognition can be performed easily and accurately.

On the other hand, when the result data received from the server system 100 includes operation data of the home appliance 200 in addition to the voice data, the control unit 240 of the home appliance 200 performs an operation corresponding to the operation data Can be controlled.

On the other hand, when the natural language 2414 such as "Dewatering is better," as shown in Fig. 29C is uttered, the control unit 240 of the home appliance 200 generates voice data 2514 from the server system 100 to the server system 100 and receive the result data 2518 from the server system 100. [

On the other hand, when audio data is not received in the result data from the server system 100 but only operation data is received, the control unit 240 of the home appliance 200 can control to perform an operation corresponding to the operation data .

On the other hand, the control unit 240 of the home appliance 200 determines whether or not the voice recognition mode is ended after the sound is output (S2843). If the voice recognition mode is ended or deactivated, (S2845).

On the other hand, after the sound is output, the rotational speed of the motor at the time of increasing the rotational speed of the motor may be equal to or larger than the rotational speed of the motor before the sound input.

On the other hand, when the voice recognition mode is ended or deactivated, the control unit 240 of the home appliance 200 can increase the rotation speed of the motor 530 as wc more than wa, as shown in Fig. 29E.

Particularly, in order to perform dehydration better, the rotational speed of the motor 530 can be increased more than wa as wc, according to the operation corresponding to the operation data from the server system 100, as shown in Fig. 29E.

Accordingly, the operating state of the home appliance 200 can be restored to a state prior to the voice recognition mode.

On the other hand, unlike the drawing, the control unit 240 controls to transmit voice data corresponding to a natural voice to the server system 100 when natural voice is inputted after the rotation speed of the motor is lowered, Controls the rotation speed of the motor to increase again, controls the rotation speed of the motor 530 to decrease again when the result data is received from the server system 100, and controls to output a sound based on the resultant data . According to this, it is possible to reduce noises at the time of natural language speech data acquisition and at the time of sound output, so that the user's convenience of use can be increased.

30 is a diagram showing another example of an internal block diagram of a home appliance according to an embodiment of the present invention.

Referring to the drawings, a home appliance 200 includes a camera 210, an audio input unit 220 for receiving a user's voice command, an operation unit 230, a memory 250 for storing various data, A display unit 292 for displaying predetermined information as an image, an audio output unit 291 for outputting predetermined information as audio, and a display unit 292 for displaying predetermined information, A control unit 240 for controlling the overall operation, and a processor 260.

The internal block diagram of the home appliance 200 of FIG. 30 is similar to that of FIG. 11 except that a processor 260 is further provided and includes an audio input unit 220, an audio output unit 291, a communication unit 270, a camera 210 And the processor 260 are provided in the voice recognition module 205, which is one single module.

The processor 260 may control the audio input unit 220, the audio output unit 291, the communication unit 270, the camera 210, and the like.

Hereinafter, the difference from Fig. 11 will be mainly described.

The processor 260 processes the voice input signal of the user received through the audio input unit 220 and performs a voice recognition process.

For example, when a wake up voice signal is received that includes a preset caller, the processor 260 may transition to a state for receiving voice commands. In this case, the processor 260 performs only a voice recognition process up to the voice input of the caller, and voice recognition for the subsequent voice input of the user can be performed through the voice recognition server system 100.

The processor 260 can control the voice recognition server system 100 to transmit the voice command of the user inputted after the recognition of the wake up voice signal to the voice recognition server system 100 through the communication unit 270. [

The processor 260 may transmit the status information of the home appliance 200, voice commands of the user, and the like to the voice recognition server system 100 or the like through the communication unit 270.

Meanwhile, the processor 260 may perform the operation in addition to the control of the driving unit 280, the vane driving unit 1210, and the fan driving unit 1220 during the operation of the control unit 240 of FIGS. 22 to 29D .

When the control signal is received through the communication unit 270, the processor 260 transmits a control signal to the control unit 240, and the control unit 240 controls the home appliance 200 to operate according to the received control signal. can do.

Eventually, through the voice recognition module 205, it becomes possible to perform voice data acquisition, communication with the server system 100, and corresponding sound output.

On the other hand, the voice recognition module 205 can be attached to various electronic devices in addition to the home appliances shown in Fig. Or may be used as a separate device without being attached to another electronic device.

The driving unit 280 described with reference to FIG. 11 or FIG. 30 may be a motor driving unit, and may be hereinafter referred to as a motor driving unit.

Fig. 31 illustrates an example of an internal block diagram of a motor driving apparatus according to an embodiment of the present invention, and Fig. 32 shows an example of an internal circuit diagram of the motor driving apparatus of Fig.

The motor driving apparatus 280 according to the embodiment of the present invention drives the motor in a sensorless manner and may include an inverter 420 and an inverter control unit 430 have.

The motor driving apparatus 280 according to the embodiment of the present invention may include a converter 410, a dc voltage detection unit B, a smoothing capacitor C, and an output current detection unit E. The driving unit 280 may further include an input current detection unit A, a reactor L, and the like.

Hereinafter, the operation of each of the constituent units in the motor driving apparatus 280 of Fig. 31 and Fig. 32 will be described.

The reactor L is disposed between the commercial AC power source 405 (v _s ) and the converter 410, and performs a power factor correcting or boosting operation. The reactor L may also function to limit the harmonic current due to the fast switching of the converter 410.

The input current detection section A can detect the input current (i _s ) input from the commercial AC power source 405. To this end, a current transformer (CT), a shunt resistor, or the like may be used as the input current detector A. The detected input current i _s can be input to the inverter control unit 430 as a discrete signal in the form of a pulse.

The converter 410 converts the commercial AC power source 405, which has passed through the reactor L, into DC power and outputs the DC power. Although the commercial AC power source 405 is shown as a single-phase AC power source in the figure, it may be a three-phase AC power source. The internal structure of the converter 410 also changes depending on the type of the commercial AC power source 405.

Meanwhile, the converter 410 may include a diode without a switching element, and may perform a rectifying operation without a separate switching operation.

For example, in the case of a single-phase AC power source, four diodes may be used in the form of a bridge, and in the case of a three-phase AC power source, six diodes may be used in the form of a bridge.

On the other hand, the converter 410 may be, for example, a half-bridge type converter in which two switching elements and four diodes are connected, and in the case of a three-phase AC power source, six switching elements and six diodes may be used .

When the converter 410 includes a switching element, the boosting operation, the power factor correction, and the DC power conversion can be performed by the switching operation of the switching element.

The smoothing capacitor C, also referred to as a dc-stage capacitor, smoothes the input power supply and stores it. In the drawing, one element is exemplified by the smoothing capacitor C, but a plurality of elements are provided so that the element stability can be ensured.

For example, when a direct current power from the solar cell is supplied to the smoothing capacitor C (not shown), the direct current power is supplied to the smoothing capacitor C It may be input directly or may be DC / DC converted and input. Hereinafter, the portions illustrated in the drawings are mainly described.

On the other hand, both ends of the smoothing capacitor C are referred to as a dc stage or a dc stage because the dc power source is stored.

The dc voltage detection unit B can detect the dc voltage Vdc at both ends of the smoothing capacitor C. [ For this purpose, the dc voltage detection unit B may include a resistance element, an amplifier, and the like. The detected dc voltage source Vdc can be input to the inverter control unit 430 as a discrete signal in the form of a pulse.

The inverter 420 includes a plurality of inverter switching elements and converts the smoothed DC power supply Vdc into a three-phase AC power supply va, vb, vc having a predetermined frequency by on / off operation of the switching element, And outputs it to the synchronous motor 530.

The inverter 420 includes a pair of upper arm switching elements Sa, Sb and Sc and lower arm switching elements S'a, S'b and S'c serially connected to each other, The switching elements are connected to each other in parallel (Sa & S a, Sb & S'b, Sc & S'c). Diodes are connected in anti-parallel to each switching element Sa, S'a, Sb, S'b, Sc, S'c.

The switching elements in the inverter 420 perform ON / OFF operations of the respective switching elements based on the inverter switching control signal Sic from the inverter controller 430. [ Thereby, the three-phase AC power source having the predetermined frequency is outputted to the three-phase synchronous motor 530.

The inverter control unit 430 can control the switching operation of the inverter 420 based on the sensorless method. To this end, the drive controller 430, and can receive the output current (i _o) detected by the output current detector (E).

The inverter control unit 430 outputs the inverter switching control signal Sic to the inverter 420 to control the switching operation of the inverter 420. [ Inverter switching control signal (Sic) is output is generated by a switching control signal of a pulse width modulation (PWM), based on the output current (i _o) detected by the output current detector (E). Detailed operation of the output of the inverter switching control signal Sic in the inverter control unit 430 will be described later with reference to FIG.

The output current detection section E detects the output current i _o flowing between the inverter 420 and the three-phase motor 530. That is, the current flowing in the motor 530 is detected. The output current detection unit E can detect all of the output currents ia, ib, ic of each phase or can detect the output currents of two phases using the three-phase balance.

The output current detection unit E may be located between the inverter 420 and the motor 530. In order to detect the current, a current transformer (CT), a shunt resistor, or the like may be used.

When a shunt resistor is used, three shunt resistors are placed between the inverter 420 and the synchronous motor 530, or three lower arm switching elements S'a, S'b, S'c To be connected to each other. On the other hand, it is also possible to use two shunt resistors using three phase equilibrium.

On the other hand, when one shunt resistor is used, the shunt resistor may be disposed between the capacitor C and the inverter 420 described above.

The detected output current (i _o) are, as discrete signals (discrete signal) of the pulse type, may be applied to the inverter controller 430, the inverter switching control signal (Sic) based on the detected output current (i _o) Is generated. The output current (i _o) detected in the following may be written in parallel to the three-phase output currents (ia, ib, ic) of the.

On the other hand, the three-phase motor 530 has a stator and a rotor, and each phase alternating current power of a predetermined frequency is applied to the coils of the stator of each phase (a, b, c phase) .

The motor 530 may be, for example, a Surface-Mounted Permanent-Magnet Synchronous Motor (SMPMSM), an Interior Permanent Magnet Synchronous Motor (IPMSM) A synchronous reluctance motor (Synrm), and the like. Among these, SMPMSM and IPMSM are Permanent Magnet Synchronous Motor (PMSM) with permanent magnet, and Synrm has no permanent magnet.

33 is an internal block diagram of the inverter control unit of Fig.

33, the inverter control unit 430 includes an axis conversion unit 310, a speed calculation unit 320, a current command generation unit 330, a voltage command generation unit 340, an axis conversion unit 350, And a switching control signal output unit 360.

The axial conversion unit 310 receives the three-phase output currents ia, ib, ic detected by the output current detection unit E and converts the three-phase output currents ia, ib, ic into the two-phase currents iα, iβ in the stationary coordinate system.

On the other hand, the axis converting unit 310 can convert the two-phase current i ?, i? Of the still coordinate system into the two-phase current id, iq of the rotating coordinate system.

)와 연산된 속도(

)를 출력할 수 있다.Based on the two-phase current (i?, I?) Of the stationary coordinate system changed in the axis by the axis converting unit 310, the speed calculating unit 320 calculates the speed

) And the calculated speed (

Can be output.

)와 속도 지령치(ω^* _r)에 기초하여, 전류 지령치(i^* _q)를 생성한다. 예를 들어, 전류 지령 생성부(330)는, 연산 속도(

)와 속도 지령치(ω^* _r)의 차이에 기초하여, PI 제어기(335)에서 PI 제어를 수행하며, 전류 지령치(i^* _q)를 생성할 수 있다. 도면에서는, 전류 지령치로, q축 전류 지령치(i^* _q)를 예시하나, 도면과 달리, d축 전류 지령치(i^* _d)를 함께 생성하는 것도 가능하다. 한편, d축 전류 지령치(i^* _d)의 값은 0으로 설정될 수도 있다. On the other hand, the current command generation unit 330 generates the current command

(I ^* _q ) on the basis of the speed command value? ^* _R and the speed command value? ^* _R. For example, the current command generation section 330 generates the current command

The PI controller 335 performs the PI control based on the difference between the speed command value? ^* _R and the speed command value? ^* _R , and generates the current command value i ^* _q . In the figure, the q-axis current command value (i ^* _q ) is exemplified by the current command value, but it is also possible to generate the d-axis current command value (i ^* _d ) unlike the figure. On the other hand, the value of the d-axis current command value i ^* _d may be set to zero.

On the other hand, the current command generation section 330 may further include a limiter (not shown) for limiting the current command value (i ^* _q ) so that the current command value (i ^* _q ) does not exceed the allowable range.

Next, the voltage command generating unit 340 generates the voltage command generating unit 340 with the d-axis and q-axis currents (i _d , i _q ) axially transformed into the two-phase rotational coordinate system in the axial converting unit and the current command value based on ^{_{i * d, i * q)}} , and generates a d-axis, q-axis voltage command value ^{_{(v * d, v * q}} ). For example, the voltage command generation unit 340 performs PI control in the PI controller 344 based on the difference between the q-axis current (i _q ) and the q-axis current command value (i ^* _q ) It is possible to generate the axial voltage command value v ^* _q . The voltage command generation unit 340 performs PI control in the PI controller 348 based on the difference between the d-axis current i _d and the d-axis current command value i ^* _d , It is possible to generate the command value v ^* _d . The voltage command generator 340 may further include a limiter (not shown) for limiting the level of the d-axis and q-axis voltage command values v ^* _d and v ^* _q so as not to exceed the permissible range .

On the other hand, the generated d-axis and q-axis voltage command values (v ^* _d and v ^* _q ) are input to the axial conversion unit 350.

)와, d축, q축 전압 지령치(v^* _d,v^* _q)를 입력받아, 축변환을 수행한다.The axis transforming unit 350 transforms the position calculated by the velocity calculating unit 320

) And the d-axis and q-axis voltage command values (v ^* _d , v ^* _q ).

)가 사용될 수 있다.First, the axis converting unit 350 performs conversion from a two-phase rotating coordinate system to a two-phase stationary coordinate system. At this time, the position calculated by the speed calculator 320 (

) Can be used.

Then, the axial conversion unit 350 performs conversion from the two-phase stationary coordinate system to the three-phase stationary coordinate system. Through this conversion, the axial conversion unit 1050 outputs the three-phase output voltage instruction values v ^* a, v ^* b, v ^* c.

The switching control signal output section 360 generates the switching control signal Sic for inverter according to the pulse width modulation (PWM) method based on the three-phase output voltage instruction values v ^* a, v ^* b and v ^* And outputs it.

The output inverter switching control signal Sic may be converted into a gate driving signal in a gate driving unit (not shown) and input to the gate of each switching element in the inverter 420. As a result, the switching elements Sa, S'a, Sb, S'b, Sc, and S'c in the inverter 420 perform the switching operation.

The air conditioner and the home appliance according to the embodiment of the present invention can be applied to the configurations and the methods of the embodiments described above in a limited manner, All or a part of the above-described elements may be selectively combined.

Meanwhile, the method of operating the air conditioner or the method of operating the home appliance of the present invention can be implemented as a processor-readable code on a processor-readable recording medium provided in an air conditioner or a home appliance. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

A fan driving unit for driving the fan;
An audio input unit for acquiring audio;
A communication unit for transmitting voice data from the audio input unit and receiving result data on the voice data from the server system, the server system performing voice recognition processing; And
And a control unit for controlling the fan driving unit, the audio input unit, and the communication unit,
Wherein,
Wherein when the sound is input through the audio input unit during the operation of the fan, the rotational speed of the operating fan is lower than before the input of the sound. The method according to claim 1,
Wherein,
Wherein the control unit controls the rotation speed of the operating fan to be lower than that before the input of the voice when the input voice is a call through the audio input unit. The method according to claim 1,
Wherein,
Controlling the audio data corresponding to the natural language voice to be transmitted to the server system when the natural voice is input after lowering the rotational speed of the fan, and when the result data is received from the server system, So as to output a sound to be output to the air conditioner. The method of claim 3,
Wherein,
And controls the fan so that the rotational speed of the fan increases again after the sound is output. 5. The method of claim 4,
Wherein the speed of rotation of the fan, which is increased after the sound output, is equal to the speed of rotation of the fan before the voice input. The method according to claim 1,
Wherein,
Wherein the controller controls to increase the rotation speed of the fan again when there is no additional voice input for a predetermined time after the voice input. The method according to claim 1,
Wherein,
Control means for controlling to transmit audio data corresponding to the natural language voice to the server system when a natural voice is input after lowering the rotational speed of the fan, And controls the rotation speed of the fan to decrease again when result data is received from the server system, and to output a sound based on the resultant data. The method according to claim 1,
And a vane driving part for driving the vane,
Wherein,
Wherein when the sound is inputted through the audio input unit during the operation of the fan, the opening angle of the vane is controlled to be larger than before the input of the sound. A fan driving unit for driving the fan;
An audio input unit for acquiring audio;
A communication unit for transmitting voice data from the audio input unit and receiving result data on the voice data from the server system, the server system performing voice recognition processing; And
And a control unit for controlling the fan driving unit, the audio input unit, and the communication unit,
Wherein,
Wherein when the voice recognition mode is activated during the operation of the fan, the rotation speed of the operating fan is lower than before activation of the voice recognition mode. 10. The method of claim 9,
Wherein,
Controlling the audio data corresponding to the natural language voice to be transmitted to the server system when the natural voice is input after lowering the rotational speed of the fan, and when the result data is received from the server system, So as to output a sound to be output to the air conditioner. 11. The method of claim 10,
Wherein,
And controls the fan so that the rotational speed of the fan increases again after the sound is output. 10. The method of claim 9,
Wherein,
Wherein the control unit controls the rotation speed of the fan to increase again when there is no voice input for a predetermined time after activation of the voice recognition mode. 10. The method of claim 9,
Wherein,
Control means for controlling to transmit audio data corresponding to the natural language voice to the server system when a natural voice is input after lowering the rotational speed of the fan, And controls the rotation speed of the fan to decrease again when result data is received from the server system, and to output a sound based on the resultant data. 10. The method of claim 9,
And a vane driving part for driving the vane,
Wherein,
Wherein when the voice recognition mode is activated during the operation of the fan, the opening angle of the vane is controlled to be larger than before activation of the voice recognition mode. A motor driving unit for driving the motor;
An audio input unit for acquiring audio;
A communication unit for transmitting voice data from the audio input unit and receiving result data on the voice data from the server system, the server system performing voice recognition processing; And
And a control unit for controlling the motor driving unit, the audio input unit, and the communication unit,
Wherein,
Wherein when the voice is input through the audio input unit during the operation of the motor, the control unit controls the rotation speed of the motor in operation to be lower than that before inputting the voice. 16. The method of claim 15,
Wherein,
Wherein the control unit controls the rotation speed of the motor in operation to be lower than that before the input of the voice when the input voice is a call through the audio input unit. 16. The method of claim 15,
Wherein,
Controlling the voice data corresponding to the natural language voice to be transmitted to the server system when natural voice is input after lowering the rotational speed of the motor; and when result data is received from the server system, And outputs the sound to the home appliance. 16. The method of claim 15,
Wherein,
Controlling the motor so as to transmit voice data corresponding to the natural language voice to the server system when natural voice is input after lowering the rotational speed of the motor, And controls the rotational speed of the motor to decrease again when result data is received from the server system, and to output a sound based on the resultant data. A motor driving unit for driving the motor;
An audio input unit for acquiring audio;
A communication unit for transmitting voice data from the audio input unit and receiving result data on the voice data from the server system, the server system performing voice recognition processing; And
And a control unit for controlling the motor driving unit, the audio input unit, and the communication unit,
Wherein,
Wherein when the voice recognition mode is activated during the operation of the motor, the control unit controls the rotation speed of the motor in operation to be lower than that before activation of the voice recognition mode. 20. The method of claim 19,
Wherein,
Controlling the motor so as to transmit voice data corresponding to the natural language voice to the server system when natural voice is input after lowering the rotational speed of the motor, And controls the rotational speed of the motor to decrease again when result data is received from the server system, and to output a sound based on the resultant data.

Images