KR20190026519A - Method for operating air conditioner - Google Patents

Abstract

According to an aspect of the present invention, a method for operating an air conditioner collects indoor environmental information and outdoor environmental information and outputs a voice guidance message to actively guide a recommendation driving mode based on the collected environmental information. Therefore, unskilled users can conveniently use optimal driving modes and functions, thereby increasing user convenience.

Description

[0001] The present invention relates to a method for operating an air conditioner,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an air conditioner and an operation method thereof, and more particularly, to an air conditioner which can be controlled according to a natural voice command of a user and can provide a recommended voice guidance according to a situation will be.

The air conditioner is a device that sucks in air and changes the temperature, humidity, cleanliness, etc., and then discharges it to the outside. The air conditioner includes a compressor for compressing the refrigerant, a condenser for condensing the compressed refrigerant, an expansion valve for expanding the condensed refrigerant, and an evaporator for exchanging the expanded refrigerant with the room air, It performs the function of adjusting the temperature.

The air conditioner may comprise a radiator or heater for changing the temperature of the room, a humidifier or dehumidifier for changing the humidity of the room, and an air purifier for changing the cleanliness of the room.

The air conditioner has various functions such as air conditioning, heating, humidification, dehumidification, and air cleaning, but it has been difficult for unskilled users to freely use the functions that the air conditioner can provide.

Therefore, various schemes for increasing the usability of the user by facilitating the control of the air conditioner and minimizing the operation of the user have been researched.

In recent years, studies on controlling the air conditioner using speech recognition technology are increasing.

There is a need for a method that enables the user to set the air conditioner in the optimum operation mode even if the user inputs speech according to usual language habits without special operation and prior knowledge.

Also, by providing the recommended voice guidance according to the user situation, it is required that a non-skilled user can freely and conveniently use the function of the air conditioner.

An object of the present invention is to provide an air conditioner and a method of operating the same which can increase the usability of a user by actively providing voice guidance so that unskilled users can conveniently use it.

SUMMARY OF THE INVENTION An object of the present invention is to provide an air conditioner and an operation method thereof, which can perform environment-customized control using collected environmental information.

An object of the present invention is to provide an air conditioner capable of efficiently recognizing and processing natural language and an operation method thereof.

It is an object of the present invention to provide a speech recognition method and system capable of recognizing a voice command of a user and controlling the air conditioner.

According to one aspect of the present invention, there is provided a method of operating an air conditioner, the method comprising the steps of: collecting indoor environmental information and outdoor environmental information; By outputting the guidance message, unskilled users can conveniently utilize the optimum operation mode and function, thereby increasing the usability of the user.

According to at least one of the embodiments of the present invention, since the air conditioner operates according to the voice input, the user does not have to operate the remote controller, and the user convenience can be increased.

Further, according to at least one of the embodiments of the present invention, the voice recognition server system recognizes the voice input received through the air conditioner, thereby efficiently recognizing and processing natural language.

Further, according to at least one embodiment of the present invention, the optimum operation mode is guided based on the acquired environment information, so that unskilled users can conveniently utilize the optimum operation mode and function, Can be increased.

In addition, according to at least one embodiment of the present invention, environment-customized control is possible using the collected environment information.

In addition, according to at least one of the embodiments of the present invention, by setting the operation mode by voice input, the user's operation can be minimized in the operation mode selection process, and the user convenience can be increased.

Meanwhile, various other effects will be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a view illustrating a smart home system including a voice recognition server system and a home appliance according to an embodiment of the present invention.
2 is a front view of an embodiment of an air conditioner according to an embodiment of the present invention.
3 is a block diagram illustrating an internal configuration of an air conditioner according to an embodiment of the present invention.
FIG. 4 is a view showing another example of an internal block diagram of an air conditioner according to an embodiment of the present invention.
5 is an example of a speech recognition server system according to an embodiment of the present invention.
6 is an example of a speech recognition server system according to an embodiment of the present invention.
7 is a flowchart illustrating an operation method of an air conditioner according to an embodiment of the present invention.
8 is a flowchart illustrating an operation method of an air conditioner according to an embodiment of the present invention.
9 to 12 are views referred to the description of an operation method of the air conditioner according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, it is needless to say that the present invention is not limited to these embodiments and can be modified into various forms.

In the drawings, the same reference numerals are used for the same or similar parts throughout the specification.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a view illustrating a smart home system including a voice recognition server system and a home appliance according to an embodiment of the present invention.

Referring to FIG. 1, a smart home system 10 according to an embodiment of the present invention includes a home appliance 200 having a communication module (not shown) and capable of communicating with other devices or connecting to a network, And a voice recognition server system 1100 including a plurality of servers for voice recognition and home appliance control.

The home appliance 200 may include an air conditioner having a communication module, a robot cleaner, a refrigerator, a washing machine, a cooking device, and the like.

In addition, the smart home system 10 according to an embodiment of the present invention may include a mobile terminal (not shown) such as a smart phone, a tablet PC, and the like.

The home appliance 200 may include a communication module to communicate with electronic devices inside / outside the smart home system 10.

The smart home system 10 according to an embodiment of the present invention may further include an access point (AP) apparatus 300. The home appliance 200 may be connected to an access point 300 via a wireless Internet It can connect to the network and communicate with other devices.

The access point 300 can allocate a wireless channel according to a predetermined communication method to the electronic devices in the smart home system 10 and perform wireless data communication through the corresponding channel.

Here, the predetermined communication method may be a Wi-Fi communication method. Correspondingly, the communication module included in the home appliance 200 may be a Wi-Fi communication module, but the present invention is not limited to the communication method.

Alternatively, the home appliance 200 may have another type of communication module or a plurality of communication modules. For example, the home appliance 200 may include an NFC module, a zigbee communication module, a Bluetooth communication module, and the like.

The home appliance 200 can be connected to a server included in the voice recognition server system 1100 or a predetermined external server or a user's portable terminal through a wi-fi communication module or the like, Function can be supported.

The user can check information on the home appliance 200 in the smart home system 10 or control the home appliance 200 through the portable terminal.

On the other hand, it may be inconvenient for a user to use the portable terminal even if the user wants to control the home appliance 200 or confirm certain information in the home.

For example, it is more efficient to have a means to control the home appliance 200 in other ways when the user does not know the current location of the mobile terminal or is in another location.

The home appliance 200 according to an exemplary embodiment of the present invention can receive a user's voice input and the voice recognition server system 1100 can recognize and analyze the voice input of the user to control the home appliance 200 have.

Accordingly, the user can control the home appliance 200 without operating the portable terminal or the remote control device.

At least some of the servers included in the voice recognition server system 1100 may be a server operated by a manufacturer of a home appliance or a sales company, or a server operated by a manufacturer or a company entrusted with a service by a sales company .

2 is a front view of an embodiment of an air conditioner according to an embodiment of the present invention.

2, the air conditioner 1 includes a pair of discharge units 2 and 3, a display assembly 10A positioned between the pair of discharge units 2 and 3, the display assembly 10A, And a center panel assembly 10B having one or more microphone holes 75 formed thereon.

Further, the air conditioner 1 may further include a discharge unit holder (not shown) for supporting the pair of discharge units 2, 3 in a spaced apart relationship. The ejection unit holder may include a top cover 140 positioned above the pair of ejection units 2, 3.

The pair of discharge units 2 and 3 can be arranged horizontally spaced apart by the discharge unit holder and the display assembly 10A is arranged between the pair of discharge units 2 and 3 in the vertical direction . The display assembly 10A can obscure the gap between the pair of discharge units 2 and 3 in front of the air conditioner 1. [

The pair of discharge units 2 and 3, the discharge unit holder, and the display assembly 10A can constitute a discharge assembly D for discharging the air ventilated by the air conditioner to the outside.

The discharge assembly D can be installed in an air purifier having a blower (not shown) and a purifier unit (not shown), and the air purified by the purifier unit is sent to the outside through a pair of the discharge units 2, Can be dispersedly ejected. In this case, the air conditioner 1 may be an air purifier for purifying indoor air. Here, the purifying unit includes a filter for filtering foreign substances in the air, an electrostatic precipitator for collecting and collecting foreign substances such as dust by using electricity, a humidifying filter for adsorbing foreign matter and absorbing moisture while passing through the air, And the like.

The discharge assembly D can be installed in a radiator, a radiator or a dehumidifier having a blower (not shown) and a heat exchanger (not shown), and the air exchanged with the heat exchanger is discharged through a pair of discharge units As shown in Fig. In this case, the air conditioner 1 may be a radiator, a radiator, or a dehumidifier that changes the temperature or the humidity of the room.

The air conditioner 1 includes a main body unit, a discharge assembly D, and a connection duct connecting the main body unit and the discharge assembly D, and at least one of a heat exchanger and a purifier unit and a blower are installed in the main body unit It is possible. In this case, the discharge assembly D can be installed so as to be spaced apart from the main unit, and air supplied to the connecting duct from the main body unit flows into the pair of discharge units 2, 3 in the connecting duct, (2, 3).

The pair of discharge units (2, 3) guide the air blown out from the blower to the outside, and can blow out air blown out from the blower to the outside in a state in which they are arranged parallel to each other by the blowout unit holder.

The pair of discharge units (2, 3) can be formed in the same structure, and their positions can be different. Each of the pair of the discharge units (2, 3) may be formed with a suction port through which air flows. Each of the pair of discharge units (2, 3) can be formed with an air discharge port through which air is discharged. In each of the pair of discharge units (2, 3), an internal flow path for guiding the air introduced into the suction port to the air discharge port may be formed.

Each of the pair of discharge units (2, 3) may have an air discharge opening formed in a part of the periphery of the upper, lower, and circumferential portions. Each of the pair of discharge units (2, 3) may have a suction port through which air flows into any one of the upper, lower, and circumferential portions.

When the suction port is formed below each of the pair of discharge units 2 and 3, the air blown from the blower can be introduced into the internal flow path through the lower part of each of the pair of discharge units 2 and 3, Can be discharged to the outside through the air discharge port formed in a part of the periphery of each of the pair of discharge units (2, 3).

When the suction port is formed on each of the pair of discharge units 2 and 3, the air blown from the blower can be introduced into the inner flow path through the upper part of each of the pair of discharge units 2 and 3, Can be discharged to the outside through the air discharge port formed in a part of the periphery of each of the pair of discharge units (2, 3).

When the suction port is formed in the periphery of each of the pair of discharge units (2, 3), the suction port can be formed at a portion spaced apart from the air discharge port in the peripheral portion. In this case, the pair of discharge units (2, 3) may have a shape in which the upper surface and the lower surface are clogged. The air blown from the blower 5 can be introduced into the internal flow path through the suction port formed in the periphery of each of the pair of the discharge units 2 and 3, The air can be discharged to the outside through the air discharge port formed in the discharge port.

Any one of the pair of the discharge units 2 and 3 may be the left discharge unit positioned on the left side with respect to the center line F of the air conditioner and the other one of the pair of discharge units 2, And may be a right discharge unit positioned on the right side with respect to the center line F of the air conditioner.

The left discharging unit can discharge air from the left direction of the air conditioner to the front direction of the air conditioner and the right discharging unit can discharge air from the right direction of the air conditioner to the front direction of the air conditioner.

The left discharge unit and the right discharge unit can discharge air in mutually opposite directions. The left discharging unit can discharge air in the left direction of the air conditioner and the right discharging unit can discharge the air in the right direction of the air conditioner.

The left discharging unit can discharge air in the first oblique direction in front of the left front of the air conditioner and the right discharging unit can discharge the air in the second oblique direction in front of the right front of the air conditioner.

Further, the left discharging unit can discharge air in the front direction of the air conditioner, and the right discharging unit can discharge air in the front direction of the air conditioner. In this case, the left discharging unit and the right discharging unit can discharge air in a parallel direction, and two forward airflows can be formed in front of the air conditioner.

The air conditioner (1) may further include a casing (4) forming an outer appearance. The air conditioner 1 may further include a blower (not shown) for blowing air to the pair of discharge units 2 and 3.

The air conditioner 1 can be constituted by a stand-type air conditioner installed on the floor of a room, and can be constituted by a wall-mounted type air conditioner which is mounted on a wall. Hereinafter, the stand type air conditioner will be described as an example.

The casing 4 may include a base assembly 11. The base assembly 11 may have a three-dimensional shape with the front and top open.

The casing (4) may further include a front cover (15). The front cover 15 may be installed to cover the front of the blower. The lower end of the front cover 15 can be raised to the lower frame (not shown) of the base assembly 11. [ The front cover 15 can be installed on the lower frame to shield a part of the lower frame.

Various components such as a blower, a heat exchanger, a circuit component, and the like can be disposed inside the casing 4.

On the other hand, any one of the pair of the discharge units 2 and 3 has a first suction port (not shown) through which the air blown by the blower flows, and a second suction port (Not shown), and a first air discharge port 43 through which air guided in the first internal flow path is discharged to the outside, and includes a first suction port, a first internal flow path, a first air discharge port 43, Can constitute the first discharge passage of any one (2) of the pair of discharge units (2, 3).

One of the pair of the discharge units (2, 3) may be provided with a first wind direction adjusting vane for controlling the direction of the air passing through the first discharge path. The first wind direction adjustment vane may be rotatably disposed inside any one of the pair of the discharge units (2, 3).

The other one of the pair of the discharge units (2, 3) is provided with a second suction port (not shown) through which the air blown by the blower flows, and a second internal flow path And a second air discharge port 53 through which the air guided in the second internal flow path is discharged to the outside. The second suction port, the second internal flow path, And the second discharge passage of the other one (3) of the pair of discharge units (2, 3).

The other one (3) of the pair of discharge units (2, 3) may be provided with a second wind direction adjusting vane (not shown) for adjusting the direction of the air passing through the second discharge path. The second wind direction adjusting vane may be rotatably disposed inside the other one (3) of the pair of the discharge units (2, 3).

The air conditioner 1 according to an embodiment of the present invention may include a center panel assembly 10B disposed under the display assembly 10A.

The center panel assembly 10B is positioned between the left and right front covers 15 and has the same width as the display assembly 10A to form a sense of beauty that is consistent with the display assembly 10A.

One or more microphone holes 75 may be formed in the center panel assembly 10B.

Meanwhile, the air conditioner 1 according to an embodiment of the present invention may include one or more microphones (not shown) for receiving voice input through the microphone hole 75.

The microphone may be attached to the inner surface of the center panel assembly 10B and be in contact with or adjacent to the microphone hole 75. [

The air conditioner 1 according to an embodiment of the present invention may further include a speaker (not shown) for outputting an audio signal, and the speaker may output various sound effects, a voice guidance message, and the like.

In some embodiments, the microphone and the speaker may be integrated modules.

3 is a block diagram illustrating an internal configuration of an air conditioner according to an embodiment of the present invention.

3, the air conditioner 1 according to an embodiment of the present invention includes a sensor unit 215 including one or more sensors for sensing various data, an audio input unit 220 A memory 250 for storing various data, a communication unit 270 for wirelessly communicating with other electronic devices, a display 292 for displaying predetermined information as an image, an audio output unit 291 for outputting predetermined information as audio, And a driving unit 280 for controlling the operation of the indoor fan, the heat exchanger, the valve, the wind direction adjusting means, etc., provided in the main body under the control of the controller 240 .

The audio input unit 220 can receive external audio signals and user voice commands. To this end, the audio input unit 220 may include one or more microphones (MICs). In addition, the audio input unit 220 may include a plurality of microphones 221 and 222 in order to more accurately receive a user's voice command. The plurality of microphones 221 and 222 can be disposed at different positions and can acquire an external audio signal and process it as an electrical signal.

3 and 4, the audio input unit 220 includes two microphones including a first microphone 221 and a second microphone 222, but the present invention is not limited thereto.

The audio input unit 220 may include a processor for converting analog sound into digital data, or may be connected to a processing unit to convert user input voice commands into data to be recognized by the controller 240 or a predetermined server.

Meanwhile, the audio input unit 220 may use various noise reduction algorithms for eliminating noise generated in the process of receiving a voice command of a user.

The audio input unit 220 may include a filter for removing noise from an audio signal received from each of the microphones 221 and 222 and an amplifier for amplifying and outputting a signal output from the filter, .

The memory 250 records various kinds of information necessary for the operation of the air conditioner 1 and may include a volatile or nonvolatile recording medium. The storage medium stores data that can be read by a microprocessor, and includes a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD- Tape, floppy disk, optical data storage, and the like.

According to an embodiment, the sound source file of the voice command input by the user may be stored in the memory 250, and the stored sound source file may be transmitted to the voice recognition server system through the communication unit 270. In addition, the stored sound source file may be deleted after a predetermined time elapses or a predetermined operation is performed.

Meanwhile, the memory 250 may store data for voice recognition, and the control unit 240 may process the voice input signal of the user received through the audio input unit 220 and perform a voice recognition process.

Alternatively, according to the embodiment, the air conditioner 1 includes a voice recognition module (not shown), and the voice recognition module can perform simple voice recognition such as caller recognition. An embodiment including the speech recognition module will be described later in detail with reference to FIG.

In addition, a call word determination algorithm for determining whether or not a voice signal includes a call word can be stored in the memory 250. [

The control unit 240 and the voice recognition module may determine whether or not the voice signal includes the caller based on the caller determination algorithm.

Meanwhile, simple speech recognition is performed by the air conditioner 1, and high-level speech recognition such as natural language processing can be performed in a speech recognition server system.

For example, when a wake up voice signal including a preset caller is received, the air conditioner 1 can be switched to a state for receiving a voice command. In this case, the air conditioner 1 performs only the voice recognition process up to the voice input of the caller, and voice recognition for the subsequent user voice input can be performed through the voice recognition server system.

Since the system resources of the air conditioner 1 are limited, complex natural language recognition and processing can be performed through the speech recognition server system.

Alternatively, the determination of whether or not the caller voice is input may be performed in the air conditioner 1 and the voice recognition server system. This makes it possible to reduce the erroneous recognition of the determination of the voice input of the caller and increase the recognition rate.

Limited data may be stored in the memory 250. [ For example, in the memory 250, data for recognizing a wake up voice signal including a preset caller may be stored. In this case, the control unit 240 can recognize a wake-up voice signal including a preset caller from the voice input signal of the user received through the audio input unit 220. [

On the other hand, the caller can be set by the manufacturer. For example, "LG Whishen" can be set up as an invocation. In addition, the caller can be changed by the user.

The control unit 240 can control the voice recognition server system to transmit the voice command of the user inputted after recognizing the wake up voice signal to the voice recognition server system through the communication unit 270. [

The communication unit 270 includes one or more communication modules, and can perform wireless communication with other electronic devices according to a predetermined communication method, and can exchange various signals.

Here, the predetermined communication method may be a Wi-Fi communication method. Correspondingly, the communication module included in the air conditioner 1 may be a Wi-Fi communication module, but the present invention is not limited to the communication method.

Alternatively, the air conditioner 1 may have another type of communication module or a plurality of communication modules. For example, the air conditioner 1 may include an NFC module, a zigbee communication module, a Bluetooth communication module, and the like.

The air conditioner 1 can be connected to a server included in the voice recognition server system or a predetermined external server or a portable terminal of a user through a wi-fi communication module or the like and functions as a smart function such as remote monitoring and remote control .

The user can confirm the information on the air conditioner 1 or control the air conditioner 1 through the portable terminal.

In addition, the communication unit 270 may communicate with an access point (AP) apparatus, and may access the wireless Internet network through the access point apparatus to communicate with other apparatuses.

In addition, the control unit 240 can transmit the status information of the air conditioner 1, voice commands of the user, and the like to the voice recognition server system or the like through the communication unit 270.

Also, the control unit 240 can receive external environmental information such as weather information from the speech recognition server system and other servers through the communication unit 270.

On the other hand, when a control signal is received through the communication unit 270, the control unit 240 can control the air conditioner 1 to operate in accordance with the received control signal.

The display 292 can display information corresponding to a command input by a user, a processing result corresponding to a command input by the user, an operation mode, an operation state, an error state, and the like.

According to an embodiment, the display 292 may be configured as a touch screen by forming a mutual layer structure with the touch pad. In this case, the display 292 may be used as an input device capable of inputting information by a user's touch in addition to the output device.

The audio output unit 291 outputs a notification message such as a warning sound, an operation mode, an operation state, an error state, etc., information corresponding to a command input by the user, a process corresponding to a command input by the user And output the result as audio.

On the other hand, the audio output unit 291 can convert the electrical signal from the control unit 240 into an audio signal and output it. For this purpose, a speaker or the like may be provided.

The control unit 240 controls the audio output unit 291 and the display 292 to provide predetermined information to the user by visual / audible means in correspondence with each step of the speech recognition process and the control process of the air conditioner 1 .

The driving unit 280 controls the rotation of the motor connected to the indoor fan, thereby controlling the amount of air discharged into the room. In addition, the driving unit 280 controls the driving of the heat exchanger to heat-exchange ambient air by evaporating or condensing the refrigerant supplied from the heat exchanger.

The driving unit 280 adjusts the direction of the air discharged into the room in response to a control command of the control unit 240 so that the air discharged when the discharging port is opened is changed up and down and left and right.

The driving unit 280 may include a vane driving unit for driving the vane under the control of the controller 240, and a fan driving unit for driving the fan.

On the other hand, the driving unit 280 may include a motor driving unit, and may include an inverter or the like to drive the motor.

Meanwhile, the air conditioner 1 may further include an operation unit 230 for user input, and a camera 210 capable of photographing a predetermined range around the air conditioner 1.

The operation unit 230 may include a plurality of operation buttons, and may transmit a signal corresponding to the input button to the control unit 240.

The camera 210 photographs the surroundings of the air conditioner 1, the external environment, and the like, and a plurality of such cameras may be installed for each part for photographing efficiency.

For example, the camera 210 may include at least one optical lens and an image sensor (e.g., an optical sensor) configured to include a plurality of photodiodes (e.g., pixels) that are imaged by light passing through the optical lens. A CMOS image sensor, and a digital signal processor (DSP) that forms an image based on signals output from the photodiodes. The digital signal processor is capable of generating moving images composed of still frames as well as still images.

Meanwhile, the image captured by the camera 210 may be stored in the memory 250.

The air conditioner 1 according to an embodiment of the present invention may include a sensor unit 215 having one or more sensors.

For example, the sensor unit 215 may include at least one temperature sensor for sensing the indoor / outdoor temperature, a humidity sensor for sensing the humidity, and a dust sensor for sensing the air quality.

Also, the control unit 240 can control the operation of the air conditioner 1 based on the data sensed by the sensor unit 215. [

FIG. 4 is a view showing another example of an internal block diagram of an air conditioner according to an embodiment of the present invention.

4, the air conditioner 1 includes a camera 210, a sensor unit 215 for sensing various data, an audio input unit 220 for receiving a user's voice command, an operation unit 230, various data A communication unit 270 that wirelessly communicates with other electronic devices, a driver 280 that performs an operation implemented in the air conditioner 1, a display unit 292 that displays predetermined information as an image, An audio output unit 291 for outputting predetermined information as audio, a control unit 240 for controlling overall operation, and a processor 260. [

The internal block diagram of the air conditioner 1 of FIG. 4 is similar to that of FIG. 3 except that a processor 260 is further provided and includes an audio input unit 220, an audio output unit 291, a communication unit 270, 210 and the processor 260 are provided in the speech recognition module 205, which is one single module.

The audio recognition module 205 may include a communication unit 270 and a processor 260. The audio input unit 220 and the audio output unit 291 may be a separate integrated module Lt; / RTI >

For example, the speech recognition module 205 may be an integrated module including the audio input unit 220 and the audio output unit 291. In this case, the audio input unit 220 may include microphones 221 and 222, and the audio output unit 291 may include a speaker (not shown).

The processor 260 may control the audio input unit 220, the audio output unit 291, the communication unit 270, the camera 210, and the like.

Hereinafter, the difference from FIG. 3 will be mainly described.

The processor 260 processes the voice input signal of the user received through the audio input unit 220 and performs a voice recognition process.

For example, when a wake up voice signal is received that includes a preset caller, the processor 260 may transition to a state for receiving voice commands. In this case, the processor 260 performs only a voice recognition process up to the voice input of the caller, and voice recognition for the subsequent user voice input can be performed through the voice recognition server system.

The processor 260 may control the voice recognition server system to transmit the voice command of the user inputted after the recognition of the wake up voice signal to the voice recognition server system through the communication unit 270. [

In addition, the processor 260 can transmit the status information of the air conditioner 1, a voice command of the user, and the like to the voice recognition server system or the like through the communication unit 270.

When the control signal is received through the communication unit 270, the processor 260 transmits a control signal to the controller 240. The controller 240 controls the air conditioner 1 to operate according to the received control signal. Can be controlled.

Eventually, through the voice recognition module 205, it becomes possible to perform voice data acquisition, communication with the server system 100, and corresponding sound output.

On the other hand, the voice recognition module 205 can be attached to various electronic devices in addition to the air conditioner 1. Or may be used as a separate device without being attached to another electronic device.

The air conditioner 1 according to the embodiment of the present invention can receive the voice input of the user and the voice recognition server system can control the air conditioner 1 by recognizing and analyzing the voice input of the user .

Accordingly, the user can control the air conditioner 1 without operating the portable terminal or the remote control device.

At least some of the servers included in the voice recognition server system may be a server operated by a manufacturer of a home appliance or a sales company, or a server operated by a manufacturer or a company entrusted with a service by a sales company.

5 is an example of a speech recognition server system according to an embodiment of the present invention.

5, a speech recognition server system according to an embodiment of the present invention includes a voice server 1100 that receives voice data from the air conditioner 1, analyzes voice data received to determine a voice command, . ≪ / RTI >

The voice server 1100 receives voice data from the air conditioner 1, converts the received voice data into text data, and analyzes the text data to determine a voice command.

Further, the voice server 1100 can transmit a signal corresponding to the voice command determined to the predetermined server.

For example, the speech recognition server system according to an embodiment of the present invention receives a signal corresponding to the determined voice command from the voice server 1100, and generates a request signal corresponding to the determined voice command And a home appliance control server 1130 that transmits a control signal based on a request signal received from the linkage service server 1120 and the linkage service server 1120 to the air conditioner 1.

The air conditioner 1 can receive voice command input by the user and transmit voice data based on the received voice command input to the voice server 1100.

The voice server 1100 includes an Automatic Speech Recognition (ASR) server 1111 for receiving voice data from the air conditioner 1 and converting the received voice data into text data, A speech recognition unit 1111 that receives the text data, analyzes the received text data to determine a voice command, and transmits a response signal based on the determined voice command to the air conditioner 1 (NLP) server 1112, and a signal including the text corresponding to the response signal from the air conditioner 1, converts the text included in the received signal into speech data And a text to speech (TTS) server 1113 for transmitting to the air conditioner 1.

The automatic speech recognition server 1111 may perform speech recognition on the speech data received from the air conditioner 1 to generate text data and transmit the text data to the natural language processing server 1112.

The natural language processing server 1112 can analyze the text data received from the automatic speech recognition server 1111 according to a natural language processing algorithm to discriminate a voice command.

The natural language processing server 1112 can process a natural language that is a language that a person routinely uses according to a natural language processing algorithm, and can analyze an intent of the user. The natural language processing server 1112 can perform natural language processing on the text data received from the automatic speech recognition server 1111 to determine a voice command that matches the user's intention.

Accordingly, the natural language processing server 1112 can determine a voice command that matches the user's intention even if the user inputs a voice command in a normal use language.

The natural language processing server 1112 can transmit a signal corresponding to the natural language processing result, that is, a signal corresponding to the discriminated voice command to the linked service server 1120. [

The connection service server 1120 can receive a signal corresponding to the voice command determined by the natural language processing server 1112. [

If the determined voice command is related to the air conditioner 1, the connection service server 1120 can communicate with the home appliance control server 1130 to perform a corresponding operation.

Alternatively, if the determined voice command is not related to the air conditioner 1, the connection service server 1120 can communicate with the external service 1121 to perform a corresponding operation.

For example, if the determined voice command is a command for requesting information such as weather, stock, news, etc., the connection service server 1120 requests and receives the information from the server providing the service corresponding to the requested information .

The connection service server 1120 may transmit the received information to the voice server 1100 and the natural language processing server 1112 may transmit the received information to the air conditioner 1. [

If the determined voice command is related to the air conditioner 1, the connection service server 1120 can generate a request signal corresponding to the determined voice command and transmit it to the home appliance control server 1130.

The home appliance control server 1130 can transmit a control signal based on the request signal received from the linkage service server 1120 to the air conditioner 1. [

For example, when a request to change the set temperature of the air conditioner 1 is received, the appliance control server 1130 can send a control signal to the air conditioner 1 to change the set temperature.

On the other hand, the air conditioner 1 can perform a corresponding operation according to the control signal received from the appliance control server 1130.

In addition, the air conditioner 1 may transmit a signal to the home appliance control server 1130 indicating that the air conditioner 1 has performed the requested operation.

The home appliance control server 1130 receives a response signal to the control signal from the air conditioner 1 and transmits processing result information corresponding to the response signal to the linkage service server 1120 .

The voice server 1100 can transmit a response signal including the processing result information to the air conditioner 1. [

The voice server 1100 receives a signal including the output text text corresponding to the processing result information from the air conditioner 1 and converts the received output text text into voice data, Can be transmitted to the harmonizer (1).

In this case, the response signal based on the voice command that the natural language processing server 1112 transmits to the air conditioner 1 may include the processing result information.

On the other hand, the air conditioner 1 can receive a response signal based on the determined voice command from the natural language processing server 1112. [ Here, the response signal may include text data of a response corresponding to the identified voice command.

For example, when the user inputs a voice command to change the set temperature of the air conditioner, the response signal may include text data indicating that the set temperature has been changed.

On the other hand, the air conditioner 1 can transmit to the text-to-speech conversion server 1113 a signal including a text corresponding to the received response signal. Here, the signal including the text corresponding to the response signal may include an output text corresponding to the processing result information.

On the other hand, the text-to-speech conversion server 1113 converts the text included in the received signal into voice data and transmits the voice data to the air conditioner 1. The converted voice data may include a sound source file.

The air conditioner 1 can output a voice guidance message based on voice data received through a speaker.

On the other hand, the connection service server 1120 requests the home appliance control server 1130 of the state information of the air conditioner 1 based on the signal corresponding to the identified voice command, 1130 may transmit the status information of the air conditioner 1 to the linked service server 1120. The home appliance control server 1130 can request and receive status information from the air conditioner 1 when the state information of the air conditioner 1 is not secured.

On the other hand, when it is possible to support the determined voice command based on the state information of the air conditioner 1, the connection service server 1120 transmits the voice command to the home appliance control server 1130 It is possible to transmit a corresponding request signal.

Alternatively, in a case where it is impossible to support the determined voice command based on the state information of the air conditioner 1, the connection service server 1120 transmits to the natural language processing server 1112, It is possible to transmit a signal indicating the function.

Even in this case, the air conditioner 1 can request and receive the voice data to the text-to-speech conversion server 1113, and output a voice guidance message indicating that the function is not supported in the current state.

According to the embodiment, the voice server 1100 can determine the supportability of the voice command discriminated. For example, the natural language processing server 1112 that has analyzed the intention of the user's voice command can determine whether or not the determined voice command can be supported.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the determined voice command transmitted by the natural language processing server 1112 is a voice command, May be a signal indicating that the function (1) is not supported.

The voice server 1100 and the voice recognition server system including the voice server 1100 according to an embodiment of the present invention can organically connect servers having various roles for natural voice processing.

The air conditioner 1 performs operations from reception of voice commands to preprocessing and server transmission, and the voice server 1100 can perform a natural language process such as voice / text conversion, intention analysis, and command identification.

By performing the natural language processing by the voice server 1100, burden on the CPU, memory, etc. of the embedded module in the home appliance can be reduced.

Meanwhile, the connection service server 1120 can communicate with the external service and home appliance control server 1130 to perform operations based on the voice command of the user.

On the other hand, the air conditioner 1 can receive voice data including a sound source file from the voice server 1100 and output a voice guidance message to the voice, so that the voice response of the user can be responded to with auditory feedback.

The air conditioner 1 receives the voice file from the voice server 1100 through streaming, and can reproduce and output the voice guidance message to the user. Accordingly, the air conditioner 1 need not store various sound source files.

Meanwhile, it is possible to link with various external services without colliding with other servers through the linked service server 1120. In addition, through the external service interworking server, it is possible to increase the success rate of the intention analysis by reflecting external information in the intention analysis.

The voice recognition server system according to an embodiment of the present invention assures compatibility and connectivity through a plurality of servers and utilizes the home appliance control server 1130 as a final control command to perform a voice recognition process and a home appliance control server 1130 ), Collision between home appliances control using Wi-Fi communication and home appliances control through a portable terminal and home appliances control by voice input through the air conditioner 1 can be prevented.

 The speech recognition server system according to an embodiment of the present invention can reduce the burden on a specific server depending on a certain server through an organic connection between the servers and the role of each server differs, It is possible to easily respond by linking with other servers having the same role.

In addition, a plurality of servers can be independently updated from time to time, which is advantageous for performance improvement.

6 is an example of a speech recognition server system according to an embodiment of the present invention.

The voice recognition server system illustrated in FIG. 6 improves the voice control response time by improving the process of transmitting voice data for voice announcement message output to the air conditioner 1 by the voice recognition server system illustrated in FIG. 5 will be.

Therefore, the speech recognition server system illustrated in FIG. 5 and FIG. 6 can perform substantially the same operations except for the above-described difference, and the same portions will be briefly described below.

6, a speech recognition server system according to an embodiment of the present invention includes a voice server 1100 that receives voice data from the air conditioner 1, analyzes voice data received to determine a voice command, . ≪ / RTI >

Further, the voice recognition server system according to an embodiment of the present invention may include a voice recognition server 1100 that receives a signal corresponding to the voice command determined by the voice server 1100, and generates a request signal corresponding to the determined voice command And a home appliance control server 1130 that transmits a control signal based on a request signal received from the service server 1120 and the connection service server 1120 to the air conditioner 1. [

The voice recognition server system illustrated in Fig. 6 is a system in which the voice server 1100 transmits voice data including processing result information based on the voice command to the air conditioner 1, without requesting the air conditioner 1, As shown in FIG.

The voice server 1100 includes an automatic voice recognition server 1111 that receives voice data from the air conditioner 1 and converts the received voice data into text data, A natural language processing server 1112 for receiving the text data from the speech data and analyzing the received text data to determine a voice command; And a text-to-speech conversion server 1113 for transmitting the text-

Also in this embodiment, the household appliance control server 1130 receives a response signal to the control signal from the air conditioner 1, and transmits processing result information corresponding to the response signal to the connection service server 1120, As shown in FIG.

The linkage service server 1120 can transmit the processing result information to the voice server 1100, and more particularly, to the natural language processing server 1112.

In this case, the voice data transmitted from the text-to-speech conversion server 1113 to the air conditioner 1 may include the processing result information.

The connection service server 1120 also requests the home appliance control server for state information of the air conditioner 1 on the basis of the signal corresponding to the determined voice command, And can transmit the status information of the tuner 1 to the linked service server 1120.

In the case where it is possible to support the determined voice command based on the state information of the air conditioner 1, the connection service server 1120 transmits the voice command to the home appliance control server 1130 It is possible to transmit a corresponding request signal.

Alternatively, when it is impossible to support the determined voice command on the basis of the state information of the air conditioner 1, the connection service server 1120 transmits to the voice server 1100 a function A signal indicating that the signal is transmitted can be transmitted.

For example, the connection service server 1120 can transmit a signal to the natural language processing server 1112 to inform the natural language processing server 1112 of the unsupported function in the current state.

In addition, the natural language processing server 1112 transmits a signal indicating that it is an unsupported function in the current state to the text-to-speech conversion server 1113, and the text-to-speech conversion server 1113 generates corresponding voice data, Can be transmitted to the harmonizer (1).

The air conditioner 1 can receive the voice data from the text-to-speech conversion server 1113 and output a voice guidance message informing that it is an unsupported function in the current state.

According to the embodiment, the voice server 1100 can determine the supportability of the voice command discriminated. For example, the natural language processing server 1112 that has analyzed the intention of the user's voice command can determine whether or not the determined voice command can be supported.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the determined voice command transmitted by the natural language processing server 1112 is a voice command, May be a signal indicating that the function (1) is not supported.

A time difference may occur between the operation and the announcement when the announcement about the operation is requested to the text-to-speech server 1113 for voice guidance at the earliest after the air conditioner 1 operates.

However, according to the embodiment of the present invention, when the intention analysis is completed and the operation request is transmitted from the natural language processing server 1112, the text voice conversion server 1113 can provide the information to the text voice conversion server 1113 at the same time.

Further, the text-to-speech conversion server 1113 can provide the announcement to the air conditioner 1 on the basis of the time when the home appliance control server 1130 issues a control command to the air conditioner 1. [

Accordingly, the announcement can be made at the same time or immediately after the operation of the air conditioner (1).

According to the present embodiment, by directly connecting the natural language processing server 1112 and the text-to-speech conversion server 1113, the time difference between the control command and the announcement via the home appliance control server 1130 can be minimized.

16 and 17, the automatic speech recognition server 1111, the natural language processing server 1112, and the text-to-speech conversion server 1113 for speech recognition and processing are integrated Server.

In addition, according to an embodiment, the linkage service server 1120 and the home appliance control server 1130 may be configured as one integrated server.

According to the present invention, since the air conditioner 1 operates according to the voice input, it is not necessary for the user to operate the remote control device such as the remote controller, the portable terminal, and the like, and the user convenience can be increased.

5 and 6, the present invention recognizes a user's natural language voice command using a plurality of servers and performs a corresponding control operation so that the home appliance, such as the air conditioner 1, , Natural language can be efficiently recognized and processed without being limited to the system resources of each server.

7 is a flowchart illustrating an operation method of an air conditioner according to an embodiment of the present invention.

Referring to FIG. 7, the air conditioner 1 according to an embodiment of the present invention can collect indoor environment information through a sensor unit 215 including a plurality of sensors (S710).

For example, the sensor unit 215 may include at least one temperature sensor for sensing the indoor / outdoor temperature, a humidity sensor for sensing the humidity, and a dust sensor for sensing the air quality.

The sensor unit 215 can sense the temperature and humidity data of the indoor environment in which the air conditioner 1 is installed.

Further, the sensor unit 215 can sense the air quality such as the amount of carbon dioxide and the amount of fine dust in the indoor environment in which the air conditioner 1 is installed.

The sensor unit 215 can continuously collect data on temperature, humidity, and air quality. Alternatively, the sensor unit 215 may collect data on temperature, humidity, and air quality at predetermined time intervals.

The air conditioner 1 can receive the external environment information from the external server through the communication unit 270 (S720).

The air conditioner 1 can receive external environmental information such as weather information from a predetermined server or other server in the speech recognition server system.

In order to provide a comfortable indoor environment, the air conditioner (1) is capable of improving and managing the air quality by the temperature control, the humidification and the dehumidifying function by the air conditioning function, the humidity control and the air cleaning function.

In many cases, indoor temperature, humidity, and air quality are related to the external environment. For example, when the outdoor temperature and the humidity are high, the room temperature and humidity often increase. If the outside air quality is poor, ventilation is difficult, and indoor air quality not ventilated is likely to deteriorate.

Therefore, it may be effective to control the operation of the air conditioner in connection with an external environment such as the weather.

Many people are getting information about the environment such as weather information by checking the news directly. However, according to the present invention, the air conditioner (1) for managing temperature, humidity, and air quality can automatically receive external environment information such as weather from a speech recognition server system or a connected server or an electronic device.

On the other hand, the air conditioner 1 can receive the external environment information at a preset event occurrence or at a predetermined time period.

For example, when the user is powered on in the predetermined space, the air conditioner 1 requests external information such as weather information to a predetermined server when the user commands a specific operation , And receive the external environment information to be responded.

Alternatively, the air conditioner 1 can receive external environment information at a predetermined time period.

The external environment information may include weather information of an area in which the air conditioner 1 operates.

For example, the external environment information may include the current state of the region where the air conditioner 1 operates, the current humidity, the current air quality, the forecast information related to the snow, rain, wind, and the like. In addition, the external environment information may include weather information of the time zone of the area in which the air conditioner 1 operates, weather information of the day, and weather information of the week.

On the other hand, the control unit 240 can determine a recommended driving mode based on the indoor environment information and the external environment information (S740) and control to output a voice guidance message to guide the determined recommended driving mode (S750).

For example, the control unit 240 can determine that the dehumidification operation is a recommended operation mode when the room humidity is high, and can control the audio output unit 291 to output an audio guidance message recommending dehumidification operation.

On the other hand, when there is no voice data for outputting the voice guidance message, the control unit 240 transmits a signal corresponding to the recommended operation mode based on the indoor environment information and the external environment information to the voice recognition server system, And to receive the sound source file corresponding to the voice guidance message guiding the recommended driving mode from the voice recognition server system.

In this case, the audio output unit 291 can output a voice guidance message based on the received sound source file.

On the other hand, when the air conditioner 1 is not in operation, the voice guidance message may include a message suggesting to operate the air conditioner 1 in the recommended driving mode.

For example, if the humidity is high even when the air conditioner 1 is not in operation, the control unit 240 can control the audio output unit 291 to output an audio guidance message actively recommending dehumidification operation have.

Further, when the air conditioner 1 is operating in the predetermined operation mode, the voice guidance message may include a message suggesting to further operate the function corresponding to the recommended driving mode.

For example, if the air conditioner 1 is in the cooling operation and the humidity is high, the control unit 240 controls the audio output unit 291 to output a voice guidance message actively recommending that the dehumidification function is further operated .

Even if the air conditioner 1 is used, it is recommended to use the air cleaning function at the same time if the air quality is poor due to a lot of fine dust in the room.

According to the embodiment, when the air conditioner 1 is in operation, the air cleaning function is automatically performed according to the indoor condition during the cooling in accordance with the user's prior consent, and after the operation for a predetermined time, Only the function can be disabled.

The control unit 240 can control to output a voice guidance message for guiding the recommended driving mode including the dehumidification function when the indoor humidity sensed through the sensor unit 215 is equal to or higher than the reference value.

The control unit 240 may also be configured to control to output a voice guidance message to guide a recommended driving mode including a cooling function when a room temperature sensed through the sensor unit 215 is equal to or higher than a reference value.

The control unit 240 may also control to output a voice guidance message to guide the recommended operation mode including the air cleaning function when the amount of dust detected through the sensor unit 215 is equal to or greater than a reference value.

While the audio output unit 291 is outputting the audio guidance message, the control unit 240 may emit the display 292 or other lamp to notify that the present audio guidance message is being output, Can help you focus on voice prompts.

The control unit 240 may control the display unit 292 to display information corresponding to the recommended driving mode.

In other words, the air conditioner 1 can notify the recommended driving mode as well as the recommended driving mode with the visual information through the display 292.

Meanwhile, the voice guidance message may include weather information of an area in which the air conditioner 1 operates. Accordingly, the user can receive weather information through the air conditioner 1 without any special effort to find weather information.

On the other hand, in the recommended operation mode, the recommendation function is determined based on the indoor environment information, and the set value of the recommendation function can be determined based on the indoor environment information and the external environment information.

The control unit 240 can discriminate the recommended functions such as cooling, heating, air cleaning, dehumidification, humidification, and the like by giving priority to the indoor environment information.

Also, the control unit 240 can determine the final recommended driving mode by discriminating the level (intensity) of cooling, heating, air cleaning, dehumidification, and humidification with reference to the external environment information.

For example, when the room temperature is high, the controller 240 selects the cooling function, and when the temperature difference between the room temperature and the outdoor temperature is large, the controller 240 sets the cooling setting temperature setting value to a lower value, , It is possible to determine the recommended operation mode.

Alternatively, the controller 240 may set the cooling setting temperature setting value during the cooling operation so that the temperature difference between the room temperature and the outdoor temperature is maintained at a certain level.

Accordingly, it is possible to prevent ineffective operation in terms of power consumption, cooling efficiency, and user perception satisfaction, which may be caused by operating a predetermined function such as a cooling function regardless of the indoor / outdoor temperature.

On the other hand, it is inefficient to provide voice guidance even when the user is not in the predetermined space in which the air conditioner 1 is disposed.

Accordingly, the air conditioner 1 can detect the occupant through the human body detection sensor that the camera 1 or the sensor unit 215 can include (S730)

The control unit 240 may control to output the voice guidance message only when the camera 1 or the sensor unit 215 detects the presence of the user.

It is possible to set the air conditioner 1 to be operable only after the user is detected because there is a possibility that the air conditioner 1 is operated by talking to the user first because there is a possibility that the air conditioner 1 is erroneously operated due to external noise or the like when there is no user.

On the other hand, when receiving the user response to the output of the voice guidance message, the control unit 240 can operate in response to the received response.

After the voice guidance message is output (S750), the air conditioner 1 can receive voice commands through one or more microphones 221 and 222. [

The control unit 240 may control the communication unit 270 to transmit the voice data including the received voice command to the voice recognition server system.

When the communication unit 270 receives a control signal based on the voice command from the voice recognition server system, the control unit 240 can control so as to operate in accordance with the received control signal.

For example, when the user utters an affirmative voice for the recommended driving mode, the air conditioner 1 can start the driving in the recommended driving mode in accordance with the transmission of the voice data and the reception of the corresponding signal.

On the other hand, when the communication unit 270 receives the response signal based on the voice command from the voice recognition server system, it can output the voice guidance message corresponding to the received response signal. The voice guidance message corresponding to the received response signal may be information for starting operation in accordance with the recommended driving mode.

At present, the air conditioner (1) has a basic cooling function, an air cleaning function, a dehumidifying operation function, a power saving function, and the like. However, most of the users use the air conditioner 1 only by using the cooling function and do not know what the indoor is.

Therefore, the air conditioner 1 according to the embodiment of the present invention can be recommended to the user so as to be environmentally customized control using the information of the indoor environment and the external environment.

In addition, the air conditioner 1 according to the embodiment of the present invention can provide voice guidance and control voice recognition of the user's voice response.

This makes it possible to realize efficient operation and power saving operation while optimizing the indoor environment. In addition, satisfaction of the performance of the air conditioner 1 can be further enhanced by allowing the non-skilled user to fully use the function of the air conditioner 1. [

8 is a flowchart illustrating an operation method of an air conditioner according to an embodiment of the present invention.

Referring to FIG. 8, the air conditioner 1 according to the embodiment of the present invention analyzes the indoor condition at a predetermined time interval (S810), receives weather information from the external weather server and analyzes the outdoor environment condition S820).

The air conditioner 1 can perform the analysis of the indoor condition (S810) and the analysis of the outdoor environment condition (S820) in the standby mode for always inputting the voice.

On the other hand, when the person is detected, the air conditioner 1 determines the indoor environmental condition (S830) and recommends the control for maintaining the optimal indoor condition to the sensed person (S850).

For example, the air conditioner 1 may include a temperature sensor, a humidity sensor, and an air quality sensor to detect the state of the indoor space, and information periodically checked by the sensors and information It is possible to provide an optimal control method to the customer.

When it is determined that the indoor condition is bad (S840), the air conditioner 1 detects the person (S830), and if the temperature of the indoor space is required or the humidity is adjusted or the air quality is bad The recommended driving mode set so as to be able to be guided by voice (S850).

When the person speaks in response to the voice guidance (S860), the air conditioner 1 recognizes the voice input of the user through the voice recognition server system (S870) and can be controlled corresponding to the recognized result ( S880).

If the indoor condition is good, the air conditioner 1 recognizes the voice guidance corresponding to the user's separate voice input S860 without igniting it (S870) and will be controlled (S880).

9 to 12 are views referred to the description of an operation method of the air conditioner according to an embodiment of the present invention.

The air conditioner 1 according to the embodiment of the present invention notifies the current indoor condition when there is a user in the vicinity, Air cleaning function, etc. can be recommended.

Referring to FIG. 9, even if at least one user 901 and 902 is in a state of very humid indoor air, the dehumidifying function of the air conditioner 1 may not be operated.

In this case, the air conditioner 1 according to the embodiment of the present invention can output a voice guidance message to guide the recommended operation mode when the user 901 or 902 is detected. That is, it is recommended that the air conditioner 1 actively talk to the users 901 and 902 first, and encourage them to operate the dehumidifying function or the like.

The user can easily operate a specific function by uttering a response to the voice guidance message by voice.

10 illustrates a user response process after the air conditioner 1 recommends the dehumidification function.

Referring to FIG. 10, as the user utters a predetermined call word such as "LG Whishen" (S1010), the air conditioner 1 can enter the command standby mode. Thereafter, the user can input a response to the voice guidance message in a natural language such as "Yes" (S1020).

According to an embodiment, the speech recognition process can be performed without inputting a caller after outputting the voice guidance message.

In order to receive the user's voice response, the air conditioner 1 outputs the voice guidance message to the user who is actively detected by the air conditioner 1, And then enter the command standby mode automatically for a predetermined period of time.

The air conditioner 1 receiving the user's response through the microphones 221 and 222 can transmit the voice data including the user's response to the voice recognition server system 1100 (S1030).

The speech recognition server system 1100 may analyze the received voice data to determine the intent of the user who desires a recommended dehumidification function. Accordingly, the speech recognition server system 1100 can transmit the control signal S1040 for driving the dehumidification function to the air conditioner 1 and the response signal S1045 corresponding to the operation.

The air conditioner 1 drives the dehumidification function and can output a voice guidance message such as "start dehumidification operation" (S1050).

11 and 12 illustrate a case where the air cleaning function is recommended according to the air quality sensed by the sensor unit 215 of the air conditioner 1 and the user responds thereto.

Referring to FIG. 11, when deterioration of the air quality is detected through the sensor unit 215, the control unit 240 can determine that the air cleaning function drive is the recommended operation mode.

Further, through the camera 210 or the sensor unit 215, If a user is detected, the control unit 240 may control the audio output unit 291 to output a voice guidance message that recommends that the air cleaning function be operated (S1130).

If there is no voice data for outputting the voice guidance message for recommending driving the air cleaning function, the air conditioner 1 can request the voice recognition server system 1110 for voice data for outputting the voice guidance message (S1110).

The communication unit 270 receives the voice data from the voice recognition server system 1110 (S1120), and the audio output unit 291 can output a voice guidance message to encourage the air cleaning function to operate (S1130).

Referring to FIG. 12, as the user utters a predetermined call word such as "LG Whishen" (S1210), the air conditioner 1 can enter the command standby mode. Thereafter, the user can input a response to the voice guidance message in a natural language such as "Yes" (S1220).

Also in this embodiment, the air conditioner 1 automatically enters the command standby mode for a predetermined time after the voice guidance message is output without inputting the caller, and the voice recognition process can be performed.

The air conditioner 1 receiving the user's response through the microphones 221 and 222 can transmit the voice data including the user's response to the voice recognition server system 1100 (S1230).

The voice recognition server system 1100 may analyze the received voice data to determine the intention of the user who desires the recommended air cleaning function. Accordingly, the speech recognition server system 1100 can transmit the control signal S1240 to the air conditioner 1 to drive the air cleaning function and the response signal S1245 corresponding to the operation.

The air conditioner 1 drives the air cleaning function and can output a voice guidance message such as "drive the air cleaning function" (S1250).

According to at least one of the embodiments of the present invention, since the air conditioner operates according to the voice input, the user does not have to operate the remote controller, and the user convenience can be increased.

Further, according to at least one of the embodiments of the present invention, the voice recognition server system recognizes the voice input received through the air conditioner, thereby efficiently recognizing and processing natural language.

Further, according to at least one embodiment of the present invention, the optimum operation mode is guided based on the acquired environment information, so that unskilled users can conveniently utilize the optimum operation mode and function, Can be increased.

In addition, according to at least one embodiment of the present invention, environment-customized control is possible using the collected environment information.

In addition, according to at least one of the embodiments of the present invention, by setting the operation mode by voice input, the user's operation can be minimized in the operation mode selection process, and the user convenience can be increased.

The voice server, the voice recognition server system, and the air conditioner according to the present invention are not limited to the configuration and method of the embodiments described above, but the embodiments may be modified in various ways All or some of them may be selectively combined.

Meanwhile, the speech recognition method, the voice server, the voice recognition server system, and the operation method of the air conditioner according to the embodiment of the present invention can be implemented as a code that can be read by a processor in a recording medium readable by a processor. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

Air Conditioner: 1
Voice recognition server system: 1100
Voice server: 1110
ASR server: 1111
NLP server: 1112
TTS server: 1113
Linked service server: 1120
Home appliance control server: 1130

Claims (15)

Collecting indoor environment information through a sensor unit including a plurality of sensors;
Receiving external environment information from an external server through a communication unit;
And outputting a voice guidance message to guide a recommended driving mode based on the indoor environment information and the external environment information. The method according to claim 1,
Transmitting a signal corresponding to a recommended driving mode based on the indoor environment information and the external environment information to the voice recognition server system;
And receiving a sound source file corresponding to a voice guidance message guiding the recommended driving mode from the voice recognition server system. The method according to claim 1,
Further comprising the steps of: detecting an occupant through a camera or a human body detection sensor;
Wherein the outputting of the voice guidance message comprises outputting the voice guidance message when the camera or the human body detection sensor detects the occupant. The method according to claim 1,
Wherein the collecting of the indoor environment information comprises continuously collecting data on temperature, humidity, and air quality or collecting the data on a predetermined time period. The method according to claim 1,
Wherein the receiving of the external environment information comprises receiving the external environment information when a predetermined event occurs or at a predetermined time period. The method according to claim 1,
Wherein the voice guidance message includes a message suggesting to operate the air conditioner in the recommended driving mode when the air conditioner is not in operation. The method according to claim 1,
Wherein the voice guidance message includes a message suggesting that the function corresponding to the recommended driving mode is additionally operated when the air conditioner is operating in the predetermined operation mode. The method according to claim 1,
Wherein the voice guidance message includes weather information of an area where the air conditioner operates. The method according to claim 1,
Wherein the recommended operation mode is determined based on the indoor environment information and the setting value of the recommendation function is determined based on the indoor environment information and the external environment information . The method according to claim 1,
Wherein the step of outputting the voice guidance message comprises the step of outputting a voice guidance message for guiding the recommended driving mode including the dehumidifying function when the indoor humidity sensed through the sensor unit is equal to or higher than the reference value Way. The method according to claim 1,
Wherein the step of outputting the voice guidance message outputs a voice guidance message to guide a recommended driving mode including a cooling function when a room temperature sensed through the sensor unit is equal to or higher than a reference value Way. The method according to claim 1,
Wherein the step of outputting the voice guidance message outputs a voice guidance message to guide a recommended driving mode including an air cleaning function when the amount of dust detected through the sensor unit is equal to or greater than a reference value Way. The method according to claim 1,
Receiving voice commands via one or more microphones (MICs);
Transmitting voice data including the received voice command to a voice recognition server system; And
Receiving a control signal based on the voice command from the voice recognition server system, and operating in response to the received control signal. 14. The method of claim 13,
Receiving a response signal based on the voice command from the voice recognition server system, and outputting a voice guidance message corresponding to the received response signal. The method according to claim 1,
And displaying information corresponding to the recommended driving mode through the display.

Images