KR20190023911A - Method for operating washing machine and voice recognition server system - Google Patents

Abstract

According to an aspect of the present invention, a method for operating a laundry treatment apparatus comprises the following steps: receiving a voice input through a microphone; transmitting first voice data corresponding to the voice input to a voice server; receiving voice recognition result information based on a voice recognition result of the first voice data from the voice server; and outputting a voice guidance message for guiding a recommended washing course corresponding to the voice recognition result. Therefore, the convenience in use for a user can be increased by enabling even unskilled users to conveniently select an optimal washing course.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a laundry processing apparatus and a voice recognition server system,

The present invention relates to a laundry processing apparatus and a method of operating a voice recognition server system. More particularly, the present invention relates to a laundry processing apparatus that can be controlled by a user's voice input, and a method of operating a voice recognition server system capable of recognizing a voice received from the laundry processing apparatus.

Generally, a laundry processing apparatus is a device that processes laundry through various operations such as washing, dehydrating and / or drying.

The laundry processing apparatus is a device that supplies water to immerse the laundry and dissolves an appropriate amount of the detergent in the washing water to remove the burden on the laundry.

Such a laundry processing apparatus includes a laundry processing device for washing clothes such as clothes and bedding using the emulsifying action of the detergent, the water flow action generated by the rotation of the washing tub or the laundry blades, and the mechanical force applied by the laundry blades, And a refresher that removes the wrinkles of the clothes by applying steam to the laundry. The washing machine includes a dryer and a washing machine.

In addition, the laundry processing apparatus provides a plurality of automatic washing course functions (or course washing) for the convenience of the user, and also supports additional functions such as a sterilizing function and a calling function.

The laundry course is automatically washed according to predetermined conditions. Generally, various laundry courses are set in the laundry processing apparatus.

 Therefore, the user can select one of the plurality of laundry courses according to the purpose of laundry or the type of laundry, thereby automatically performing the washing according to predetermined conditions.

That is, the washing course is convenient for a user to automatically perform a desired washing without individually selecting the number of times of washing, that is, the temperature and amount of water, washing, rinsing and dehydrating, etc. .

However, according to the recent tendency of the function of the laundry processing apparatus to function, the type of the clothes, and the tendency of the user's preferences to diversify, the user has difficulty in determining which laundry course is to be washed by the laundry processing apparatus provided in the laundry processing apparatus have. Further, even when the user selects a specific laundry course, many input steps are often required.

In order to solve such a problem, Prior Art 1 (Laid-Open Patent Publication No. 10-2005-0004616) supports a sterilizing function and displays selectable laundry courses on the display unit to assist a user's selection.

Conventional technique 2 (Laid-Open Patent Publication No. 10-2009-0086747) also displays a washing course on the display unit as a letter, rather than printing the washing course display unit on the surface of the control panel of the outside of the laundry processing apparatus.

In the related arts 1 and 2, the user can select a specific washing course according to the number of times the button is pressed or the degree of turning the dial switch while viewing the screen displayed on the display unit, but there is a disadvantage in that a plurality of operations are required .

Therefore, various methods for increasing the usability of the user by making the selection of the washing course convenient and minimizing the operation of the user have been researched.

In recent years, research on controlling home appliances using speech recognition technology is increasing.

Therefore, there is a need for a user to set an optimum washing course even if he / she inputs a voice in accordance with usual language habits without special operation and prior knowledge.

An object of the present invention is to provide a laundry processing device, a voice recognition server system, and a method of operating the same, which enable non-skilled users to conveniently select an optimum washing course and thereby increase the usability of the user.

It is an object of the present invention to provide a laundry processing device, a voice recognition server system, and an operation method thereof, which can minimize user's operation during a washing course selection process to increase user convenience.

It is an object of the present invention to provide a laundry processing apparatus, a speech recognition server system, and an operation method thereof that can efficiently recognize and process natural language.

An object of the present invention is to provide a voice recognition method and system capable of recognizing voice commands of a user and controlling the laundry processing apparatus.

According to another aspect of the present invention, there is provided a method for operating a laundry processing apparatus, comprising: receiving a voice input through a microphone; transmitting first voice data corresponding to the voice input to a voice server; Receiving voice recognition result information based on a voice recognition result of the first voice data from a voice server and outputting a voice guidance message guiding a recommended laundry course corresponding to a voice recognition result, Unsupervised users can also choose the optimal washing course conveniently, thus increasing the user's convenience.

According to another aspect of the present invention, there is provided a method of operating a voice recognition server system, comprising: receiving first voice data from a laundry processing device; Recognizing a first user command included in the first voice data by analyzing the first text data; discriminating a recommended laundry course corresponding to a recognition result of the first user command; And transmitting the voice recognition result information including the information about the recommended laundry course to the laundry processing device. Thus, unskilled users can conveniently select the optimum laundry course, thereby increasing the usability of the user.

According to at least one of the embodiments of the present invention, since the laundry processing device operates according to the voice input, the user does not need to operate the remote controller, and the user convenience can be increased.

In addition, according to at least one embodiment of the present invention, the voice recognition server system recognizes the voice input received through the laundry processing device, thereby efficiently recognizing and processing natural language.

Further, according to at least one of the embodiments of the present invention, the optimum washing course is guided by voice input, so that unskilled users can conveniently select the optimum washing course, thereby increasing the usability of the user .

In addition, according to at least one embodiment of the present invention, by setting the washing course by voice input, the user's operation can be minimized in the washing course selection process, thereby enhancing user convenience.

In addition, according to at least one of the embodiments of the present invention, various options can be added to the laundry course setting by voice input, thereby enhancing user convenience.

Meanwhile, various other effects will be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a view illustrating a smart home system including a voice recognition server system and a home appliance according to an embodiment of the present invention.
2 is a diagram illustrating various examples of home appliances.
3A is an example of a speech recognition server system according to an embodiment of the present invention.
3B is an example of a speech recognition server system according to an embodiment of the present invention.
4 is a block diagram illustrating an internal block diagram of a server according to an embodiment of the present invention.
FIG. 5 is a view showing an example of an internal block diagram of a laundry processing apparatus according to an embodiment of the present invention.
6 is a perspective view illustrating a laundry processing apparatus according to an embodiment of the present invention.
7 is a flowchart illustrating an operation method of the laundry processing apparatus according to an embodiment of the present invention.
8 is a flowchart illustrating an operation method of a speech recognition server system according to an embodiment of the present invention.
FIG. 9 is a flowchart illustrating a method of operating a laundry processing apparatus and a voice recognition server system according to an embodiment of the present invention. Referring to FIG.
10 and 11 are diagrams illustrating signal flow of a speech recognition server system according to an embodiment of the present invention.
12 to 14 are diagrams referred to in explaining a method of operating a laundry processing apparatus and a voice recognition server system according to an embodiment of the present invention.
15 is a flowchart illustrating an operation method of a laundry processing apparatus and a voice recognition server system according to an embodiment of the present invention.
16 is a flowchart illustrating an operation method of a speech recognition server system according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, it is needless to say that the present invention is not limited to these embodiments and can be modified into various forms.

In the drawings, the same reference numerals are used for the same or similar parts throughout the specification.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description and do not give special significance or role in themselves. Thus, "module" and "part" may be used interchangeably.

FIG. 1 is a schematic view of a smart home system including a voice recognition server system and a home appliance according to an embodiment of the present invention. FIG. 2 is a view for explaining various examples of a home appliance.

Referring to FIG. 1, a smart home system 10 according to an embodiment of the present invention includes a home appliance 200 having a communication module (not shown) and capable of communicating with other devices or connecting to a network, And a voice recognition server including a plurality of servers for voice recognition and home appliance control.

2, a laundry processing apparatus 200a having a communication module, a robot cleaner 200b, a refrigerator 200c, an air conditioner 200d, a cooking appliance 200e, and the like are connected to the home appliance 200 .

In addition, the smart home system 10 according to an embodiment of the present invention may include a mobile terminal (not shown) such as a smart phone, a tablet PC, and the like.

The home appliance 200 may include a communication module to communicate with electronic devices inside / outside the smart home system 10.

The smart home system 10 according to an embodiment of the present invention may further include an access point (AP) apparatus 300. The home appliance 200 may be connected to an access point 300 via a wireless Internet It can connect to the network and communicate with other devices.

The access point 300 can allocate a wireless channel according to a predetermined communication method to the electronic devices in the smart home system 10 and perform wireless data communication through the corresponding channel.

Here, the predetermined communication method may be a Wi-Fi communication method. Correspondingly, the communication module included in the home appliance 200 may be a Wi-Fi communication module, but the present invention is not limited to the communication method.

Alternatively, the home appliance 200 may have another type of communication module or a plurality of communication modules. For example, the home appliance 200 may include an NFC module, a zigbee communication module, a Bluetooth communication module, and the like.

The home appliance 200 can be connected to a server included in the voice recognition server system 100 or a predetermined external server or a user's portable terminal through a wi-fi communication module or the like, Function can be supported.

The user can check information on the home appliance 200 in the smart home system 10 or control the home appliance 200 through the portable terminal.

On the other hand, it may be inconvenient for a user to use the portable terminal even if the user wants to control the home appliance 200 or confirm certain information in the home.

For example, it is more efficient to have a means to control the home appliance 200 in other ways when the user does not know the current location of the mobile terminal or is in another location.

The home appliance 200 according to an exemplary embodiment of the present invention can receive a user's voice input and the voice recognition server system 100 can recognize and analyze the user's voice input to control the home appliance 200 have.

Accordingly, the user can control the home appliance 200 without operating the portable terminal or the remote control device.

At least some of the servers included in the voice recognition server system 100 may be a server operated by a manufacturer of a home appliance, a sales company, or a server operated by a manufacturer or a company entrusted with a service by a sales company .

3A is an example of a speech recognition server system according to an embodiment of the present invention.

3A, a speech recognition server system according to an embodiment of the present invention receives voice data from a home appliance 200, for example, a laundry processing device 200a, analyzes the received voice data, And a voice server 110 for discriminating a voice command.

The voice server 110 receives the voice data from the laundry processing device 200a, converts the received voice data into text data, and analyzes the text data to determine a voice command.

Further, the voice server 110 can transmit a signal corresponding to the voice command determined to the predetermined server.

For example, the speech recognition server system according to an embodiment of the present invention receives a signal corresponding to the identified voice command from the voice server 110, and generates a request signal corresponding to the determined voice command And a home appliance control server 130 for transmitting a control signal based on a request signal received from the connecting service server 120 and the connecting service server 120 to the laundry processing apparatus 200a.

The laundry processing apparatus 200a may receive a voice command input by the user and transmit the voice data based on the received voice command input to the voice server 110. [

The voice server 110 includes an Automatic Speech Recognition (ASR) server 111 for receiving voice data from the laundry processing device 200a and converting the received voice data into text data, And a control unit for receiving the text data from the automatic speech recognition server 111, analyzing the received text data to determine a voice command, and transmitting a response signal based on the determined voice command to the laundry processing device 200a (NLP) server 112 for receiving a response signal from the laundry processing apparatus 200a and a signal including a text corresponding to the response signal from the laundry processing apparatus 200a and converting the text included in the received signal into speech data And a text to speech (TTS) server 113 for transmitting the text message to the laundry processing apparatus 200a.

The automatic speech recognition server 111 may perform speech recognition on the speech data received from the laundry processing device 200a to generate text data and transmit the text data to the natural language processing server 112. [

The natural language processing server 112 can analyze the text data received from the automatic speech recognition server 111 according to a natural language processing algorithm to discriminate a voice command.

The natural language processing server 112 can process a natural language that is a language that a person routinely uses according to a natural language processing algorithm, and can analyze an intent of a user. The natural language processing server 112 can perform natural language processing on the text data received from the automatic speech recognition server 111 to discriminate a voice command that matches the user's intention.

Accordingly, the natural language processing server 112 can discriminate a voice command that matches the user's intention even if the user inputs a voice command in a daily use language.

The natural language processing server 112 can transmit a signal corresponding to the natural language processing result, that is, a signal corresponding to the discriminated voice command, to the linked service server 120.

The connection service server 120 can receive a signal corresponding to the determined voice command from the natural language processing server 112. [

The connection service server 120 may perform a corresponding operation by communicating with the home appliance control server 130 if the voice command is related to the laundry processing device 200a.

Alternatively, if the determined voice command is not related to the laundry processing apparatus 200a, the linked service server 120 may perform a corresponding operation by communicating with the external service 121.

For example, if the determined voice command is a command for requesting information such as weather, stock, news, etc., the connection service server 120 requests and receives the information from the server providing the service corresponding to the requested information .

The connection service server 120 may transmit the received information to the voice server 110 and the natural language processing server 112 may transmit the received information to the laundry processing apparatus 200a.

The connection service server 120 may generate a request signal corresponding to the determined voice command and transmit it to the home appliance control server 130 if the voice command is related to the laundry processing device 200a.

The home appliance control server 130 may transmit a control signal based on a request signal received from the associated service server 120 to the laundry processing device 200a.

For example, when a request to start washing is received, the home appliance control server 130 may transmit a control signal to start washing with the laundry processing apparatus 200a.

Meanwhile, the laundry processing apparatus 200a may perform a corresponding operation according to a control signal received from the household control server 130. [

Further, the laundry processing apparatus 200a may transmit a signal to the household control server 130 indicating that the operation has been performed after performing the requested operation.

The home appliance control server 130 receives a response signal to the control signal from the laundry processing device 200a and transmits processing result information corresponding to the response signal to the connection service server 120 .

The voice server 110 may transmit a response signal including the processing result information to the laundry processing device 200a.

Also, the voice server 110 receives a signal including an output text corresponding to the processing result information from the laundry processing device 200a, converts the received output text text into voice data, To the processing device 200a.

In this case, the response signal based on the determined voice command transmitted to the laundry processing device 200a by the natural language processing server 112 may include the processing result information.

On the other hand, the laundry processing device 200a can receive a response signal based on the determined voice command from the natural language processing server 112. [ Here, the response signal may include text data of a response corresponding to the identified voice command.

For example, when the user inputs a voice command to change the washing course, the response signal may include text data indicating that the washing course has been changed.

On the other hand, the laundry processing device 200a can transmit a signal including the text corresponding to the received response signal to the text-to-speech conversion server 113. [ Here, the signal including the text corresponding to the response signal may include an output text corresponding to the processing result information.

On the other hand, the text-to-speech conversion server 113 converts the text included in the received signal into voice data and transmits the voice data to the laundry processing device 200a. The converted voice data may include a sound source file.

The laundry processing apparatus 200a can output a voice guidance message based on voice data received through a speaker.

The connection service server 120 requests the appliance control server 130 to send the status information of the laundry processing device 200a to the home appliance control server 130 based on a signal corresponding to the determined voice command, 130 may transmit status information of the laundry processing apparatus 200a to the linked service server 120. If the state information of the laundry processing apparatus 200a is not secured, the home appliance control server 130 may request and receive status information from the laundry processing apparatus 200a.

Meanwhile, when it is possible to support the determined voice command based on the state information of the laundry processing device 200a, the connection service server 120 transmits the voice command to the home appliance control server 130 It is possible to transmit a corresponding request signal.

Alternatively, if it is impossible to support the determined voice command on the basis of the status information of the laundry processing device 200a, the connection service server 120 notifies the natural language processing server 112 It is possible to transmit a signal indicating the function.

Even in this case, the laundry processing apparatus 200a can request and receive the voice data to the text-to-speech conversion server 113 and output a voice guidance message indicating that the voice data is an unsupported function in the current state.

According to the embodiment, the voice server 110 can determine whether or not the identified voice command can be supported. For example, the natural language processing server 112 that has analyzed the intention of the user's voice command can determine the supportability of the determined voice command.

In this case, when the determined voice command includes an instruction that can not be supported, a response signal based on the voice command determined by the natural language processing server 112 is transmitted to the laundry processing device May be a signal indicating that the function is an unsupported function.

The voice server 110 and the voice recognition server system 100 including the voice server 110 according to an exemplary embodiment of the present invention can organically connect servers having various roles for natural voice processing.

The home appliance 200 performs operations from reception and preprocessing of voice commands to server transmission and the voice server 110 can perform a natural language process such as voice / text conversion, intent analysis, and command identification.

By performing the natural language processing by the voice server 110, burden on the CPU, memory, etc. of the embedded module in the home appliance can be reduced.

Meanwhile, the connection service server 120 may communicate with the external service and home appliance control server 130 to perform an operation based on the voice command of the user.

On the other hand, the home appliance 200 can receive voice data including a sound source file from the voice server 110 and output a voice guidance message to the voice to reply to the voice input of the user through auditory feedback.

The home appliance 200 receives the voice file streaming from the voice server 110 and reproduces and outputs the voice guidance message to the user. Accordingly, the home appliance 200 need not store various sound source files.

Meanwhile, it is possible to link with various external services without colliding with other servers through the connection service server 120. In addition, through the external service interworking server, it is possible to increase the success rate of the intention analysis by reflecting external information in the intention analysis.

The voice recognition server system 100 according to an embodiment of the present invention assures compatibility and connectivity through a plurality of servers and the final control command uses the home appliance control server 130 to perform a voice recognition process and a home appliance control It is possible to prevent a collision between the home appliance control using the Wi-Fi communication through the server 130 and the home appliance control through the mobile terminal and the home appliance control by the voice input through the home appliance 200. [

 The speech recognition server system 100 according to an embodiment of the present invention can reduce a load on a specific server depending on a server through an organic connection between the servers, If there is a problem with the server, it can be easily responded to by linking with other servers having the same role.

In addition, a plurality of servers can be independently updated from time to time, which is advantageous for performance improvement.

3B is an example of a speech recognition server system according to an embodiment of the present invention.

The voice recognition server system illustrated in FIG. 3B improves the voice control response time by improving the process of transmitting voice data for voice guidance message output to the laundry processing device 200a by the voice recognition server system illustrated in FIG. 3A will be.

Therefore, the speech recognition server system illustrated in FIGS. 3A and 3B can perform substantially the same operations other than the above-described differences, and the same portions will be briefly described below.

3B, a speech recognition server system according to an embodiment of the present invention includes a voice server 110 for receiving voice data from the laundry processing device 200a, analyzing the voice data received to determine a voice command, . ≪ / RTI >

In addition, the voice recognition server system according to an embodiment of the present invention may include a voice recognition server system 110 for receiving a signal corresponding to the voice command discriminated from the voice server 110 and generating a request signal corresponding to the discriminated voice command And a home appliance control server 130 for transmitting a control signal based on a request signal received from the service server 120 and the connection service server 120 to the laundry processing apparatus 200a.

The voice recognition server system illustrated in FIG. 3B can transmit voice data including the processing result information based on the voice command to the laundry processing device 200a, without requesting the laundry processing device 200a, As shown in FIG.

The voice server 110 includes an automatic voice recognition server 111 that receives voice data from the laundry processing device 200a and converts the received voice data into text data, A natural language processing server (112) for receiving the text data from the speech processing device and analyzing the received text data to discriminate a voice command; and a speech processor for converting the response signal based on the voice command into voice data, And a text-to-speech conversion server 113 for transmitting the text-

In the present embodiment, the household appliance control server 130 receives a response signal to the control signal from the laundry processing apparatus 200a, and transmits processing result information corresponding to the response signal to the connection service server 120 As shown in FIG.

The linking service server 120 can transmit the processing result information to the voice server 110, more specifically, the natural language processing server 112.

In this case, the voice data transmitted by the text-to-speech conversion server 113 to the laundry processing device 200a may include the processing result information.

In addition, the linked service server 120 requests the household appliance control server for status information of the laundry processing device 200a based on the signal corresponding to the voice command that has been determined, And transmit the status information of the processing device 200a to the linked service server 120. [

In the case where it is possible to support the determined voice command based on the state information of the laundry processing device 200a, the connection service server 120 may transmit the voice command to the home appliance control server 130 It is possible to transmit a corresponding request signal.

Alternatively, when it is impossible to support the determined voice command on the basis of the status information of the laundry processing device 200a, the connection service server 120 transmits a function that is not supported in the current state to the voice server 110 A signal indicating that the signal is transmitted can be transmitted.

For example, the connection service server 120 may transmit a signal to the natural language processing server 112 indicating that the function is an unsupported function in the current state.

In addition, the natural language processing server 112 transmits a signal indicating the unsupported function in the current state to the text-to-speech conversion server 113, and the text-to-speech conversion server 113 generates corresponding voice data, To the processing device 200a.

The laundry processing apparatus 200a may receive the voice data from the text-to-speech conversion server 113 and output a voice guidance message indicating that the voice data is not supported in the current state.

According to the embodiment, the voice server 110 can determine whether or not the identified voice command can be supported. For example, the natural language processing server 112 that has analyzed the intention of the user's voice command can determine the supportability of the determined voice command.

In this case, when the determined voice command includes an instruction that can not be supported, a response signal based on the determined voice command transmitted by the natural language processing server (112) May be a signal indicating that the function is an unsupported function.

A time difference may occur between the operation and the announcement when the text message server 113 for voice guidance requests the announcement about the operation after the laundry processing device 200a operates.

However, according to an embodiment of the present invention, when the intention analysis is completed and the operation request is transmitted from the natural language processing server 112, the text voice conversion server 113 can provide information at the same time.

In addition, the text-to-speech conversion server 113 can provide a notification to the laundry processing apparatus 200a at a time point when the home appliance control server 130 issues a control command to the laundry processing apparatus 200a.

Accordingly, the announcement item can be ignited at the same time or immediately after the operation of the laundry processing apparatus 200a.

According to the present embodiment, by directly connecting the natural language processing server 112 and the text-to-speech conversion server 113, the time difference between the control command and the announcement through the home appliance control server 130 can be minimized.

3A and 3B, the laundry appliance 200a is illustrated as an example of the home appliance 200, but the present invention is not limited thereto. For example, the home appliance 200 may include a robot cleaner 200b, a refrigerator 200c, an air conditioner 200d, and a cooking appliance 200e in addition to the laundry processing device 200a.

3A and 3B, an automatic speech recognition server 111, a natural language processing server 112, and a text-to-speech conversion server 113 for speech recognition and processing are integrated Server.

Also, according to an embodiment, the connection service server 120 and the home appliance control server 130 may be configured as one integrated server.

According to the present invention, since the home appliance operates according to the voice input, the user does not need to operate a remote control device such as a remote control device, a portable terminal, etc., thereby improving user convenience.

As described with reference to FIGS. 3A and 3B, the present invention recognizes a user's natural language voice command using a plurality of servers, and performs a corresponding control operation so that the system resources of the home appliance, Natural language can be recognized and processed efficiently without limitation.

4 is a block diagram of an internal block diagram of a server according to an embodiment of the present invention. The server includes an automatic speech recognition server 111, a natural language processing server 112, a text-to-speech conversion server 113, A connection service server 120, and a home appliance control server 130. [

Referring to FIG. 4, the server may include a communication module 420, a storage unit 430, and a processor 410.

The processor 410 may control the overall operation of the server.

The communication module 420 can receive various data such as status information, operation information, operation information, voice data, and character data from a home appliance such as a portable terminal, a laundry processing device, or another server.

The communication module 420 can transmit the data corresponding to the received various information to the home appliances such as the portable terminal, the laundry processing device, and other servers after the predetermined processing.

To this end, the communication module 420 may include one or more communication modules such as an Internet module, a mobile communication module, and the like.

The storage unit 430 may store received information and may include data for generating result information corresponding to the received information.

The storage unit 430 may store data for operation of the server. For example, in the case of the automatic speech recognition server 111, an automatic speech recognition algorithm and the like are stored in the storage unit 430. In the case of the home appliance control server 130, the product information of the home appliance, Can be stored.

Meanwhile, the server may be a server operated by a home appliance manufacturer such as a laundry processing device or a server operated by a service provider, or may be a kind of a cloud server.

FIG. 5 is a view showing an example of an internal block diagram of a laundry processing apparatus according to an embodiment of the present invention.

5, the home appliance 200 according to an exemplary embodiment of the present invention includes an audio input unit 220 for receiving a voice command of a user, a memory 250 for storing various data, A display unit 292 for displaying predetermined information as an image; an audio output unit 291 for outputting predetermined information as audio; And a control unit 240 for controlling operations.

The audio input unit 220 can receive external audio signals and user voice commands. To this end, the audio input unit 220 may include one or more microphones (MICs). In addition, the audio input unit 220 may include a plurality of microphones 221 and 222 in order to more accurately receive a user's voice command. The plurality of microphones 221 and 222 can be disposed at different positions and can acquire an external audio signal and process it as an electrical signal.

In FIG. 5, the audio input unit 220 includes two microphones including a first microphone 221 and a second microphone 222, but the present invention is not limited thereto.

The audio input unit 220 may include a processor for converting analog sound into digital data, or may be connected to a processing unit to convert user input voice commands into data to be recognized by the controller 240 or a predetermined server.

Meanwhile, the audio input unit 220 may use various noise reduction algorithms for eliminating noise generated in the process of receiving a voice command of a user.

The audio input unit 220 may include a filter for removing noise from an audio signal received from each of the microphones 221 and 222 and an amplifier for amplifying and outputting a signal output from the filter, .

The memory 250 records various kinds of information necessary for the operation of the home appliance, and may include a volatile or nonvolatile recording medium. The storage medium stores data that can be read by a microprocessor, and includes a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD- Tape, floppy disk, optical data storage, and the like.

Meanwhile, the memory 250 may store data for voice recognition, and the control unit 240 may process the voice input signal of the user received through the audio input unit 220 and perform a voice recognition process.

Meanwhile, a simple speech recognition may be performed by the home appliance 200, and a high-level speech recognition such as natural language processing may be performed in the speech recognition server system 100.

For example, in the case where a wake up voice signal including a preset caller is received, the home appliance 200 can be switched to a state for receiving a voice command. In this case, the home appliance 200 performs only the voice recognition process up to the voice input of the caller, and voice recognition for the subsequent voice input of the user can be performed through the voice recognition server system 100.

Home appliances Because there is a limit to these system resources, complex natural language recognition and processing can be performed through the speech recognition server system 100.

Limited data may be stored in the memory 250. For example, in the memory 250, data for recognizing a wake up voice signal including a predetermined caller may be stored. In this case, the controller 240 can recognize a wake-up voice signal including a preset caller from the voice input signal received through the audio input unit 220.

On the other hand, the caller can be set by a manufacturer, and another caller can be set for each home appliance. For example, in the case of a laundry processing device, "LG Trombone ", in the case of an air conditioner," LG Whisen ", and in the case of a refrigerator, "LG Dios"

The caller can be changed by the user.

The control unit 240 can control the voice recognition server system 100 to transmit the voice command of the user inputted after recognizing the wake up voice signal to the voice recognition server system 100 through the communication unit 270. [

The communication unit 270 includes one or more communication modules and can perform wireless communication with other electronic devices to exchange various signals. For example, the communication unit 270 can communicate with electronic devices inside / outside the mall home system 10. [

The communication unit 270 may communicate with the access point 300 and may communicate with other devices by accessing the wireless Internet network through the access point 300. [

The control unit 240 can also transmit the state information of the home appliance 200, voice commands of the user, and the like to the voice recognition server system 100 or the like through the communication unit 270.

Meanwhile, when a control signal is received through the communication unit 270, the control unit 240 may control the home appliance 200 to operate according to the received control signal.

The display 292 can display information corresponding to a command input by a user, a processing result corresponding to a command input by the user, an operation mode, an operation state, an error state, and the like.

According to an embodiment, the display 292 may be configured as a touch screen by forming a mutual layer structure with the touch pad. In this case, the display 292 may be used as an input device capable of inputting information by a user's touch in addition to the output device.

The audio output unit 291 outputs a notification message such as a warning sound, an operation mode, an operation state, an error state, etc., information corresponding to a command input by the user, a process corresponding to a command input by the user And output the result as audio.

On the other hand, the audio output unit 291 can convert the electrical signal from the control unit 240 into an audio signal and output it. For this purpose, a speaker or the like may be provided.

Also, the home appliance 200 according to an embodiment of the present invention can provide a user experience (UX) considering various situations that may occur during a speech recognition process and a home appliance control process.

The control unit 240 may control the audio output unit 291 and the display unit 292 to provide predetermined information to the user in a visual / auditory sense corresponding to each step of the speech recognition process and the home appliance control process.

The controller 240 controls the display 292 to provide visual information corresponding to each step of the speech recognition process and the home appliance control process.

In addition, the controller 240 controls the audio output unit 291 to provide auditory information corresponding to each step of the speech recognition process and the home appliance control process.

The driving unit 280 performs an operation implemented in the home appliance, and may be configured differently for each home appliance.

For example, when the home appliance is a laundry processing apparatus, the driving unit 280 may include a driving unit for driving the drum or the tub, a motor control unit for applying an operation control signal to the motor, and the like.

The control unit 240 can perform the washing, rinsing and dewatering processes according to a predetermined algorithm and the driving unit 280 controls the load of the motor, the water supply valve, the drain valve, .

The driving unit 280 may control the driving of the laundry processing device to perform the set operation corresponding to the control signal applied from the control unit 240. Accordingly, the laundry processing apparatus performs a series of strokes such as a washing cycle, a rinsing cycle, and a dewatering cycle to remove the contamination of the laundry.

For example, in the case of a laundry processing apparatus, the driving unit 280 drives a motor for rotating the washing tub or the drum and controls the operation thereof so that the washing tub or the drum rotates to remove dirt from the laundry. In response to the control command of the control unit 240, the valve is controlled to perform water supply or drainage.

In another example, when the home appliance is a refrigerator, the driving unit 280 includes a refrigerator compartment driving unit for operating a refrigerator compartment fan for supplying cooled air to the refrigerating compartment, a freezer compartment driving unit for operating a freezer compartment fan for supplying cooled air to the freezer compartment, A compressor driving unit for operating a compressor for compressing the refrigerant, and the like.

As another example, when the home appliance is an air conditioner, the driving unit 280 includes a compressor driving unit for driving the compressor in the outdoor unit, an outdoor fan driving unit for operating the outdoor fan for heat exchange, A fan drive unit, and the like.

As another example, when the home appliance is a cooker, the driving unit 280 may include a microwave driving unit that outputs microwaves into the cavity.

As another example, when the home appliance is a cleaner, the driving unit 280 may include a fan motor driving unit for air suction.

Meanwhile, the home appliance 200 may further include an operation unit 230 for user input, and a sensor unit 260 including at least one sensor for sensing various data.

The operation unit 230 may include a plurality of operation buttons, and may transmit a signal corresponding to the input button to the control unit 240.

The sensor unit 260 may include at least one sensing unit for sensing temperature, pressure, voltage, current, water level, rotation speed, etc., and may apply the sensed or measured data to the control unit 240. For example, the sensor unit 260 may measure the water level of the water during the water supply or drainage in the laundry processing apparatus, and measure the temperature of the water supplied, the rotation speed of the drum, or the like.

6 is a perspective view illustrating a laundry processing apparatus according to an embodiment of the present invention.

6, the laundry processing apparatus 200a includes a cabinet 611, a tub 632 disposed inside the cabinet 611 and capable of receiving and rotating laundry, a tub 632, (Not shown) for supplying washing water to the tub 632, a motor (not shown) for driving the tub 632, a washing water supply device (not shown) for supplying washing water to the tub 632, and a drain have.

The cabinet 611 includes a cabinet body 612 and a cabinet cover 613 disposed on the front surface of the cabinet body 612 and coupled to the cabinet body 612. The cabinet cover 611 is disposed above the cabinet cover 613 and operates the laundry processing apparatus 200a And a top plate 615 disposed above the control panel 616 and coupled to the cabinet body 612. The control panel 616 may include a control panel 616,

On the other hand, the cabinet cover 613 may include a hole (not shown) in which the laundry enters and exits, and a door 614 that rotates to open and close the hole.

The control panel 616 is provided with an operation portion 230 including a plurality of operation keys 617 for operating the laundry processing device 200a is disposed on the control panel 616 and the operation of the laundry processing device 200a An audio output unit 291 for outputting a status as a beep tone, and a display panel 618 for displaying the operation status by letters, numbers, special symbols, images, and the like.

In addition, the control panel 616 may be provided with microphones 621 and 622 that receive voice commands from the user. Alternatively, the microphones 621 and 622 may be located at other locations suitable for receiving voice commands.

The microphones 621 and 622 can receive external audio signals and user voice commands. Also, the microphones 621 and 622 can acquire external audio signals and user voice commands and process them as electrical signals.

The operation unit 230 may include input means for applying a predetermined signal by pressing, touching, pressure, rotating, or the like in the form of a key, a button, a switch, a rotary switch, or a touch input means.

The audio output unit 291 can output audio signals such as various sound effects and voice guidance messages. To this end, the audio output unit 291 may include a speaker or the like.

The audio output from the audio output unit 291 may be emitted to the outside through a sound channel or sound guide formed on the back surface of the control panel 616 through a gap of a portion where the operation keys 617 are formed.

In addition, when a separate output hole 619 is provided, the sound output from the audio output unit 291 through the output hole 619 may be emitted to the outside.

Meanwhile, FIG. 6 shows an example of the laundry processing apparatus 200a, and the present invention is not limited thereto.

For example, the laundry processing apparatus 200a may be implemented by a front load method or a top load method.

Also, the laundry processing apparatus 200a may be a drying and laundry processing apparatus that provides both a washing function and a drying function.

The operation key 617 receives data such as a washing course and various settings according to the operation of the laundry processing apparatus 200a and applies the data to the control unit 240. [

At this time, the operation keys 617 may be composed of a button, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, a finger mouse, a rotary switch, a jog dial, Any device capable of generating predetermined input data by an operation such as pressure, contact, or the like can be applied.

The display panel 618 displays information input by the operation unit 230 and the operation keys 617, operation state information of the laundry processing apparatus 200a, information on the completion of operation, and the like in correspondence with the control command of the control unit 240 It can be displayed on the screen. In addition, failure information relating to malfunction at the time of malfunction is displayed on the screen.

The display panel 618 may display a wash setting and an operation state on a screen in a combination of at least one of a character, an image, an icon, and a special character, and may display various notifications according to an operation state.

7 is a flowchart illustrating an operation method of the laundry processing apparatus according to an embodiment of the present invention.

5 and 7, the laundry processing device 200a can receive voice input through the microphones 221 and 222 (S727), and transmits the first voice data corresponding to the voice input to the voice server 200a (S730).

The laundry processing device 200a can activate the voice recognition function by user input (S710). The control unit 240 of the home appliance 200 can activate the microphones 221 and 222 according to user input.

Alternatively, the laundry processing device 200a may automatically activate the voice recognition function in accordance with the setting for activating the voice recognition function.

For example, when the power is turned on, the laundry processing apparatus 200a can automatically activate the microphones 221 and 222 and activate the voice recognition function.

When a voice input is received from the user while the microphones 221 and 222 of the laundry processing apparatus 200a are activated, the microphones 221 and 222 receive the input voice and can transmit the input voice to the control unit 240 have.

On the other hand, the laundry processing apparatus 200a can wait for input of a predetermined caller in accordance with activation of the voice recognition function (S710).

If the preset caller is received through the microphones 221 and 222 in step S720, the laundry processing apparatus 200a may be switched to the voice input standby mode for receiving the voice command of the user in step S725.

If the laundry processing device 200a always waits for a natural language command, the power consumed in the voice recognition function, the CPU occupation rate, and the load on the server of the voice recognition server system are burdensome.

Accordingly, the laundry processing apparatus 200a can transmit only the voice signal input in the voice input standby mode to the voice server.

In addition, the laundry processing apparatus 200a gives a condition at a time of waiting for voice input, and can receive a sound until a command completion time when the command is input within a time, and can transmit the sound to the voice server.

According to one aspect of the present invention, the laundry processing apparatus 200a performs only a voice recognition process up to the voice input of the caller, and voice recognition for the subsequent user voice input can be performed through the voice recognition server system 100 have.

On the other hand, the caller can be set by a manufacturer, and another caller can be set for each home appliance. For example, in the case of laundry processing equipment, the "LGTM" Further, the caller can be changed by a manufacturer or a user.

Meanwhile, the control unit 240 may control the voice recognition server system 100 to transmit the voice input of the user input after recognition of the voice call through the communication unit 270 (S730).

The laundry processing apparatus 200a can communicate with the voice server 110 via the communication unit 270 and can transmit the first voice data corresponding to the voice input of the user to the voice server at step S730.

On the other hand, waiting indefinitely for a user's voice command is wasteful of system resources and does not match the intention of a user who does not input a command. Therefore, in the command standby mode, only voice commands input during a predetermined elapsed time can be set to be processed (S727 ).

In this case, the controller 240 may control the voice server 110 to transmit the voice data including the voice input received within the predetermined elapsed time to the voice server 110 (S730).

On the other hand, if the voice command is not received within the preset elapsed time (S727), the control unit 240 can control to again wait for the input of the caller.

Meanwhile, the voice server 110 and the voice recognition server system 100 including the voice server 110 recognize and process voice data including voice input received from the laundry processing device 200a as described with reference to FIGS. 1 to 3B can do.

Accordingly, when the communication unit 270 receives the control signal based on the voice input from the home appliance control server 130 (S740), the control unit 240 controls the laundry processing apparatus 200a to operate in accordance with the received control signal (S745).

When the communication unit 270 receives the speech recognition result information based on the speech recognition result of the first speech data from the speech server 110 (S1750), the control unit 240 responds to the received speech recognition result information The audio output unit 291 may be controlled to output a voice guidance message (S770).

The voice input received through the microphones 221 and 222 includes at least one of a keyword indicating the type of cloth (material of laundry), the method of washing, the degree of dirt, the speed of washing, the temperature of water, .

In this case, the voice recognition server system 100 is based on at least one of a cloth type (material of the laundry), a washing method, a degree of dirt, a laundry speed, a water temperature, and a keyword indicating information on a usable detergent Thus, the optimum washing course can be discriminated.

For example, the voice server 110 can identify the recommended laundry course by itself.

Alternatively, the appliance control server 130 may receive the voice recognition result from the voice server 110 to determine the recommended laundry course. In this case, the home appliance control server 130 transmits the recommended washing course information to the voice server 110, and the voice server 110 transmits the voice recognition result information based on the received recommended washing course information to the laundry processing device 200a. Lt; / RTI >

In the present specification, the washing course means a series of operations of the laundry processing apparatus which are automatically performed according to predetermined conditions and procedures. In general, the washing course may include a washing cycle, a rinsing cycle, and a dewatering cycle.

For example, a variety of laundry courses can be provided, such as a functional apparel course, a lingerie course, a children's wear course, a sterilization course, a wool course, a quilt course, a soaking course, a soaking course, Each of the washing courses takes into consideration the washing purpose of the user or the kind of the clothes, and is intended to perform the washing according to predetermined procedures and conditions from the beginning to the end according to the washing purpose of each washing course.

In addition, the manufacturer may store data for a plurality of frequently used laundry courses in advance in the laundry processing apparatus 200a, and if necessary, operate the laundry processing apparatus 200a according to a specific laundry course based on stored data can do.

The plurality of laundry courses previously stored in the present specification may be a plurality of standard laundry courses in which each stroke is set as a standard considering the purpose of laundry or the type of clothes.

The voice server 110 or the home appliance control server 130 can determine any one of the plurality of standard laundry courses as a recommended washing course based on the voice recognition result.

Meanwhile, the voice guidance message corresponding to the voice recognition result information output from the laundry processing apparatus 200a may be a voice guidance message for guiding the recommended laundry course corresponding to the voice recognition result information.

The voice guidance message may include a message explaining the reason for selecting the recommended laundry course. The laundry processing apparatus 200a can voice the recommendation of the recommended laundry course and the reason for selecting the recommended laundry course.

In addition, the voice guidance message may include a message for guiding an option setting to change at least one of the administrations included in the recommended laundry course. The laundry processing apparatus 200a can voice a message to guide the option setting of the recommended laundry course and the recommended laundry course.

The option setting is for the user to adjust the detailed setting such as the water temperature, the number of times of the dewatering or rinsing, etc., and the amount of water according to the user's needs. Therefore, the user is guided through the recommended laundry course, and the detailed setting of the recommended laundry course can also be adjusted by voice.

The laundry processing apparatus 200a can sequentially output a message to guide the recommended laundry course, reason for selection, and option setting.

According to an embodiment, the voice recognition result information may include a sound source file corresponding to a voice guidance message for guiding the recommended laundry course. In this case, the audio output unit 291 of the laundry processing apparatus 200a can directly reproduce the sound source file and output a voice guidance message.

If the voice recognition result information does not include voice data at step S760, the control unit 240 requests voice data to the voice server 110 at step S765, As shown in Fig.

On the other hand, the user can decide whether to listen to the voice guidance and operate the recommended laundry course, set other additional options, and the like.

The laundry processing apparatus 200a can receive the answer voice input of the user corresponding to the voice guidance message through the microphones 221 and 222. [ The laundry processing device 200a may transmit the second voice data corresponding to the answer voice input to the voice server in the same manner as described above.

The laundry processing device 200a can operate based on the received control signal when receiving the control signal based on the answer voice input from the voice server 110 or the home appliance control server 130. [

For example, the voice server 110 recognizes a user's answer voice input, and when the user's answer voice input corresponds to a command for confirming and executing a recommended laundry course, The washing machine may transmit a control signal to perform washing according to the washing operation.

Alternatively, the voice server 110 recognizes the answer voice input of the user, and when the user's answer voice input corresponds to a command for confirming and executing the recommended laundry course, the voice server 110 recognizes the answer voice input to the home appliance control server 130 A signal corresponding to the result can be transmitted. The home appliance control server 130 may transmit a control signal to the laundry processing device 200a to perform washing according to a recommended washing course.

The voice server 110 recognizes the answer voice input of the user, and when the answer voice input of the user corresponds to the instruction to set the additional option, the voice server 110 transmits the signal corresponding to the recognition result of the answer voice input to the home appliance control server 130 Can be transmitted.

The home appliance control server 130 may transmit a control signal to convert the setting of the recommended laundry course in response to the instruction to set the additional option and to perform the washing according to the recommended laundry course converted into the laundry processing device 200a .

On the other hand, in accordance with the result of speech recognition, a signal corresponding to the speech recognition failure can be received from the speech server 110 via the communication unit 270. In this case, the control unit 240 may control the audio output unit 291 to output a voice guidance message requesting re-input of the voice command, and to switch to the command standby mode again.

In step S735, a signal indicating that the voice command is related to the unsupported function may be received from the voice server 110 via the communication unit 270, in accordance with the discrimination of whether or not the identified voice command can be supported. In this case, the control unit 240 may control the audio output unit 291 to output a voice guidance message informing that the voice command is related to the unsupported function (S737).

In this case, the control unit 240 can control to switch to a mode for waiting for a caller input. Alternatively, the control unit 240 may control to switch to the command standby mode again.

According to an embodiment of the present invention, it is possible to precisely determine at what stage a voice control command is not normally controlled, by providing a voice guidance message for each situation. In addition, the degree of freedom of commands for controlling the product is high, and usability is improved.

8 is a flowchart illustrating an operation method of a speech recognition server system according to an embodiment of the present invention.

Referring to FIG. 8, a voice server 110 according to an embodiment of the present invention may receive first voice data (S810).

The laundry processing apparatus 200a according to an embodiment of the present invention can receive the user's voice through the microphones 221 and 222. [

 The laundry processing apparatus 200a may receive the voice command input by the user and transmit the first voice data based on the received voice input to the voice server 110. The voice server 110 may transmit the first voice data to the laundry processing apparatus 200a (S810).

The voice server 110 may convert the first voice data into first text data (S820). The text data conversion of the voice data can be performed in the automatic voice recognition server 111. [

Thereafter, the voice server 110 may analyze the first text data and recognize a first user command included in the first voice data (S830).

The natural language processing server 112 of the voice server 110 can perform the natural language processing on the first text data by using the natural language processing algorithm to discriminate the first user command corresponding to the intention of the user.

Meanwhile, the voice server 110 may determine a recommended laundry course corresponding to the recognition result of the recognized first user command (S840).

Alternatively, the recognition result of the first user command may be transmitted to the home appliance control server 130, and the home appliance control server 130 may determine a recommended washing course (S840). In this case, the home appliance control server 130 may transmit information on the determined recommended laundry course to the voice server 110. [

The first audio data may include at least one of a keyword indicating a type of cloth (material of the laundry), a washing method, a degree of dirt, a washing speed, a water temperature, and a usable detergent.

In this case, the voice recognition server system 100 is based on at least one of a cloth type (material of the laundry), a washing method, a degree of dirt, a laundry speed, a water temperature, and a keyword indicating information on a usable detergent Thus, the optimum washing course can be discriminated.

For example, the voice server 110 can identify the recommended laundry course by itself.

Alternatively, the appliance control server 130 may receive the voice recognition result from the voice server 110 to determine the recommended laundry course. In this case, the home appliance control server 130 may transmit the recommended laundry course information to the voice server 110. [

According to an embodiment of the present invention, the home appliance control server 130 may include a washing course corresponding to the recognition result of the first user command in the first washing course table in which a plurality of preset standard courses are stored in the laundry processing device 200a You can search for recommended laundry courses.

If there is no laundry course corresponding to the recognition result of the first user command in the first laundry course table, the home appliance control server 130 may generate a plurality of derived laundry courses whose one or more settings are changed in the plurality of standard courses It is possible to search for the laundry course corresponding to the recognition result of the first user command in the stored second laundry course table to determine the recommended laundry course.

Meanwhile, the voice server 110 may transmit voice recognition result information including information on the determined recommended laundry course to the laundry processing device 200a (S850).

On the other hand, as described with reference to FIG. 3A, the voice server 110 can receive a response signal corresponding to the voice recognition result information from the laundry processing device 200a (S860).

For example, the response signal corresponding to the speech recognition result information may include a text corresponding to a voice guidance message for guiding the recommended laundry course.

The response signal corresponding to the speech recognition result information may include a text corresponding to a message explaining a reason for selecting the recommended laundry course.

In addition, the response signal corresponding to the speech recognition result information may include text corresponding to a message for guiding an option setting capable of changing at least one setting among the strokes included in the recommended laundry course.

The voice server 110 receives a signal including an output text corresponding to the voice recognition result information from the laundry processing device 200a (S860), converts the received output text into voice data To the laundry processing apparatus 200a (S870).

On the other hand, the laundry processing device 200a can receive the speech recognition result information from the natural language processing server 112. [ Here, the speech recognition result information may include text data.

On the other hand, the laundry processing device 200a can transmit a signal including the text corresponding to the received voice recognition result information to the text / voice conversion server 113 of the voice server 110. [ .

On the other hand, the text-to-speech conversion server 113 converts the text included in the received signal into voice data and transmits the voice data to the laundry processing device 200a. The converted voice data may include a sound source file.

The laundry processing apparatus 200a can output a voice guidance message based on the voice data received through the audio output unit 291. [

Alternatively, the voice recognition result information may include a sound source file corresponding to a voice guidance message for guiding the recommended laundry course.

The voice recognition result information may include a sound source file corresponding to a message explaining a reason for selecting the recommended laundry course.

In addition, the speech recognition result information may include a sound source file corresponding to a message for guiding an option setting capable of changing at least one setting among the strokes included in the recommended washing course.

3B, the natural language processing server 112 can transmit the text corresponding to the speech recognition result information to the text-to-speech conversion server 113, and the text-to-speech conversion server 113 transmits the speech recognition result The text corresponding to the information can be converted into the voice data.

The text-to-speech conversion server 113 can transmit the converted voice data to the laundry processing device 200a, and the laundry processing device 200a can output the voice guidance message based on the received voice data.

On the other hand, when the voice server 110 receives the second voice data corresponding to the answer voice input of the user corresponding to the voice recognition result information, the voice server 110 converts the received second voice data into second text data And analyzing the second text data to determine a second user command included in the second voice data.

The voice server 110 can control to transmit a control signal corresponding to the recommended laundry course to the laundry processing apparatus 200a when the determined second user command is an instruction to select the recommended laundry course have.

The voice server 110 may transmit a control signal for directing the laundry processing apparatus 200a to perform washing according to a recommended washing course.

Alternatively, the voice server 110 recognizes the second user command, and when the second user command corresponds to the instruction for selecting the recommended laundry course, the voice server 110 transmits the recognition result of the second user command to the home appliance control server 130 The corresponding signal can be transmitted. The home appliance control server 130 may transmit a control signal to the laundry processing device 200a to perform washing according to a recommended washing course.

The voice server 110 recognizes the second user command and instructs the home appliance control server 130 to send the second user command to the home appliance control server 130 when the determined second user command is an instruction to set an option to the recommended laundry course. A signal corresponding to the recognition result can be transmitted.

The home appliance control server 130 generates the optimal laundry course by converting the setting of the recommended laundry course in accordance with the option in at least one of the strokes included in the recommended laundry course in response to the instruction to set the additional option .

Also, the household appliance control server 130 may transmit a control signal corresponding to the generated optimal washing course to the laundry processing device 200a.

As described above, according to the present invention, it is possible to provide a method of setting an optimum laundry course tailored to laundry by voice recognition.

Even if the user does not know the laundry course setting option supported by the laundry processing apparatus 200a, only the kind of the laundry, the washing method, the degree of dirt, the washing speed, the water temperature, whether to rinse / The recognition server system 100 can select and guide the optimum washing course.

The speech recognition server system 100 performs voice recognition and can automatically set the optimal washing course provided by the laundry processing apparatus 200a by the washing course conversion process based on the recognized result.

Accordingly, the laundry processing device 200a can recommend the optimum washing course to the user by voice.

FIG. 9 is a flowchart illustrating a method of operating a laundry processing apparatus and a voice recognition server system according to an embodiment of the present invention. Referring to FIG.

Referring to FIG. 9, although a user who intends to wash cotton underwear according to an embodiment of the present invention does not know what kind of course to wash, he or she inputs a user's intention into the laundry processing apparatus 200a, such as "boil cotton underwear" (910).

Since the voice recognition server system 100 can recognize that the user desires to wash with 'cotton underwear' and 'boil' after voice recognition, it is possible to use the extracted two keywords to perform the ' , And the laundry processing apparatus 200a may output a voice guidance message 920 recommending a 'hard boiled' laundry course.

Further, when the user speaks 'baby clothes', the voice recognition server system 100 discriminates the 'baby clothes laundry course' as a recommended laundry course, and the laundry processing device 200a recognizes 'baby clothes laundry course' Recommended.

When the user speaks the word 'climbing clothing', the voice recognition server system 100 discriminates the 'functional clothes washing course' as a recommended washing course, and the laundry washing machine 200a recommends 'functional clothes washing course' can do.

If the user speaks 'quick finish', the voice recognition server system 100 discriminates the 'speed wash laundry course' as a recommended laundry course, and the laundry processing apparatus 200a sounds 'speed wash laundry course' Recommended.

On the other hand, the user's voice input 910 may be performed after the caller input such as 'LGT-TOM', or may be performed in succession to the caller input.

On the other hand, the voice guidance message 920 may include a message for guiding voice input that the user can select and execute the recommended laundry course.

In the example of FIG. 9, the user of the voice recognition server system 100 can control the laundry processing apparatus 200a to perform the washing with the 'buffet booze' washing course, .

Accordingly, although the user does not know what function the laundry processing apparatus 200a is provided and how to wash the laundry, the user is recommended to have an optimal laundry course when he / she talks about the type of laundry, information, Can be executed.

10 and 11 are diagrams illustrating signal flow of a speech recognition server system according to an embodiment of the present invention.

Referring to FIG. 10, the laundry processing apparatus 200a according to an embodiment of the present invention can receive user's voice input such as "LG Trom, boil cotton underwear" (S1010).

The laundry processing apparatus 200a may transmit the voice input of the received user to the voice server 110 (S1020). The laundry processing device 200a may convert the received voice input into digital voice data of a predetermined format such as a wave file and transmit the digital voice data to the automatic voice recognition server 111. [

The automatic speech recognition server 111 recognizes the received speech data and converts the received speech data into text data (S1031), and transmits the text data to the natural language processing server 112 (S1033).

The natural language processing server 112 may perform natural language processing on the received text data to analyze and determine the intention of the user's voice admission (S1041).

Further, the natural language processing server 112 can discriminate the recommended laundry course corresponding to the discriminated voice input (S1042).

In this embodiment, since the natural language processing server 112 can know that the user desires to wash with 'cotton underwear' and 'boil' after voice recognition, You can set the laundry course.

The present embodiment is advantageous in that it can respond quickly when an audio input corresponding to a standard washing course, which the laundry processing apparatus 200a basically stores, is recognized.

The voice recognition server system 100 may be configured such that the voice server 110 performs only voice recognition related functions and the home appliance control server 130 performs all functions related to control of the laundry processing device 200a have.

In this case, the voice recognition result information is transmitted to the household appliance control server 130, and the household appliance control server 130 can know that it wants to wash with 'cotton underwear' and 'boil' With two keywords, you can set up a 'buffet' laundry course.

Thereafter, the natural language processing server 112 may transmit recognition result information indicating that the recommended laundry course determined by the laundry processing device 200a is a 'buffalo' laundry course (S1043).

On the other hand, the laundry processing apparatus 200a transmits a signal including a text (output phrase) corresponding to the response signal (S1051), and the text-to-speech conversion server 113 receives the text included in the received signal Converted into voice data (S1053), and transmitted to the laundry processing apparatus 200a (S1055).

Based on the received voice data, the laundry processing apparatus 200a sets "a patina boiling course." If it is desired to operate, say "start LG Trom washing." (S1060). ≪ / RTI >

The user can decide whether to listen to the voice guidance and operate the recommended laundry course, set other additional options, and so on.

Referring to FIG. 11, the laundry processing apparatus 200a may receive a user's answer voice input corresponding to the voice guidance message through the microphones 221 and 222 (S1110). The laundry processing device 200a may transmit the second voice data corresponding to the answer voice input to the voice server 110 (S1120).

For example, the voice server 110 recognizes a user's answer voice input, and when the user's answer voice input corresponds to a command for confirming and executing a recommended laundry course, The washing machine may transmit a control signal to perform washing according to the washing operation.

Alternatively, the voice server 110 recognizes the answer voice input of the user, and when the user's answer voice input corresponds to a command for confirming and executing the recommended laundry course, the voice server 110 recognizes the answer voice input to the home appliance control server 130 A signal corresponding to the result can be transmitted. The home appliance control server 130 may transmit a control signal to the laundry processing device 200a to perform washing according to a recommended washing course.

The laundry processing device 200a can operate based on the received control signal when receiving the control signal based on the answer voice input from the voice server 110 or the home appliance control server 130. [

The voice server 110 recognizes the answer voice input of the user, and when the answer voice input of the user corresponds to the instruction to set the additional option, the voice server 110 transmits the signal corresponding to the recognition result of the answer voice input to the home appliance control server 130 Can be transmitted.

11, the laundry processing apparatus 200a can receive the user's voice input setting options such as "dehydration once more " (S1110), and transmits the received voice input of the user to the voice server 110 (S1120).

The laundry processing device 200a converts the received voice input into digital voice data of a predetermined format such as a wave file upon receiving a user's voice input for setting options such as "dehydrated once more" (111).

On the other hand, the laundry processing device 200a may receive a voice command and then transmit a voice command to the voice server 110 while waiting for a command input.

Alternatively, the laundry processing device 200a may receive continuous speech input, including a caller and a voice command. In this case, the laundry processing device 200a can recognize the call word and transmit the voice command to the voice server 110. [

Meanwhile, when the devices communicate with each other in the speech recognition server system 10, signals transmitted and received include, in addition to main data to be exchanged, identification information of each device, a session value for a task to be performed, .

The automatic speech recognition server 111 recognizes the received speech data, converts the received speech data into text data (S1131), and transmits the text data to the natural language processing server 112 (S1133).

The natural language processing server 112 performs natural language processing on the received text data (S1141), and can analyze and determine the intention of the user's voice command (S1143).

For example, the natural language processing server 112 can determine the voice command of the intention to add the dewatering stroke once in the recommended washing course at "dewatering once more ".

The natural language processing server 112 may transmit a signal corresponding to the determined voice command to the link service server 120 (S1143).

On the other hand, upon receiving the status information, the linking service server 120 transmits a request signal to the home appliance control server 130 to add the dehydration cycle once in the recommended laundry course of the laundry processing apparatus 200a in accordance with the determined voice command (S1161).

The home appliance control server 130 generates a control signal based on the request signal and transmits the control signal to the laundry processing apparatus 200a to control the laundry processing apparatus 200a (S1163).

According to the embodiment, the function corresponding to the voice input of the user can check the current state information such as whether the laundry processing apparatus 200a can be supported or the currently set washing course information.

In this case, when the connection service server 120 requests current state information of the laundry processing device 200a to the home appliance control server 130 (S1151), the home appliance control server 130 transmits the current state information of the laundry processing device 200a The state information is inquired (S1153), and the current state information of the laundry processing apparatus 200a can be transmitted to the linked service server 120 (S1155).

If the home appliance control server 130 does not have the current state information of the laundry processing device 200a, the home appliance control server 130 can request and receive current state information from the laundry processing device 200a.

The home appliance control server 130 receives a response signal to the control signal from the laundry processing device 200a after controlling the laundry processing device 200a and outputs processing result information indicating that the operation for the request is successful May be transmitted to the connection service server 120 (S1165).

The linking service server 120 can transmit a signal corresponding to the processing result information to the natural language processing server 112 (S1170), and the natural language processing server 112 transmits the signal corresponding to the processing result information to the natural language processing server 112 The laundry processing device 200a can transmit a response signal based on the voice command of the user who has determined (S1181). Here, the response signal based on the voice command of the discriminating user may include the processing result information.

On the other hand, the laundry processing apparatus 200a transmits a signal including a text (output phrase) corresponding to the response signal (S1183), and the text-to-speech conversion server 113 receives the text included in the received signal (S1185), and transmits the voice data to the laundry processing apparatus 200a (S1187).

The laundry processing apparatus 200a can output a voice guidance message such as "set dehydration once more in the buffalo wash course ", based on the received voice data (S1190).

12 to 14 are diagrams referred to in explaining a method of operating a laundry processing apparatus and a voice recognition server system according to an embodiment of the present invention.

Referring to FIG. 12, the voice guidance message 1210 that guides the recommended laundry course may include a message explaining the reason for selecting the recommended laundry course.

For example, the laundry processing apparatus 200a may include a voice guidance message 1210 such as "boil cotton underwear and wash it like hand laundry, boil it as steam, and set it as a hand-washing boot course." Can be output.

13, a voice guidance message 1210 that guides the recommended laundry course may include a message to guide an option setting to change at least one of the administrations included in the recommended laundry course .

For example, the laundry processing apparatus 200a may output a voice guidance message 1310 such as "Tell me if you want to add an option."

Referring to FIG. 14, a user may utter a spoken response 1410 that adds an option, such as "dehydration once more."

Correspondingly, the speech recognition server system 100 can add a dehydration stroke once to the moderate boiling course.

Further, the laundry processing apparatus 200a can output a voice guidance message 1420 such as "Add option to once more dehydration."

15 is a flowchart illustrating an operation method of a laundry processing apparatus and a voice recognition server system according to an embodiment of the present invention.

Referring to FIG. 15, the laundry processing apparatus 200a can receive a user's voice input through the microphones 221 and 222 (S1510).

 The laundry processing apparatus 200a can transmit the voice data to the voice server 110 after voice pre-processing such as noise cancellation on the received voice input.

On the other hand, the voice server 110 can recognize the voice data transmitted according to the natural language voice recognition algorithm (S1520).

The voice output by the user may be generated by the voice server 110 and the voice server 110 may transmit the text result data to the home appliance control server 130.

On the other hand, the home appliance control server 130 can grasp the control intention of the user from the recognized voice recognition result (S1530)

The home appliance control server 130 can directly control the laundry processing apparatus 200a when the intention is simple device control such as on / off which is not related to the washing course (S1540) S1560).

Alternatively, the home appliance control server 130 can control the laundry processing apparatus 200a (S1560) after setting the optimum washing course (S1550) if the determined intention is a command that desires a washing course (S1540) .

Meanwhile, the laundry processing apparatus 200a displays a controlled state through the display 292 (S1570), and can output a voice guidance message through the voice output unit 291 (S1578)

16 is a flowchart illustrating an operation method of a speech recognition server system according to an embodiment of the present invention.

According to an embodiment of the present invention, the household appliance control server 130 determines whether or not the first user's command is recognized in the first laundry course table 1601 in which a plurality of predetermined standard courses are stored in the laundry processing device 200a It is possible to search for a corresponding laundry course, and to identify a recommended laundry course.

If there is no laundry course corresponding to the recognition result of the first user command in the first laundry course table 1601, the home appliance control server 130 may generate a plurality of derivatives of one or more settings changed in the plurality of standard courses The second laundry course table 1602 in which the laundry courses are stored is searched for the laundry course corresponding to the recognition result of the first user command to determine the recommended laundry course.

Referring to FIG. 16, a voice recognition result in the voice server 110 is generated as a text (S1610), and a keyword may be extracted from the text (S1620).

Alternatively, the voice recognition result in the voice server 110 may be generated as text (S1610), and the home appliance control server 130 may extract the keyword from the text (S1620).

The first washing course table 1601 and the second washing course table 1602 stored in the home appliance control server 130 are arranged in a table with various utterance texts (keyword combinations) for the laundry course, The course may be set.

For example, a predetermined plurality of standard courses may be stored in the first laundry course table 1601, and a plurality of derived laundry courses 1602 in which one or more settings are changed in the plurality of standard courses may be stored in the second laundry course table 1602. [ The courses can be saved. Here, it is possible to provide a washing method in which a standard course is combined with options (rinsing, dehydration, water temperature, etc.).

In the mapping process S1630, the home appliance control server 130 first searches the first laundry course table 1601 to see if there is a laundry course provided by the laundry handling device 200a, When the mapping is established, a recommended washing course is set with the mapped washing course (S1640).

In the mapping process S1630, if there is no desired laundry course in the first laundry course table 1601, the appliance control server 130 searches the second laundry course table 1602 for a corresponding laundry course and sets it as a recommended laundry course (S1640).

On the other hand, according to the embodiment, the first laundry course table 1601 stores a special laundry course specifically provided by the laundry processing apparatus 200a, and the second laundry course table 1602 stores general laundry courses A plurality of derived laundry courses with one or more settings changed can be stored.

In this case as well, the home appliance control server 130 can search for and set the laundry course corresponding to the keyword extracted in the order of the first and second laundry course tables 1601 and 1602.

If there is no laundry course corresponding to the keyword extracted from the first and second laundry course tables 1601 and 1602, the appliance control server 130 can set a recommended laundry course as one of the general standard laundry courses have.

On the other hand, the mapping conversion related to the voice utterance and the setting of the washing course is stored in the first washing course table 1601, the second washing course table 1602, etc., and is continuously added to provide a new washing method .

That is, the first washing course table 1601 and the second washing course table 1602 can be constantly updated. Accordingly, a new washing course can be provided without changing the data stored in the laundry processing apparatus 200a.

According to the present invention, when the user intends to freely wash clothes such as the type of cloth, the washing method, the degree of dirt, the washing speed, the water temperature, the rinsing / The optimum washing course tailored to the laundry can be set by the washing course conversion process.

In addition, by informing the reason for the recommendation of the recommended laundry course and receiving the answer thereto, the user's intent can be confirmed.

According to at least one of the embodiments of the present invention, since the laundry processing device operates according to the voice input, the user does not need to operate the remote controller, and the user convenience can be increased.

In addition, according to at least one embodiment of the present invention, the voice input received through the laundry processing device is recognized by the voice server, so that the natural language can be efficiently recognized and processed.

Further, according to at least one of the embodiments of the present invention, the optimum washing course is guided by voice input, so that unskilled users can conveniently select the optimum washing course, thereby increasing the usability of the user .

In addition, according to at least one embodiment of the present invention, by setting the washing course by voice input, the user's operation can be minimized in the washing course selection process, thereby enhancing user convenience.

In addition, according to at least one of the embodiments of the present invention, various options can be added to the laundry course setting by voice input, thereby enhancing user convenience.

The voice server, the voice recognition server system, and the laundry processing apparatus according to the present invention can be applied to the configurations and methods of the embodiments described above in a limited manner, All or a part of the above-described elements may be selectively combined.

Meanwhile, the voice recognition method, the voice server, the voice recognition server system, and the operation method of the laundry processing apparatus according to the embodiment of the present invention can be implemented as a processor-readable code on a recording medium readable by a processor. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

Speech Recognition Server System: 100
Voice server: 110
ASR server: 111
NLP server: 112
TTS server: 113
Linked service server: 120
Home appliance control server: 130
Home Appliance: 200
Laundry processing equipment: 200a

Claims (15)

Receiving voice input through a microphone;
Transmitting first voice data corresponding to the voice input to a voice server;
Receiving voice recognition result information based on a voice recognition result of the first voice data from the voice server; And
And outputting a voice guidance message to guide a recommended laundry course corresponding to the voice recognition result. The method according to claim 1,
Wherein the voice input includes at least one of a cloth type, a washing method, a degree of dirt, a laundry speed, and a keyword indicating a water temperature. The method according to claim 1,
Wherein the voice recognition result information includes a sound source file corresponding to a voice guidance message for guiding the recommended laundry course. The method according to claim 1,
Wherein the voice guidance message includes a message explaining a reason for selecting the recommended laundry course. The method according to claim 1,
Wherein the voice guidance message includes a message for guiding an option setting to change at least one of the strokes included in the recommended laundry course. The method according to claim 1,
Receiving an answer voice input of a user corresponding to the voice guidance message;
Transmitting second voice data corresponding to the answer voice input to a voice server;
Receiving a control signal based on the answer voice input; And
And operating on the basis of the control signal. Receiving first audio data from a laundry processing device;
Converting the received first speech data into first text data;
Analyzing the first text data to recognize a first user command included in the first voice data;
Determining a recommended laundry course corresponding to the recognition result of the first user command; And
And transmitting voice recognition result information including information on the determined recommended laundry course to the laundry processing device. 8. The method of claim 7,
The step of discriminating the recommended laundry course comprises:
Searching for a washing course corresponding to a recognition result of the first user command in a first washing course table storing a plurality of preset standard courses in the laundry processing apparatus;
If there is no laundry course corresponding to the recognition result of the first user command in the first laundry course table, the second laundry course table in which a plurality of derived laundry courses whose one or more settings are changed in the plurality of standard courses is stored, And searching for a laundry course corresponding to a recognition result of one user command. 8. The method of claim 7,
Wherein the first voice data includes at least one of a cloth type, a washing method, a degree of dirt, a laundry speed, and a keyword indicating a water temperature. 8. The method of claim 7,
Wherein the voice recognition result information includes a sound source file corresponding to a voice guidance message for guiding the recommended laundry course. 8. The method of claim 7,
Wherein the speech recognition result information includes a sound source file corresponding to a message explaining a reason for selecting the recommended laundry course. 8. The method of claim 7,
Wherein the speech recognition result information includes a sound source file corresponding to a message that guides setting of an option capable of changing at least one of the strokes included in the recommended laundry course How it works. 8. The method of claim 7,
Receiving second voice data corresponding to a user's answer voice input corresponding to the voice recognition result information;
Converting the received second voice data into second text data;
And analyzing the second text data to determine a second user command included in the second voice data. 14. The method of claim 13,
And controlling the control unit to transmit a control signal corresponding to the recommended laundry course to the laundry processing apparatus when the determined second user command is an instruction to select the recommended laundry course Way. 14. The method of claim 13,
And when the determined second user command is an instruction to set an option to the recommended laundry course, the optimum laundry course is generated by reflecting the option in at least one of the strokes included in the recommended laundry course step;
And controlling the control unit to transmit a control signal corresponding to the generated optimal washing course to the laundry processing apparatus.

Images