EP3743914A1 - Household appliance and method and system for voice controlling household appliance - Google Patents

Household appliance and method and system for voice controlling household appliance

Info

Publication number
EP3743914A1
EP3743914A1 EP18833709.1A EP18833709A EP3743914A1 EP 3743914 A1 EP3743914 A1 EP 3743914A1 EP 18833709 A EP18833709 A EP 18833709A EP 3743914 A1 EP3743914 A1 EP 3743914A1
Authority
EP
European Patent Office
Prior art keywords
voice
user
control device
feedback information
cloud server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP18833709.1A
Other languages
German (de)
French (fr)
Inventor
Yu Liu
Linjie Shen
Liang Wang
Yang ZHAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BSH Hausgeraete GmbH
Original Assignee
BSH Hausgeraete GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BSH Hausgeraete GmbH filed Critical BSH Hausgeraete GmbH
Publication of EP3743914A1 publication Critical patent/EP3743914A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/34—Adaptation of a single recogniser for parallel processing, e.g. by use of multiple processors or cloud computing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/225—Feedback of the input speech

Definitions

  • the present invention relates to the field of household appliances, and specifically to voice control of a household appliance.
  • a voice controlled household appliance in the market generally uses several methods: one is connecting the household appliance to a mobile phone by using WIFI, and performing voice control on the household appliance by using a mobile APP, which is complex in operation; and one is adding a voice identification module and a voice database on the household appliance, and also combining online identification, but costs are relatively high.
  • the present invention provides a more convenient household appliance with low costs and a method and a system for voice controlling the household appliance, where the household appliance may be a refrigerator, a washing machine, an oven, or the like.
  • a method for voice controlling a household appliance includes a control device and a voice device, a wireless communication module in a wireless communication connection to a cloud server is disposed on the control device, and the voice device includes a voice collecting module and a voice output module.
  • the method includes the following steps: collecting, by using the voice collecting module, a voice signal input by a user; sending the voice signal to the cloud server by using the wireless communication module for identification; receiving, by using the wireless communication module, a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; outputting the instruction confirmation information in a voice signal manner by using the voice output module, and asking for feedback information of the user; and instructing, according to the feedback information, the control device whether to execute the control instruction.
  • the foregoing household appliance is not provided with a voice identification module with relatively high costs, but directly identifies user voice online by using the cloud server, obtains the control instruction and the instruction confirmation information according to user semantics, and notifies the user of the instruction confirmation information in a voice manner, and only after the user confirms the instruction confirmation information and gives a feedback, the control device executes the control instruction. It is avoided that a control instruction not conforming to the user's real meaning is generated due to user's pronunciation or grammatical mistake, and this is more accurate.
  • the control device executes the control instruction; or when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
  • the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • the feedback information is a key signal generated by the user by triggering different feedback keys
  • the control device determines, according to different key signals, whether the feedback information conforms to the user semantics. If the user performs a near-distance operation, whether the feedback information conforms to the user semantics may be directly confirmed by using a key, and the program design is more simple and direct.
  • the key may be a physical key or a virtual key on a touchscreen.
  • the feedback information is a voice feedback signal of the user
  • the method includes: collecting the voice feedback signal by using the voice collecting module; sending the voice feedback signal to the cloud server by using the wireless communication module for identification and determining; receiving, by using the wireless communication module, a determining result fed back by the cloud server; and choosing, by the control device according to the determining result, to execute the control instruction or control the voice output module to inform the user in a voice signal manner to re-input a voice signal.
  • a household appliance is provided.
  • the household appliance is voice controlled by using the foregoing method.
  • the present invention further provides a system for voice controlling a household appliance, including at least one household appliance and a cloud server.
  • the household appliance is provided with a voice device and a control device, including: a voice collecting module disposed on the voice device, configured to collect a voice signal input by a user; a wireless communication module disposed on the control device, in a wireless communication connection to the cloud server, and configured to: send the voice signal to the cloud server for identification, and receive a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; and a voice output module disposed on the voice device, configured to output the instruction confirmation information in a voice signal manner to ask for feedback information of the user, where the control device is instructed, according to the feedback information, whether to execute the control instruction.
  • the control device executes the control instruction; or when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
  • the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • the household appliance is provided with a feedback key
  • the feedback information is a key signal generated by the user by triggering different feedback keys
  • the control device determines, according to different key signals, whether the feedback information conforms to the user semantics. If the user performs a near- distance operation, whether the feedback information conforms to the user semantics may be directly confirmed by using a key, and the program design is more simple and direct.
  • the feedback information is a voice feedback signal of the user;
  • the voice collecting module collects the voice feedback signal and sends the voice feedback signal to the cloud server by using the wireless communication module for identification, and the cloud server identifies and determines whether the feedback information conforms to the user semantics, and notifies the control device of a determining result; and the control device executes the control instruction according to the determining result or controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • FIG. 1 is a schematic diagram of a system for voice controlling a household appliance
  • FIG. 2 is a structural diagram of a system for voice controlling a household appliance
  • FIG. 3 is a flowchart of a method for voice controlling a household appliance
  • FIG. 4 is a preferred flowchart of a method for voice controlling a household appliance.
  • An embodiment of the present invention provides a system for voice controlling a household appliance, including at least one household appliance 1 and a cloud server 100.
  • the household appliance 1 is provided with a voice device 2 and a control device 3.
  • FIG. 1 is a schematic diagram of the system for controlling a household appliance by using voice.
  • the system further includes: a voice collecting module 21 disposed on the voice device 2, configured to collect a voice signal input by a user; a wireless communication module 31 disposed on the control device 3, in a wireless communication connection to the cloud server 100, configured to: send the voice signal to the cloud server 100 for identification, and receive a control instruction and instruction confirmation information that match the voice signal and fed back by the cloud server 100; and a voice output module 22 disposed on the voice device 2, configured to output the instruction confirmation information in a voice signal manner to ask for feedback information of the user, where the control device 3 is instructed, according to the feedback information, whether to execute the control instruction.
  • a voice collecting module 21 disposed on the voice device 2, configured to collect a voice signal input by a user
  • a wireless communication module 31 disposed on the control device 3, in a wireless communication connection to the cloud server 100, configured to: send the voice signal to the cloud server 100 for identification, and receive a control instruction and instruction confirmation information that match the voice signal and fed back by the cloud server 100
  • a voice output module 22 disposed
  • the household appliance 1 is a washing machine, and when the user needs to perform a special washing operation, for example, gives voice "Dehydrate only for ten minutes", the voice collecting module 21 collects the voice signal, and transmits the voice signal to the cloud server 100 by using the wireless communication module 31 disposed on the control device 3.
  • the voice collecting module 21 includes a conversion component that converts an acoustic signal into an electrical signal, for example, a microphone.
  • the voice collecting module 21 may further include a voice processing unit, configured to perform digital processing and noise reduction on the voice signal, to facilitate transmission performed by the wireless communication module 31.
  • the wireless communication module 31 may be directly or indirectly connected to the cloud server, and specifically includes, but is not limited to, wireless transmission manners such as WIFI, Bluetooth, and Zigbee, for data or instruction transmission.
  • wireless transmission manners such as WIFI, Bluetooth, and Zigbee
  • the cloud server 100 After receiving the voice signal, the cloud server 100 identifies the voice signal, matches the identified voice signal "Dehydrate only for ten minutes" with a control instruction stored in the cloud, or recalculates a corresponding control instruction, and then sends the control instruction and instruction confirmation information to the wireless communication module 31.
  • the instruction confirmation information is output in a voice signal manner by using the voice output module 32 to ask for feedback information of the user.
  • control device 3 executes the control instruction; or when the feedback information does not conform to user semantics, the control device 3 does not execute the control instruction.
  • control device 3 controls the voice output module 32 to instruct the user in a voice signal manner to re- input a voice signal.
  • An existing household appliance includes a voice identification module, and needs a smart voice neural network processing chip and a local storage unit.
  • the local storage unit needs storage space to store a lot of command words and corresponding control instructions, but still cannot completely meet diversified semantic requirements of users.
  • the washing machine in this embodiment is not provided with a voice identification module with relatively high costs, but directly identifies user voice online by using the cloud server 100, obtains the control instruction and the instruction confirmation information according to the user semantics, and notifies the user of the instruction confirmation information in a voice manner.
  • a voice identification module and a storage unit do not need to be mounted in the household appliance, thereby reducing costs.
  • control device 3 determines whether to execute the control instruction. Therefore, it can be ensured that a user requirement is accurately expressed, and no misoperation is generated, and this is more secure and reliable.
  • the washing machine 1 may be provided with a feedback key 4, the feedback information is a key signal generated by the user by triggering different feedback keys 4, and the control device 3 determines, according to different key signals, whether the feedback information conforms to the user semantics.
  • the user may still give a feedback by using voice.
  • the feedback information is a voice feedback signal of the user
  • the voice collecting module 21 collects the voice feedback signal and sends the voice feedback signal to the cloud server 100 by using the wireless communication module 31 for identification
  • the cloud server 100 identifies and determines whether the feedback information conforms to the user semantics, and notifies the control device 3 of a determining result
  • the control device 3 executes the control instruction according to the determining result or controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 not to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal.
  • FIG. 3 is a flowchart of the method for voice controlling a household appliance.
  • the control method is applied to a washing machine end, and corresponds to the foregoing system for voice controlling a household appliance.
  • a washing machine is in a communication connection to a cloud server, the washing machine includes a control device 3 and a voice device 2, a wireless communication module 31 in a wireless communication connection to the cloud server 100 is disposed on the control device 3, and the voice device 2 includes a voice collecting module 21 and a voice output module 22.
  • the method includes the following steps:
  • Step S102 Collect, by using the voice collecting module 21 , a voice signal input by a user.
  • Step S104 Send the voice signal to the cloud server 100 by using the wireless communication module 31 for identification.
  • Step S106 Receive, by using the wireless communication module 31 , a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server 100.
  • Step S108 Output the instruction confirmation information in a voice signal manner by using the voice output module 22, and ask for feedback information of the user.
  • Step S110 Instruct, according to the feedback information, the control device 3 whether to execute the control instruction.
  • control device 3 executes the control instruction; or when the feedback information does not conform to user semantics, the control device 3 does not execute the control instruction.
  • control device 3 controls the voice output module 32 to instruct the user in a voice signal manner to re- input a voice signal.
  • the washing machine 1 may be provided with a feedback key 4, the feedback information is a key signal generated by the user by triggering different feedback keys 4, and the control device 3 determines, according to different key signals, whether the feedback information conforms to the user semantics. If the feedback information conforms to the user semantics, it is directly confirmed by using the key, so that the program design is more simple and direct.
  • FIG. 4 is a preferred flowchart of a method for voice controlling a household appliance. As shown in FIG. 4, following the foregoing steps, the method further includes:
  • Step S1 Collect the voice feedback signal by using the voice collecting module 21.
  • Step S114 Send the voice feedback signal to the cloud server 100 by using the wireless communication module 31 for identification and determining.
  • Step S116 Receive, by using the wireless communication module 31, a determining result fed back by the cloud server 100.
  • Step S118. choose, by the control device 3 according to the determining result, to execute the control instruction or control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 not to execute the control instruction.
  • the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Theoretical Computer Science (AREA)
  • Control Of Washing Machine And Dryer (AREA)
  • Telephonic Communication Services (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The present invention provides a household appliance and a method and system for voice controlling the household appliance. The household appliance includes a control device and a voice device, a wireless communication module in a wireless communication connection to a cloud server is disposed on the control device, and the voice device includes a voice collecting module and a voice output module. The method includes the following steps: collecting, by using the voice collecting module, a voice signal input by a user; sending the voice signal to the cloud server by using the wireless communication module for identification; receiving, by using the wireless communication module, a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; outputting the instruction confirmation information in a voice signal manner by using the voice output module, and asking for feedback information of the user; and instructing, according to the feedback information, the control device whether to execute the control instruction.

Description

HOUSEHOLD APPLIANCE AND METHOD AND SYSTEM FOR VOICE CONTROLLING HOUSEHOLD APPLIANCE
BACKGROUND
Technical Field
The present invention relates to the field of household appliances, and specifically to voice control of a household appliance.
Related Art
With development of voice identification technologies, household appliances controlled by using voice have entered daily life of users. At present, a voice controlled household appliance in the market generally uses several methods: one is connecting the household appliance to a mobile phone by using WIFI, and performing voice control on the household appliance by using a mobile APP, which is complex in operation; and one is adding a voice identification module and a voice database on the household appliance, and also combining online identification, but costs are relatively high.
SUMMARY
The present invention provides a more convenient household appliance with low costs and a method and a system for voice controlling the household appliance, where the household appliance may be a refrigerator, a washing machine, an oven, or the like.
To achieve the objective, according to one aspect of the present invention, a method for voice controlling a household appliance is provided. The household appliance includes a control device and a voice device, a wireless communication module in a wireless communication connection to a cloud server is disposed on the control device, and the voice device includes a voice collecting module and a voice output module. The method includes the following steps: collecting, by using the voice collecting module, a voice signal input by a user; sending the voice signal to the cloud server by using the wireless communication module for identification; receiving, by using the wireless communication module, a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; outputting the instruction confirmation information in a voice signal manner by using the voice output module, and asking for feedback information of the user; and instructing, according to the feedback information, the control device whether to execute the control instruction.
Different from the prior art, the foregoing household appliance is not provided with a voice identification module with relatively high costs, but directly identifies user voice online by using the cloud server, obtains the control instruction and the instruction confirmation information according to user semantics, and notifies the user of the instruction confirmation information in a voice manner, and only after the user confirms the instruction confirmation information and gives a feedback, the control device executes the control instruction. It is avoided that a control instruction not conforming to the user's real meaning is generated due to user's pronunciation or grammatical mistake, and this is more accurate.
Preferably, when the feedback information conforms to user semantics, the control device executes the control instruction; or when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
Preferably, when the feedback information does not conform to the user semantics, the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
Preferably, the feedback information is a key signal generated by the user by triggering different feedback keys, and the control device determines, according to different key signals, whether the feedback information conforms to the user semantics. If the user performs a near-distance operation, whether the feedback information conforms to the user semantics may be directly confirmed by using a key, and the program design is more simple and direct. The key may be a physical key or a virtual key on a touchscreen. Preferably, the feedback information is a voice feedback signal of the user, and the method includes: collecting the voice feedback signal by using the voice collecting module; sending the voice feedback signal to the cloud server by using the wireless communication module for identification and determining; receiving, by using the wireless communication module, a determining result fed back by the cloud server; and choosing, by the control device according to the determining result, to execute the control instruction or control the voice output module to inform the user in a voice signal manner to re-input a voice signal.
According to another aspect of the present invention, a household appliance is provided. The household appliance is voice controlled by using the foregoing method.
The present invention further provides a system for voice controlling a household appliance, including at least one household appliance and a cloud server. The household appliance is provided with a voice device and a control device, including: a voice collecting module disposed on the voice device, configured to collect a voice signal input by a user; a wireless communication module disposed on the control device, in a wireless communication connection to the cloud server, and configured to: send the voice signal to the cloud server for identification, and receive a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; and a voice output module disposed on the voice device, configured to output the instruction confirmation information in a voice signal manner to ask for feedback information of the user, where the control device is instructed, according to the feedback information, whether to execute the control instruction.
Preferably, when the feedback information conforms to user semantics, the control device executes the control instruction; or when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
Preferably, when the feedback information does not conform to the user semantics, the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal. Preferably, the household appliance is provided with a feedback key, the feedback information is a key signal generated by the user by triggering different feedback keys, and the control device determines, according to different key signals, whether the feedback information conforms to the user semantics. If the user performs a near- distance operation, whether the feedback information conforms to the user semantics may be directly confirmed by using a key, and the program design is more simple and direct.
Preferably, the feedback information is a voice feedback signal of the user; the voice collecting module collects the voice feedback signal and sends the voice feedback signal to the cloud server by using the wireless communication module for identification, and the cloud server identifies and determines whether the feedback information conforms to the user semantics, and notifies the control device of a determining result; and the control device executes the control instruction according to the determining result or controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
By means of the present invention, a problem in the prior art that a voice control solution of a household appliance is inconvenient and has high costs is resolved, and in the household appliance of the present invention, no additional voice identification device needs to be disposed, thereby reducing costs of the household appliance.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings described herein are used for providing further understanding of the present invention, and form a part of this application. Exemplary embodiments of the present invention and descriptions of the exemplary embodiments are used for explaining the present invention, and do not form an improper limitation to the present invention. In the accompanying drawings:
FIG. 1 is a schematic diagram of a system for voice controlling a household appliance;
FIG. 2 is a structural diagram of a system for voice controlling a household appliance;
FIG. 3 is a flowchart of a method for voice controlling a household appliance; and FIG. 4 is a preferred flowchart of a method for voice controlling a household appliance.
DETAILED DESCRIPTION
The following describes the present invention in detail with reference to the accompanying drawings and in combination with embodiments. It should be noted that, the embodiments in this application and features in the embodiments may be combined with each other without conflict.
An embodiment of the present invention provides a system for voice controlling a household appliance, including at least one household appliance 1 and a cloud server 100. The household appliance 1 is provided with a voice device 2 and a control device 3. FIG. 1 is a schematic diagram of the system for controlling a household appliance by using voice. The system further includes: a voice collecting module 21 disposed on the voice device 2, configured to collect a voice signal input by a user; a wireless communication module 31 disposed on the control device 3, in a wireless communication connection to the cloud server 100, configured to: send the voice signal to the cloud server 100 for identification, and receive a control instruction and instruction confirmation information that match the voice signal and fed back by the cloud server 100; and a voice output module 22 disposed on the voice device 2, configured to output the instruction confirmation information in a voice signal manner to ask for feedback information of the user, where the control device 3 is instructed, according to the feedback information, whether to execute the control instruction.
The household appliance 1 is a washing machine, and when the user needs to perform a special washing operation, for example, gives voice "Dehydrate only for ten minutes", the voice collecting module 21 collects the voice signal, and transmits the voice signal to the cloud server 100 by using the wireless communication module 31 disposed on the control device 3.
The voice collecting module 21 includes a conversion component that converts an acoustic signal into an electrical signal, for example, a microphone. By using the prior art, the voice collecting module 21 may further include a voice processing unit, configured to perform digital processing and noise reduction on the voice signal, to facilitate transmission performed by the wireless communication module 31.
The wireless communication module 31 may be directly or indirectly connected to the cloud server, and specifically includes, but is not limited to, wireless transmission manners such as WIFI, Bluetooth, and Zigbee, for data or instruction transmission.
After receiving the voice signal, the cloud server 100 identifies the voice signal, matches the identified voice signal "Dehydrate only for ten minutes" with a control instruction stored in the cloud, or recalculates a corresponding control instruction, and then sends the control instruction and instruction confirmation information to the wireless communication module 31. The instruction confirmation information is output in a voice signal manner by using the voice output module 32 to ask for feedback information of the user.
When the feedback information conforms to user semantics, the control device 3 executes the control instruction; or when the feedback information does not conform to user semantics, the control device 3 does not execute the control instruction. In addition, when the feedback information does not conform to the user semantics, the control device 3 controls the voice output module 32 to instruct the user in a voice signal manner to re- input a voice signal.
An existing household appliance includes a voice identification module, and needs a smart voice neural network processing chip and a local storage unit. The local storage unit needs storage space to store a lot of command words and corresponding control instructions, but still cannot completely meet diversified semantic requirements of users.
Different from the prior art, the washing machine in this embodiment is not provided with a voice identification module with relatively high costs, but directly identifies user voice online by using the cloud server 100, obtains the control instruction and the instruction confirmation information according to the user semantics, and notifies the user of the instruction confirmation information in a voice manner. In this way, a voice identification module and a storage unit do not need to be mounted in the household appliance, thereby reducing costs.
Meanwhile, because user's pronunciation or grammatical mistake may generate a control instruction not conforming to user's real meaning, in the foregoing solution, only after the user confirms the instruction confirmation information and gives a feedback, the control device 3 determines whether to execute the control instruction. Therefore, it can be ensured that a user requirement is accurately expressed, and no misoperation is generated, and this is more secure and reliable.
If the user is at a position close to the washing machine, the user can implement a near- distance operation. The washing machine 1 may be provided with a feedback key 4, the feedback information is a key signal generated by the user by triggering different feedback keys 4, and the control device 3 determines, according to different key signals, whether the feedback information conforms to the user semantics.
If the feedback information conforms to the user semantics, it is directly confirmed, so that the program design is more simple and direct.
If the user is at a position far from the washing machine, or it is inconvenient to perform an operation with hands, the user may still give a feedback by using voice. In this case, the feedback information is a voice feedback signal of the user, the voice collecting module 21 collects the voice feedback signal and sends the voice feedback signal to the cloud server 100 by using the wireless communication module 31 for identification, and the cloud server 100 identifies and determines whether the feedback information conforms to the user semantics, and notifies the control device 3 of a determining result; and the control device 3 executes the control instruction according to the determining result or controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal. When the determining result of the feedback information is that the feedback information conforms to the user semantics, the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to execute the control instruction. When the determining result of the feedback information is that the feedback information does not conform to the user semantics, the cloud server 100 instructs the control device 3 by using the wireless communication module 31 not to execute the control instruction. When the feedback information does not conform to the user semantics, the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal.
An embodiment of the present invention further provides a method for voice controlling a household appliance. FIG. 3 is a flowchart of the method for voice controlling a household appliance. As shown in FIG. 3, the control method is applied to a washing machine end, and corresponds to the foregoing system for voice controlling a household appliance. A washing machine is in a communication connection to a cloud server, the washing machine includes a control device 3 and a voice device 2, a wireless communication module 31 in a wireless communication connection to the cloud server 100 is disposed on the control device 3, and the voice device 2 includes a voice collecting module 21 and a voice output module 22. The method includes the following steps:
Step S102. Collect, by using the voice collecting module 21 , a voice signal input by a user.
Step S104. Send the voice signal to the cloud server 100 by using the wireless communication module 31 for identification.
Step S106. Receive, by using the wireless communication module 31 , a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server 100.
Step S108. Output the instruction confirmation information in a voice signal manner by using the voice output module 22, and ask for feedback information of the user. Step S110. Instruct, according to the feedback information, the control device 3 whether to execute the control instruction.
When the feedback information conforms to user semantics, the control device 3 executes the control instruction; or when the feedback information does not conform to user semantics, the control device 3 does not execute the control instruction. In addition, when the feedback information does not conform to the user semantics, the control device 3 controls the voice output module 32 to instruct the user in a voice signal manner to re- input a voice signal.
If the user is at a position close to the washing machine, the user can implement a near- distance operation. The washing machine 1 may be provided with a feedback key 4, the feedback information is a key signal generated by the user by triggering different feedback keys 4, and the control device 3 determines, according to different key signals, whether the feedback information conforms to the user semantics. If the feedback information conforms to the user semantics, it is directly confirmed by using the key, so that the program design is more simple and direct.
In a preferred solution, if the user is at a position far from the washing machine, or it is inconvenient to perform an operation with hands, the user may still give a feedback in a voice manner. In this case, the feedback information is a voice feedback signal of the user. FIG. 4 is a preferred flowchart of a method for voice controlling a household appliance. As shown in FIG. 4, following the foregoing steps, the method further includes:
Step S1 12. Collect the voice feedback signal by using the voice collecting module 21.
Step S114. Send the voice feedback signal to the cloud server 100 by using the wireless communication module 31 for identification and determining.
Step S116. Receive, by using the wireless communication module 31, a determining result fed back by the cloud server 100. Step S118. Choose, by the control device 3 according to the determining result, to execute the control instruction or control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal. When the determining result of the feedback information conforms to the user semantics, the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to execute the control instruction. When the determining result of the feedback information does not conform to the user semantics, the cloud server 100 instructs the control device 3 by using the wireless communication module 31 not to execute the control instruction. When the feedback information does not conform to the user semantics, the cloud server 100 instructs the control device 3 by using the wireless communication module 31 to control the voice output module 32 to instruct the user in a voice signal manner to re-input a voice signal. The various specific implementations described above and shown in the accompanying drawings are only used to describe the present invention, but not all of the present invention. Modifications in any form made to the present invention by a person of ordinary skill in the related technical field without departing from the scope of the basic technical idea of the present invention shall all fall within the protection scope of the present invention.

Claims

CLAIMS What is claimed is:
1. A method for voice controlling a household appliance, wherein the household appliance comprises a control device and a voice device, a wireless communication module in a wireless communication connection to a cloud server is disposed on the control device, and the voice device comprises a voice collecting module and a voice output module, characterized by comprising the following steps:
collecting, by using the voice collecting module, a voice signal input by a user;
sending the voice signal to the cloud server by using the wireless communication module for identification; and receiving, by using the wireless communication module, a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server;
outputting the instruction confirmation information in a voice signal manner by using the voice output module, and asking for feedback information of the user; and
instructing, according to the feedback information, the control device whether to execute the control instruction.
2. The method according to claim 1 , characterized in that
when the feedback information conforms to user semantics, the control device executes the control instruction; or
when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
3. The method according to claim 2, characterized in that
when the feedback information does not conform to the user semantics, the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
4. The method according to claim 2 or 3, characterized in that the feedback information is a key signal generated by the user by triggering different feedback keys, and the control device determines, according to different key signals, whether the feedback information conforms to the user semantics.
5. The method according to claim 3, characterized in that the feedback information is a voice feedback signal of the user, and the method further comprises:
collecting the voice feedback signal by using the voice collecting module;
sending the voice feedback signal to the cloud server by using the wireless communication module for identification and determining;
receiving, by using the wireless communication module, a determining result fed back by the cloud server; and
choosing, by the control device according to the determining result, to execute the control instruction or control the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
6. A voice controlled household appliance, characterized in that
the household appliance implements voice control by using the method according to any one of claims 1 to 5.
7. A system for voice controlling a household appliance, comprising at least one household appliance and a cloud server, wherein the household appliance is provided with a voice device and a control device, characterized by comprising:
a voice collecting module disposed on the voice device, configured to collect a voice signal input by a user; a wireless communication module disposed on the control device, in a wireless communication connection to the cloud server, and configured to: send the voice signal to the cloud server for identification, and receive a control instruction and instruction confirmation information that match the voice signal and that are fed back by the cloud server; and
a voice output module disposed on the voice device, configured to output the instruction confirmation information in a voice signal manner to ask for feedback information of the user, wherein
the control device is instructed, according to the feedback information, whether to execute the control instruction.
8. The system according to claim 7, characterized in that
when the feedback information conforms to user semantics, the control device executes the control instruction; or
when the feedback information does not conform to user semantics, the control device does not execute the control instruction.
9. The system according to claim 8, characterized in that
when the feedback information does not conform to the user semantics, the control device controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
10. The system according to claim 8 or 9, characterized in that
the household appliance is provided with a feedback key, the feedback information is a key signal generated by the user by triggering different feedback keys, and the control device determines, according to different key signals, whether the feedback information conforms to the user semantics.
11. The system according to claim 9, characterized in that
the feedback information is a voice feedback signal of the user;
the voice collecting module collects the voice feedback signal and sends the voice feedback signal to the cloud server by using the wireless communication module for identification, and the cloud server identifies and determines whether the feedback information conforms to the user semantics, and notifies the control device of a determining result; and
the control device executes the control instruction according to the determining result or controls the voice output module to instruct the user in a voice signal manner to re-input a voice signal.
EP18833709.1A 2018-01-26 2018-12-07 Household appliance and method and system for voice controlling household appliance Pending EP3743914A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810075595.5A CN110085219A (en) 2018-01-26 2018-01-26 Household electrical appliance and method and system by the voice control household electrical appliance
PCT/IB2018/059760 WO2019145769A1 (en) 2018-01-26 2018-12-07 Household appliance and method and system for voice controlling household appliance

Publications (1)

Publication Number Publication Date
EP3743914A1 true EP3743914A1 (en) 2020-12-02

Family

ID=65019544

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18833709.1A Pending EP3743914A1 (en) 2018-01-26 2018-12-07 Household appliance and method and system for voice controlling household appliance

Country Status (3)

Country Link
EP (1) EP3743914A1 (en)
CN (1) CN110085219A (en)
WO (1) WO2019145769A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210012266A (en) * 2019-07-24 2021-02-03 현대자동차주식회사 Hub-dialogue system, method for controlling the same and electronic apparatus
CN110570855A (en) * 2019-08-28 2019-12-13 珠海格力电器股份有限公司 system, method and device for controlling intelligent household equipment through conversation mechanism
CN111292746A (en) * 2020-02-07 2020-06-16 普强时代(珠海横琴)信息技术有限公司 Voice input conversion system based on human-computer interaction
CN111221262A (en) * 2020-03-30 2020-06-02 重庆特斯联智慧科技股份有限公司 Self-adaptive intelligent household adjusting method and system based on human body characteristics
CN112562734B (en) * 2020-11-25 2021-08-27 中检启迪(北京)科技有限公司 Voice interaction method and device based on voice detection

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7949529B2 (en) * 2005-08-29 2011-05-24 Voicebox Technologies, Inc. Mobile systems and methods of supporting natural language human-machine interactions
CN202453859U (en) * 2011-12-20 2012-09-26 安徽科大讯飞信息科技股份有限公司 Voice interaction device for home appliance
WO2014171144A1 (en) * 2013-04-19 2014-10-23 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Control method for household electrical appliance, household electrical appliance control system, and gateway
US10726831B2 (en) * 2014-05-20 2020-07-28 Amazon Technologies, Inc. Context interpretation in natural language processing using previous dialog acts
CN104110895A (en) * 2014-07-28 2014-10-22 芜湖美的厨卫电器制造有限公司 Water heater system, water heater, controller method of water heater, intelligent terminal and server
CN105898584A (en) * 2015-08-12 2016-08-24 乐视致新电子科技（天津）有限公司 Voice message feedback method and device and television set
CN105329187B (en) * 2015-11-05 2018-06-22 深圳市几米软件有限公司 The intelligent vehicle-mounted system and control method of safety operation are realized in Bluetooth key triggering
CN105929700A (en) * 2016-04-26 2016-09-07 海信（山东）空调有限公司 Intelligent control method and device
CN106292321A (en) * 2016-08-30 2017-01-04 无锡小天鹅股份有限公司 Washing machine and control method thereof and control system
CN106385347A (en) * 2016-09-09 2017-02-08 珠海格力电器股份有限公司 Household appliance control method and device
CN106452997A (en) * 2016-09-30 2017-02-22 无锡小天鹅股份有限公司 Household electrical appliance and control system thereof
CN206117701U (en) * 2016-09-30 2017-04-19 无锡小天鹅股份有限公司 Domestic appliance and control system thereof
CN107220292A (en) * 2017-04-25 2017-09-29 上海庆科信息技术有限公司 Intelligent dialogue device, reaction type intelligent sound control system and method
CN107274902A (en) * 2017-08-15 2017-10-20 深圳诺欧博智能科技有限公司 Phonetic controller and method for household electrical appliances

Also Published As

Publication number Publication date
WO2019145769A1 (en) 2019-08-01
CN110085219A (en) 2019-08-02

Similar Documents

Publication Publication Date Title
WO2019145769A1 (en) Household appliance and method and system for voice controlling household appliance
CN106019993B (en) Cooking system
RU2605578C1 (en) Method and device for controlling intelligent device basing on preliminarily specified scenario mode
CN106385347A (en) Household appliance control method and device
CN104808559B (en) A kind of wireless switching control method, system and relevant device
CN103945046A (en) Photographing control method and control device
WO2018041029A1 (en) Smart router for home voice control centre, and signal transmission method therefor
US20160132029A1 (en) Method for configuring and controlling smart home products
CN107615775A (en) Method, terminal and the noise cancelling headphone of noise cancelling headphone are set
CN103885350A (en) Method and device for voice control over household appliances
US10481569B2 (en) Household appliance control method and device, and central processing device
CN103914972A (en) Household electrical appliance control device and infrared learning method thereof
JP6612464B2 (en) System and method for managing customizable configurations of hearing aids
CN104090480B (en) Intelligent alarm clock
CN105185094A (en) Intelligent voice remote controller
WO2019184585A1 (en) Home appliance control method and system based on wi-fi sensing
CN106707978B (en) Method for transferring intelligent household control right through address book and address book
CN109884913A (en) Control method, Intelligent control equipment and the system of split type household appliance
CN107181991B (en) Wireless microphone and central control system of wireless microphone system
CN106790936B (en) Call mode switching method and wearable device
CN106023566B (en) Bluetooth remote control device, system and method based on voice recognition
CN204965739U (en) Intelligent voice remote controller
CN204350220U (en) A kind of remote controller and control system
RU2009136414A (en) DEVICE AND METHOD FOR CONTROL AND CONTROL OF HOUSEHOLD APPLIANCES
CN105867143A (en) Speech box and speech box pairing method

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200826

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20220622

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN