CN105913839A - Intelligent refrigerator, server and voice control system and method - Google Patents

Intelligent refrigerator, server and voice control system and method Download PDF

Info

Publication number
CN105913839A
CN105913839A CN201610384412.9A CN201610384412A CN105913839A CN 105913839 A CN105913839 A CN 105913839A CN 201610384412 A CN201610384412 A CN 201610384412A CN 105913839 A CN105913839 A CN 105913839A
Authority
CN
China
Prior art keywords
voice signal
voice
module
intelligent refrigerator
password
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610384412.9A
Other languages
Chinese (zh)
Inventor
杨世清
王岩
陈海雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Midea Intelligent Technologies Co Ltd
Original Assignee
Hefei Hualing Co Ltd
Midea Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Hualing Co Ltd, Midea Group Co Ltd filed Critical Hefei Hualing Co Ltd
Priority to CN201610384412.9A priority Critical patent/CN105913839A/en
Publication of CN105913839A publication Critical patent/CN105913839A/en
Priority to PCT/CN2017/084959 priority patent/WO2017206725A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/4185—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by the network communication
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00—Problems to be solved
    • F25D2500/06—Stock management
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/26—Pc applications
    • G05B2219/2642—Domotique, domestic, home control, automation, smart house
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Manufacturing & Machinery (AREA)
  • Devices That Are Associated With Refrigeration Equipment (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The invention relates to an intelligent refrigerator, a server and a voice control system and method. The intelligent refrigerator comprises a main control module and a voice module, wherein the voice module is used for collecting voice signals and transmitting the voice signals to the main control module; and the main control module is used for determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signals according to the voice signals and a pre-stored password set. According to the voice signals transmitted by the voice module and the preset password set, the main control module determines whether to control the intelligent refrigerator to execute the operation corresponding to the voice signals, offline identification of the voice signals is realized, the identification accuracy of the voice signals is improved, and the timeliness problem of voice signal identification is solved.

Description

Intelligent refrigerator, server and voice control system and method
Technical Field
The invention relates to the technical field of intelligent refrigerators, in particular to an intelligent refrigerator, a server, a voice control system and a voice control method.
Background
With the unprecedented development of integrated circuits, artificial intelligence and internet technology, the refrigerator only needs to have the function of storing food, becomes a part of a home network, and can provide more intelligent services for family members. However, the control mode of the traditional refrigerator cannot meet the requirement of more convenient human-computer interaction of the intelligent refrigerator, and the voice control technology cannot be widely applied to the household appliance industry due to the problems of poor real-time performance, low recognition rate, low reliability and the like.
Disclosure of Invention
The invention aims to solve the technical problem of the prior art and provides an intelligent refrigerator, a server, a voice control system and a voice control method.
The technical scheme for solving the technical problems is as follows: an intelligent refrigerator comprising: the voice module is used for acquiring voice signals and transmitting the voice signals to the main control module; the main control module is used for determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal according to the voice signal transmitted by the voice module and a pre-stored password set.
The invention has the beneficial effects that: the main control module determines whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the voice signal transmitted by the voice module and the pre-stored password set, so that the off-line recognition of the voice signal can be realized, the accuracy of the voice signal recognition is improved, and the problem of instantaneity of the voice signal recognition is solved.
On the basis of the technical scheme, the invention can be further improved as follows.
Further, the main control module is specifically configured to: matching the voice signal with the password in the password set to obtain a matching result; and determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the matching result.
Further, the main control module is further configured to send the voice signal and the matching result to a server connected to the main control module, so that the server updates the password set according to the voice signal and the matching result.
The beneficial effect of adopting the further scheme is that: online updating of the password set may be implemented.
Further, the main control module is further configured to receive an updated password set sent by the server, and replace a pre-stored password set according to the updated password set.
The beneficial effect of adopting the further scheme is that: the identification capability of the main control module to the password in the password set can be continuously improved.
Further, the password set comprises a plurality of password subsets, and each password subset consists of passwords with different voices but identical semantics.
Another technical solution of the present invention for solving the above technical problems is as follows: a server, comprising: the receiving module is used for receiving a voice signal sent by a main control module of the intelligent refrigerator and a matching result corresponding to the voice signal; the updating module is used for updating a pre-stored password set according to the voice signal received by the receiving module and the matching result; and the sending module is used for sending the password set updated by the updating module to the intelligent refrigerator.
The invention has the beneficial effects that: by receiving the voice signal sent by the main control module of the intelligent refrigerator and the matching result corresponding to the voice signal and updating the pre-stored password set according to the voice signal and the matching result, the online updating of the password set can be realized, and the recognition capability of the main control module on the password in the password set is improved.
On the basis of the technical scheme, the invention can be further improved as follows.
Further, the server further includes: the recognition module is used for carrying out automatic voice recognition on the voice signal and obtaining a recognition result; the sending module is also used for sending the result identified by the identification module to the intelligent refrigerator.
The beneficial effect of adopting the further scheme is that: online speech recognition can be implemented.
Another technical solution of the present invention for solving the above technical problems is as follows: a voice control system, comprising: the intelligent refrigerator comprises a communication module, the intelligent refrigerator in the embodiment and a server in the embodiment, wherein the intelligent refrigerator is connected with the server through the communication module.
The invention has the beneficial effects that: the method comprises the steps that a voice signal transmitted by a voice module is matched with a password in a password set through a main control module of the intelligent refrigerator to obtain a matching result, the voice signal and the matching result are sent to a server through a communication module, the server updates a prestored password set according to the voice signal and the matching result and sends the updated password set to the intelligent refrigerator, the intelligent refrigerator receives the voice signal and replaces the originally prestored password set according to the updated password set, online updating of the password set can be achieved, and the recognition capability of the main control module on the password in the password set is constantly improved.
Another technical solution of the present invention for solving the above technical problems is as follows: a voice control method, comprising the steps of: step 1, collecting voice signals; and 2, determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the voice signal and a prestored password set.
The invention has the beneficial effects that: whether the intelligent refrigerator is controlled to execute the operation corresponding to the voice signal or not is determined according to the collected voice signal and the pre-stored password set, so that the off-line recognition of the voice signal can be realized, the accuracy of the voice signal recognition is improved, and the problem of instantaneity of the voice signal recognition is solved.
Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a schematic structural block diagram of an intelligent refrigerator according to an embodiment of the present invention;
fig. 2 is a schematic structural block diagram of a server according to the embodiment of the present invention;
fig. 3 is a schematic block diagram of a voice control system according to an embodiment of the present invention;
FIG. 4 is a schematic flow chart of a voice control method according to an embodiment of the present invention;
fig. 5 is a schematic flowchart of a voice control method according to another embodiment of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
Fig. 1 shows a schematic structural block diagram of an intelligent refrigerator 100 according to an embodiment of the present invention. The smart refrigerator 100 shown in fig. 1 includes: a main control module 110 and a voice module 120. The voice module 120 is configured to collect a voice signal and transmit the collected voice signal to the main control module 110; the main control module 110 is configured to determine whether to control the intelligent refrigerator 100 to perform an operation corresponding to the voice signal according to the voice signal transmitted by the voice module 120 and a pre-stored password set.
Specifically, in this embodiment, the speech module 120 may employ a microphone array. The voice module 120 has functions of collecting voice signals and preprocessing the voice signals, and the voice module 120 preprocesses the voice signals, including but not limited to noise reduction processing, echo cancellation processing, reverberation reduction processing, sound source localization processing, and blind source separation processing.
The password set pre-stored in the main control module 110 comes from a server connected with the intelligent refrigerator. The password set comprises a plurality of password subsets, each password subset consisting of passwords with different voices but the same semantics. For example: the 'open door' and 'please open door' are two passwords with different voices and the same semantics, which belong to one password subset, and the 'mediate temperature' and 'please adjust temperature' are passwords with different voices and the same semantics, which belong to the other password subset.
According to the intelligent refrigerator provided by the embodiment, whether the intelligent refrigerator is controlled to execute the operation corresponding to the voice signal is determined according to the voice signal transmitted by the voice module and the pre-stored password set through the main control module, so that the off-line recognition of the voice signal can be realized, the accuracy of the voice signal recognition is improved, and the real-time problem of the voice signal recognition is solved.
Optionally, as an embodiment of the present invention, the main control module 110 is specifically configured to: and matching the voice signal transmitted by the voice module 120 with the password in the password set to obtain a matching result, and determining whether to control the intelligent refrigerator 100 to execute the operation corresponding to the voice signal according to the matching result.
For example: the voice signal is a 'door opening' password, when the 'door opening' password is matched with the password in the password set, the intelligent refrigerator 100 is controlled to open the refrigerator door, otherwise, the intelligent refrigerator does not execute the operation of opening the refrigerator door.
According to the intelligent refrigerator provided by the embodiment, the voice signal transmitted by the voice module is matched with the password in the password set through the main control module to obtain the matching result, and whether the intelligent refrigerator is controlled to execute the operation corresponding to the voice signal or not is determined according to the matching result, so that the off-line recognition of the voice signal can be realized, the accuracy of the voice signal recognition is improved, and the real-time problem of the voice signal recognition is solved.
Optionally, as another embodiment of the present invention, the main control module 110 is further configured to send a voice signal and a matching result to a server connected thereto, so that the server updates the password set according to the voice signal and the matching result.
For example: the password corresponding to the voice signal is "open door", and when the "open door" password is matched with the password in the password set, the intelligent refrigerator 100 is controlled to open the refrigerator door. And simultaneously sending the voice signal and the matched matching result to the server, and receiving the voice signal and the matched matching result by the server and updating the password set. Namely: and updating the 'door opening' password in the original password set.
If the door opening password is not matched with the password in the password set, the intelligent refrigerator does not execute the operation of opening the refrigerator door. And simultaneously sending the voice signal and the unmatched matching result to the server, receiving the voice signal and the unmatched matching result by the server, and updating the password set. Namely: adding the 'door opening' password to an existing password subset, wherein the password subset comprises a password which is different from the 'door opening' password in voice but has the same semantic meaning. Or when the password set does not have a password subset composed of passwords which are different from the 'door opening' password voice but have the same semantic meaning, a password subset set can be added according to the 'door opening' password.
Specifically, in this embodiment, the main control module 110 is further configured to receive an updated password set sent by the server, and replace an original pre-stored password set according to the updated password set.
According to the intelligent refrigerator provided by the embodiment, the voice signal transmitted by the voice module is matched with the password in the password set through the main control module to obtain the matching result, the voice signal and the matching result are sent to the server connected with the main control module, the updated password set sent by the server is received, the original pre-stored password set is replaced according to the updated password set, the online updating of the password set can be realized, and the recognition capability of the main control module on the password in the password set is continuously improved.
Optionally, as an embodiment of the present invention, after the power is turned on, the main control module 110 is in a sleep state, and the voice module 120 is in a working state. The main control module 110 is further configured to match the voice signal with the wake-up password in the password set, and determine whether to enter a scanning state according to a matching result.
Specifically, in this embodiment, if the two signals match, it is determined that the main control module 110 enters the scanning state; otherwise, the main control module 110 continues to be in the sleep state.
When the main control module 110 enters the scanning state, the main control module 110 is further configured to provide a confirmation voice message to the user, and determine whether to enter the activation state according to whether a feedback voice signal of the user collected by the voice module can be received within a first preset time period.
Specifically, in this embodiment, if the feedback voice signal is received within the first preset time period, it is determined that the main control module 110 enters the activated state; otherwise, the main control module 110 continues to be in the sleep state.
After the main control module 110 enters the activated state, the main control module 110 is further configured to detect whether the voice signal collected by the voice module 120 can be received within a second preset time period; if the voice signal is received within a second preset time period, determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the voice signal and the password set; otherwise, the main control module 110 continues to be in the sleep state.
For example: in this embodiment, after the intelligent refrigerator 100 is powered on, the main control module 110 is in a sleep state, and the voice module 120 is in an operating state. After the voice module 120 collects the voice signal, the voice signal is transmitted to the main control module 110, and the main control module 110 transmits a password corresponding to the voice signal, such as: "i love my home", match with the wake-up password in the password set, if match, the main control module 110 enters the scanning state; otherwise, the sleep state is continued.
After the main control module 110 enters the scanning state, providing the user with confirmation voice information, such as: if "you are good", a feedback voice signal is received in a first preset time period, such as: determine to enter an active state if you are good; otherwise, the sleep state is continued.
After the main control module 110 enters the activated state, it is detected whether the voice signal collected by the voice module 120 can be received within a second preset time period. If the voice signal is received in a second preset time period, the password corresponding to the voice signal is determined as follows: the temperature is adjusted, the temperature is matched with the password in the password set, and if the temperature is matched with the password, the intelligent refrigerator is controlled to execute the temperature adjusting operation; otherwise, the sleep state is continued.
According to the intelligent refrigerator provided by the embodiment, the main control module is awakened and works only when the preset condition is met, so that the effects of low power consumption and power saving can be achieved. Meanwhile, by setting the awakening password, false awakening can be eliminated, and the voice recognition performance can be effectively improved.
The intelligent refrigerator provided by the embodiment of the invention is described in detail in the above with reference to fig. 1, and the server provided by the embodiment of the invention is described in detail in the following with reference to fig. 2.
Fig. 2 is a schematic block diagram of a server 200 according to an embodiment of the present invention. The server 200 shown in fig. 2 includes: a receiving module 210, an updating module 220, and a receiving module 230. Wherein,
the receiving module 210 is configured to receive a voice signal sent by a main control module of the intelligent refrigerator and a matching result corresponding to the voice signal. The updating module 220 is used for updating the pre-stored password set according to the voice signal and the matching result received by the receiving module 210. The sending module 230 is configured to send the password set updated by the updating module 220 to the smart refrigerator. .
The server provided in the above embodiment receives the voice signal sent by the main control module of the intelligent refrigerator and the matching result corresponding to the voice signal, and updates the pre-stored password set according to the voice signal and the matching result, so that online update of the password set can be realized, and the recognition capability of the main control module on the password in the password set is improved.
It should be noted that, in this embodiment, the updating module 220 may update the voice signal received by the receiving module 210 when a preset condition is met, for example: the preset condition is that the number of the voice signals received by the receiving module 210 reaches a preset value.
Optionally, as an embodiment of the present invention, as shown in fig. 2, the server 200 further includes an identification module 240. And the recognition module 240 is configured to perform automatic speech recognition on the speech signal and obtain a recognition result. The sending module 230 is further configured to send the result identified by the identifying module 240 to the intelligent refrigerator.
Specifically, in this embodiment, the recognition module 240 may convert the voice signal into a corresponding semantic text, and then match the semantic text with a pre-stored password set to obtain a matching result, which is the recognized result.
The server provided in the above embodiment performs automatic speech recognition on a speech signal through the recognition module, and obtains a recognition result. The sending module sends the recognized result to the intelligent refrigerator, and online recognition of the voice signal can be achieved.
The invention also provides a voice control system. Fig. 3 is a schematic block diagram of a speech control system 300 according to an embodiment of the present invention.
The voice control system shown in fig. 3 includes: a smart refrigerator 310, a server 320, and a communication module 330. The intelligent refrigerator 310 may implement all functions of the intelligent refrigerator 100 by using the intelligent refrigerator 100 shown in fig. 1. Server 320 is server 200 shown in fig. 2 and may implement all functions of server 200.
Specifically, in this embodiment, the voice module 311 included in the intelligent refrigerator 310 may collect a voice signal and transmit the voice signal to the main control module 312. The main control module 312 may match the pre-stored password set, and determine whether to control the smart refrigerator 310 to perform an operation corresponding to the voice signal according to a matching result.
For example, when the password corresponding to the voice signal matches the password in the pre-stored password set, the intelligent refrigerator 310 is controlled to perform the operation corresponding to the voice signal, otherwise, the intelligent refrigerator does not perform the operation.
The main control module 312 also transmits the voice signal and the matching result to the receiving module 321 included in the server 320 through the communication module 330. The receiving module 321 receives the voice signal and the matching result transmitted by the main control module 312 through the communication module 330. The updating module 322 updates the pre-stored password set according to the voice signal and the matching result received by the receiving module 321. The sending module 323 sends the updated password set to the main control module 312 through the communication module 330.
For example: the password corresponding to the voice signal is 'please open the door', and when the 'please open the door' password matches with the password in the password set, the intelligent refrigerator 310 is controlled to open the refrigerator door. Meanwhile, the voice signal and the matching result are transmitted to the server 320 through the communication module 330, and the server 320 receives the voice signal and the matching result and updates the password "please open the door" in the password set.
If the "please open the door" password does not match the password in the password set, the intelligent refrigerator 310 does not perform the operation of opening the refrigerator door. Simultaneously, the voice signal and the unmatched matching result are sent to the server 320, and the server receives the voice signal and the unmatched matching result and determines to update the password set, namely: the "please open the door" password is added to an existing password subset that contains a different but semantically identical password than the "please open the door" password. Or when the password set does not comprise a password subset which is composed of passwords with different voices but the same semantics as the password for opening the door, a password subset set can be added according to the password for opening the door.
After the server 320 completes updating the password set, the updated password set is sent to the smart refrigerator 310 through the communication module 330. The intelligent refrigerator 310 receives the updated password set sent by the server 320, and can replace and upgrade the originally pre-stored password set according to the updated password set.
In the voice control system provided in the above embodiment, the main control module of the intelligent refrigerator matches the voice signal transmitted by the voice module with the password in the password set to obtain the matching result, the voice signal and the matching result are sent to the server through the communication module, the server updates the pre-stored password set according to the voice signal and the matching result, and sends the updated password set to the intelligent refrigerator, and the intelligent refrigerator receives and replaces the originally pre-stored password set according to the updated password set, so that online updating of the password set can be realized, and the recognition capability of the main control module on the password in the password set is constantly improved.
Optionally, as an embodiment of the present invention, the server 320 further includes an identification module 324. The recognition module 324 performs automatic speech recognition on the speech signal and obtains a recognition result. The transmitting module 323 transmits the result recognized by the recognition module 324 to the smart refrigerator.
Specifically, in this embodiment, the recognition module 324 may convert the voice signal into a corresponding semantic text, and then match the semantic text with a pre-stored password set to obtain a matching result, which is the recognized result.
The voice recognition system provided in the above embodiment performs automatic voice recognition on the voice signal through the recognition module included in the server, obtains the recognition result, and sends the recognized result to the intelligent refrigerator through the sending module, so that online recognition of the voice signal can be realized.
After the intelligent refrigerator 310 is powered on, the main control module 312 is in a dormant state, and the voice module 311 is in a working state. The main control module 312 matches the voice signal with the wake-up password in the password set, and determines whether to enter a scanning state according to a matching result. If the two signals match, the main control module 312 enters a scanning state; otherwise, the sleep state is continued.
When the main control module 312 enters the scanning state, the confirmation voice information is provided to the user, and whether the user enters the activation state is determined according to whether the feedback voice signal of the user collected by the voice module can be received within the first preset time period. If the feedback voice signal is received within the first preset time period, the main control module 312 enters an activated state; otherwise, the sleep state is continued.
After the main control module 312 enters the activated state, it is detected whether the voice signal collected by the voice module 311 can be received within a second preset time period. If the voice signal is received within a second preset time period, determining whether to control the intelligent refrigerator 310 to execute the operation corresponding to the voice signal according to the voice signal and the password in the password set; otherwise, the sleep state is continued.
According to the voice control system provided by the embodiment, the main control module of the intelligent refrigerator is awakened and works only when the preset condition is met, so that the effects of low power consumption and power saving can be achieved. Meanwhile, by setting the awakening password, false awakening can be eliminated, and the voice recognition performance can be effectively improved.
The invention also provides a voice control method. Fig. 4 is a schematic flow chart of a voice control method 400 according to an embodiment of the present invention. The execution subject of the method 400 shown in fig. 4 may be the intelligent refrigerator shown in fig. 1 described above. The method 400 includes:
410. and collecting voice signals.
420. And determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal according to the voice signal collected in the step 410 and a pre-stored password set.
It should be understood that, in the embodiment of the present invention, an execution main body of the voice control method 400 according to the embodiment of the present invention may correspond to the intelligent refrigerator 100 according to the embodiment of the present invention, and the above and other operations and/or functions of each module in the intelligent refrigerator 100 are respectively for implementing corresponding flows of each method in fig. 4 and fig. 5, and are not described herein again for brevity.
According to the voice control method provided by the embodiment, whether the intelligent refrigerator is controlled to execute the operation corresponding to the voice signal is determined according to the collected voice signal and the pre-stored password set, so that the off-line recognition of the voice signal can be realized, the accuracy of the voice signal recognition is improved, and the real-time problem of the voice signal recognition is solved.
Optionally, as an embodiment of the present invention, the method 500 shown in fig. 5 includes:
510. and collecting voice signals.
521. And matching the voice signal with the password in the password set to obtain a matching result.
522. And determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the matching result.
According to the voice control method provided by the embodiment, the collected voice signals are converted into the corresponding semantic texts, the semantic texts are matched with the passwords in the password set to obtain the matching result, and whether the intelligent refrigerator is controlled to execute the operation corresponding to the voice signals or not is determined according to the matching result, so that the off-line recognition of the voice signals can be realized, the accuracy of the voice signal recognition is improved, and the real-time problem of the voice signal recognition is solved.
Optionally, as an embodiment of the present invention, the method 500 shown in fig. 5 further includes:
530. and sending the voice signal and the matching result to a server connected with the intelligent refrigerator so that the server updates the password set according to the voice signal and the matching result.
540. And receiving the updated password set sent by the server.
550. And replacing the pre-stored password set according to the updated password set.
In the voice control method provided by the embodiment, the acquired voice signal and the password in the password set are matched to obtain the matching result, the voice signal and the matching result are sent to the server connected with the intelligent refrigerator, the updated password set sent by the server is received, and the original pre-stored password set is replaced according to the updated password set, so that the online updating of the password set can be realized, and the recognition capability of the main control module on the password in the password set is continuously improved.
It should be understood that, in the embodiments of the present invention, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
While the invention has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (20)

1. An intelligent refrigerator comprising: the host system, its characterized in that still includes: a voice module for, among other things,
the voice module is used for collecting voice signals and transmitting the voice signals to the main control module;
the main control module is used for determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal according to the voice signal transmitted by the voice module and a pre-stored password set.
2. The intelligent refrigerator according to claim 1, wherein the main control module is specifically configured to:
matching the voice signal with the password in the password set to obtain a matching result;
and determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the matching result.
3. The intelligent refrigerator according to claim 2, wherein the main control module is further configured to send the voice signal and the matching result to a server connected thereto, so that the server updates the password set according to the voice signal and the matching result.
4. The intelligent refrigerator according to claim 3, wherein the main control module is further configured to receive an updated password set sent by the server, and replace a pre-stored password set according to the updated password set.
5. The intelligent refrigerator of any one of claims 1 to 4, wherein the password set comprises a plurality of password subsets, each of the password subsets consisting of passwords with different voices but the same semantics.
6. The intelligent refrigerator according to claim 2, wherein after power-on, the main control module is in a sleep state, and the main control module is further configured to match the voice signal with a wake-up password in the password set to determine whether to enter a scan state.
7. The intelligent refrigerator according to claim 6, wherein the main control module is specifically configured to: if the two are matched, determining to enter a scanning state; otherwise, the sleep state is continued.
8. The intelligent refrigerator according to claim 7, wherein after the main control module enters the scanning state, the main control module is further configured to provide a confirmation voice message to the user, and determine whether to enter the activation state according to whether a feedback voice signal of the user collected by the voice module can be received within a first preset time period.
9. The intelligent refrigerator according to claim 8, wherein the main control module is specifically configured to: if the feedback voice signal is received within the first preset time period, determining to enter an activation state; otherwise, the sleep state is continued.
10. The intelligent refrigerator according to claim 9, wherein after the main control module enters the activated state, the main control module is further configured to detect whether the voice signal collected by the voice module can be received within a second preset time period; if the voice signal is received within the second preset time period, determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the voice signal and the password set; otherwise, the sleep state is continued.
11. The intelligent refrigerator of claim 1, wherein the voice module employs a microphone array.
12. A server, comprising:
the receiving module is used for receiving a voice signal sent by a main control module of the intelligent refrigerator and a matching result corresponding to the voice signal;
the updating module is used for updating a pre-stored password set according to the voice signal received by the receiving module and the matching result;
and the sending module is used for sending the password set updated by the updating module to the intelligent refrigerator.
13. The server according to claim 12, wherein the server further comprises:
the recognition module is used for carrying out automatic voice recognition on the voice signal and obtaining a recognition result;
the sending module is also used for sending the result identified by the identification module to the intelligent refrigerator.
14. A server according to claim 12 or 13, wherein the password set comprises a plurality of password subsets, each of which is formed by passwords that are phonetically different but semantically identical.
15. A voice control system, comprising: the intelligent refrigerator comprises a communication module, the intelligent refrigerator as claimed in any one of claims 1 to 11, and the server as claimed in any one of claims 12 to 14, wherein the intelligent refrigerator and the server are connected through the communication module.
16. A voice control method, comprising the steps of:
step 1, collecting voice signals;
and 2, determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the voice signal and a prestored password set.
17. The method according to claim 16, wherein step 2 specifically comprises:
step 2.1, matching the voice signal with the password in the password set to obtain a matching result;
and 2.2, determining whether to control the intelligent refrigerator to execute the operation corresponding to the voice signal or not according to the matching result.
18. The method of claim 17, further comprising:
and 3, sending the voice signal and the matching result to a server connected with the refrigerator so that the server can update the password set according to the voice signal and the matching result.
19. The method of claim 18, further comprising:
step 4, receiving the updated password set sent by the server;
and 5, replacing the pre-stored password set according to the updated password set.
20. The method of any one of claims 16 to 19, wherein the password set comprises a plurality of password subsets, each of the password subsets consisting of different phonetically but semantically identical passwords.
CN201610384412.9A 2016-05-30 2016-05-30 Intelligent refrigerator, server and voice control system and method Pending CN105913839A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610384412.9A CN105913839A (en) 2016-05-30 2016-05-30 Intelligent refrigerator, server and voice control system and method
PCT/CN2017/084959 WO2017206725A1 (en) 2016-05-30 2017-05-18 Smart refrigerator, server and language control system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610384412.9A CN105913839A (en) 2016-05-30 2016-05-30 Intelligent refrigerator, server and voice control system and method

Publications (1)

Publication Number Publication Date
CN105913839A true CN105913839A (en) 2016-08-31

Family

ID=56741985

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610384412.9A Pending CN105913839A (en) 2016-05-30 2016-05-30 Intelligent refrigerator, server and voice control system and method

Country Status (2)

Country Link
CN (1) CN105913839A (en)
WO (1) WO2017206725A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106502649A (en) * 2016-09-27 2017-03-15 北京光年无限科技有限公司 A kind of robot service awakening method and device
CN106707788A (en) * 2017-03-09 2017-05-24 上海电器科学研究院 Intelligent and household voice control and recognition system
CN106782525A (en) * 2016-11-30 2017-05-31 无锡小天鹅股份有限公司 Washing machine and its phonetic controller, method
CN106940119A (en) * 2017-04-06 2017-07-11 绵阳美菱软件技术有限公司 A kind of refrigerator, food control method and system
CN107146622A (en) * 2017-06-16 2017-09-08 合肥美的智能科技有限公司 Refrigerator, voice interactive system, method, computer equipment, readable storage medium storing program for executing
CN107403617A (en) * 2017-06-26 2017-11-28 合肥美的智能科技有限公司 Refrigerator, sound control method, computer equipment, readable storage medium storing program for executing
WO2017206725A1 (en) * 2016-05-30 2017-12-07 合肥华凌股份有限公司 Smart refrigerator, server and language control system and method
CN107800572A (en) * 2017-10-27 2018-03-13 福州瑞芯微电子股份有限公司 A kind of method and apparatus based on neutral net updating apparatus
CN108346207A (en) * 2018-04-12 2018-07-31 伟创亚洲有限公司 The speech control system and method for intelligent gradevin
CN109247898A (en) * 2018-09-04 2019-01-22 佛山市顺德区美的洗涤电器制造有限公司 The control device of dish-washing machine and dish-washing machine, method

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108055650B (en) * 2018-01-31 2024-06-07 四川金互通科技股份有限公司 Data processing apparatus and method
CN111696541B (en) * 2019-03-13 2022-09-20 青岛海尔电冰箱有限公司 Voice data interaction method and system for adding food materials into refrigerator

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101794126A (en) * 2009-12-15 2010-08-04 广东工业大学 Wireless intelligent home appliance voice control system
CN102636171A (en) * 2012-04-27 2012-08-15 深圳市凯立德科技股份有限公司 Voice navigation method and device
CN103578472A (en) * 2012-08-10 2014-02-12 海尔集团公司 Method and device for controlling electrical equipment
CN103714816A (en) * 2012-09-28 2014-04-09 三星电子株式会社 Electronic appratus, server and control method thereof
CN104505093A (en) * 2014-12-16 2015-04-08 佛山市顺德区美的电热电器制造有限公司 Household appliance and voice interaction method thereof

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2429801Y (en) * 2000-06-13 2001-05-09 广东科龙电器股份有限公司 Intelleclural refrigerator with speech control
CN102855872B (en) * 2012-09-07 2015-08-05 深圳市信利康电子有限公司 Based on terminal and the mutual household electric appliance control method of internet voice and system
EP3043348B1 (en) * 2013-09-03 2017-10-04 Panasonic Intellectual Property Corporation of America Voice interaction control method
CN105206275A (en) * 2015-08-31 2015-12-30 小米科技有限责任公司 Device control method, apparatus and terminal
CN105913839A (en) * 2016-05-30 2016-08-31 合肥华凌股份有限公司 Intelligent refrigerator, server and voice control system and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101794126A (en) * 2009-12-15 2010-08-04 广东工业大学 Wireless intelligent home appliance voice control system
CN102636171A (en) * 2012-04-27 2012-08-15 深圳市凯立德科技股份有限公司 Voice navigation method and device
CN103578472A (en) * 2012-08-10 2014-02-12 海尔集团公司 Method and device for controlling electrical equipment
CN103714816A (en) * 2012-09-28 2014-04-09 三星电子株式会社 Electronic appratus, server and control method thereof
CN104505093A (en) * 2014-12-16 2015-04-08 佛山市顺德区美的电热电器制造有限公司 Household appliance and voice interaction method thereof

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017206725A1 (en) * 2016-05-30 2017-12-07 合肥华凌股份有限公司 Smart refrigerator, server and language control system and method
CN106502649A (en) * 2016-09-27 2017-03-15 北京光年无限科技有限公司 A kind of robot service awakening method and device
CN106782525A (en) * 2016-11-30 2017-05-31 无锡小天鹅股份有限公司 Washing machine and its phonetic controller, method
CN106707788A (en) * 2017-03-09 2017-05-24 上海电器科学研究院 Intelligent and household voice control and recognition system
CN106707788B (en) * 2017-03-09 2019-05-28 上海电器科学研究院 A kind of intelligent home voice control identifying system and method
CN106940119A (en) * 2017-04-06 2017-07-11 绵阳美菱软件技术有限公司 A kind of refrigerator, food control method and system
CN107146622A (en) * 2017-06-16 2017-09-08 合肥美的智能科技有限公司 Refrigerator, voice interactive system, method, computer equipment, readable storage medium storing program for executing
CN107146622B (en) * 2017-06-16 2021-02-19 合肥美的智能科技有限公司 Refrigerator, voice interaction system, method, computer device and readable storage medium
CN107403617A (en) * 2017-06-26 2017-11-28 合肥美的智能科技有限公司 Refrigerator, sound control method, computer equipment, readable storage medium storing program for executing
CN107800572A (en) * 2017-10-27 2018-03-13 福州瑞芯微电子股份有限公司 A kind of method and apparatus based on neutral net updating apparatus
CN108346207A (en) * 2018-04-12 2018-07-31 伟创亚洲有限公司 The speech control system and method for intelligent gradevin
CN109247898A (en) * 2018-09-04 2019-01-22 佛山市顺德区美的洗涤电器制造有限公司 The control device of dish-washing machine and dish-washing machine, method

Also Published As

Publication number Publication date
WO2017206725A1 (en) 2017-12-07

Similar Documents

Publication Publication Date Title
CN105913839A (en) Intelligent refrigerator, server and voice control system and method
JP7198861B2 (en) Intelligent assistant for home automation
CN112051743A (en) Device control method, conflict processing method, corresponding devices and electronic device
CN107450390B (en) intelligent household appliance control device, control method and control system
US11031008B2 (en) Terminal device and method for controlling thereof
US11721343B2 (en) Hub device, multi-device system including the hub device and plurality of devices, and method of operating the same
CN110767225B (en) Voice interaction method, device and system
CN105045122A (en) Intelligent household natural interaction system based on audios and videos
CN112634897B (en) Equipment awakening method and device, storage medium and electronic device
CN111754997B (en) Control device and operation method thereof, and voice interaction device and operation method thereof
CN111161714A (en) Voice information processing method, electronic equipment and storage medium
US11727085B2 (en) Device, method, and computer program for performing actions on IoT devices
CN108665900B (en) Cloud wake-up method and system, terminal and computer readable storage medium
CN108038947B (en) Intelligent door lock system based on Bluetooth
CN111968644A (en) Intelligent device awakening method and device and electronic device
CN108932942A (en) A kind of interactive system and method for realization intelligent sound box
CN111862965A (en) Awakening processing method and device, intelligent sound box and electronic equipment
WO2019227370A1 (en) Method, apparatus and system for controlling multiple voice assistants, and computer-readable storage medium
CN110740083A (en) Voice equipment awakening method and device, household appliance and readable storage medium
CN108417008A (en) Infrared control method based on speech recognition and system
CN113782016B (en) Wakeup processing method, wakeup processing device, equipment and computer storage medium
US20220270601A1 (en) Multi-modal smart audio device system attentiveness expression
CN113138559A (en) Device interaction method and device, electronic device and storage medium
CN112992137B (en) Voice interaction method and device, storage medium and electronic device
CN113889116A (en) Voice information processing method and device, storage medium and electronic device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180313

Address after: 230601 Building No. 198, No. G2, No. 198, Mingzhu Avenue, Hefei high tech Zone, Hefei, Anhui

Applicant after: Hefei Midea Intelligent Technology Co., Ltd.

Address before: 230601 Hefei economic and Technological Development Zone, Fairview Road, Anhui

Applicant before: Hefei Hualing Co., Ltd.

Applicant before: Midea Group Co., Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160831