EP3994685A1 - Method for controlling voice recognition module, voice recognition module, and household appliance - Google Patents
Method for controlling voice recognition module, voice recognition module, and household applianceInfo
- Publication number
- EP3994685A1 EP3994685A1 EP20734921.8A EP20734921A EP3994685A1 EP 3994685 A1 EP3994685 A1 EP 3994685A1 EP 20734921 A EP20734921 A EP 20734921A EP 3994685 A1 EP3994685 A1 EP 3994685A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- voice recognition
- recognition module
- graph
- echo graph
- microphone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/02—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
- G01S15/04—Systems determining presence of a target
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
- G01S7/523—Details of pulse systems
- G01S7/526—Receivers
- G01S7/53—Means for transforming coordinates or for evaluating data, e.g. using computers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
Definitions
- the present invention relates to the field of household appliance technologies, and in particular, to a method for controlling a voice recognition module, a voice recognition module, and a household appliance.
- a voice module of a household appliance has two modes: an operating mode and a standby mode.
- an operating mode when the voice module is in the standby mode, a sensor is used to activate or wake up the voice module, so that the voice module enters the operating mode.
- a sensor when the voice module is in the standby mode, a sensor is used to activate or wake up the voice module, so that the voice module enters the operating mode.
- such a method requires the configuration of a sensor in the household appliance, increasing costs of the household appliance.
- An objective of embodiments of the present invention is to wake up a voice recognition module by using a microphone array and a speaker of the voice recognition module without additionally disposing any sensor, thereby simplifying the design of structure lines and reducing equipment costs.
- the present invention provides a method for controlling a voice recognition module, where the voice recognition module is in a dormant state, and the voice recognition module includes a microphone array and a speaker, at least one microphone is in an awake state, and the speaker is controlled to send a sound wave signal after the at least one microphone receives a sound; the at least one microphone receives an echo of the sound wave signal, and obtains a current echo graph in a space where the voice recognition module is located; and the current echo graph is compared with a preset echo graph, so as to control the voice recognition module.
- the voice recognition module can be woken up when it is detected that a user needs to use a voice recognition function, thereby reducing energy consumption and costs.
- the preset echo graph is obtained when the space where the voice recognition module is located is an empty room. Whether there is a user entering the space can be recognized by comparing a different echo graph formed in a different space from a sound wave with a graph formed in the empty room.
- the method further includes controlling the entire voice recognition module to wake up when the current echo graph is different from the preset echo graph.
- the method further includes controlling the entire voice recognition module to wake up when a difference between the current echo graph and the preset echo graph exceeds a preset value.
- the embodiments of the present invention further disclose a voice recognition module including a microphone array, a speaker and a controller, where the controller is configured to keep at least one microphone in an awake state, enable the speaker to send a sound wave pulse signal after the at least one microphone receives a sound, and enable the at least one microphone to receive the sound wave pulse signal; and is further configured to obtain a current echo graph in a space where the voice recognition module is located, and compare the current echo graph with a preset echo graph, so as to control the voice recognition module.
- the preset echo graph is obtained when the space is an empty room.
- the controller is further configured to wake up the entire voice recognition module when the current echo graph is different from the preset echo graph. In a possible embodiment, the controller is further configured to wake up the entire voice recognition module when a difference between the current echo graph and the preset echo graph exceeds a preset value.
- a household appliance includes the voice recognition module according to any one of the foregoing.
- FIG. 1 is a schematic structural diagram of a voice recognition module according to an embodiment of the present invention.
- FIG. 2 is a flowchart of a method for controlling a voice recognition module according to an embodiment of the present invention.
- a voice recognition module 100 includes a controller 101 , a microphone array 102 connected to the controller 101 , and a speaker 103, and further includes a power supply unit 104 supplying power to the controller 101 , the microphone array 102, and the speaker 103.
- an operating mode of the voice recognition module 100 includes a standby mode and a wakeup mode. It is beneficial to reduction of energy consumption to keep the voice recognition module in the standby mode without using a voice recognition function. When the voice recognition function needs to be used, the voice recognition module 100 is woken up.
- the controller 101 may be configured to control operating states of the microphone array 102 and the speaker 103.
- the microphone array 102 may include two or more microphones.
- the controller 101 may be configured to keep at least one microphone in an awake state, and wake up the remaining microphones to operate according to different operating circumstance requirements.
- An arrangement of the microphones in the microphone array 102 is not limited, may be a linear array, or may be a two-dimensional array or a three-dimensional array.
- the voice recognition module 100 may include four microphones and one speaker 103.
- the controller 101 is configured to control one of the microphones to be in an awake state.
- the controller 101 controls the speaker 103 to send a sound wave pulse signal.
- the microphone receives an echo of the sound wave pulse signal, and moreover the controller 102 stores an echo graph and compares the echo graph with a preset echo graph.
- the controller 101 controls an operating state of the voice recognition module according to a comparison result.
- the comparison result is that the current echo graph is the same as the preset echo graph, it indicates that it is unnecessary to wake up the voice recognition module 100; if the comparison result is that the two are different, it indicates that there is a user entering a current space where the voice recognition module 100 is located and the voice recognition function may need to be used, and the controller 101 performs control to start the remaining three microphones.
- a preset echo graph may be an echo graph of an empty room obtained through a test or an experiment.
- the current echo graph is different from the echo graph of the empty room, it is considered that there is a user entering the same space and the voice recognition function needs to be enabled, and the controller 101 performs control to start corresponding microphones.
- a microphone may be controlled to operate by setting a threshold of a difference between a current echo graph and an echo graph of an empty room, that is, when the difference exceeds the threshold, the remaining microphones are started.
- a method for controlling a voice recognition module is applicable to the foregoing voice recognition module 100. Steps of the method include the following:
- At least one microphone being in an awake state, after the at least one microphone receives a sound, a speaker is controlled to send a sound wave signal.
- one microphone in a microphone array may be in an awake state, and is configured to activate the speaker through any sound received.
- the speaker may send a plurality of sound wave pulse signals to form a clear and accurate sound wave echo graph.
- the at least one microphone receives an echo of the sound wave signal and obtains a current echo graph in a space where the voice recognition module is located.
- the current echo graph is compared with a preset echo graph to control the voice recognition module.
- the current echo graph when the current echo graph is different from the preset echo graph, it indicates that there may be a user entering the space where the voice recognition module is located and the entire voice recognition module is controlled to wake up, that is, the remaining microphones in a dormant state.
- the entire voice recognition module is controlled to wake up.
- the preset echo graph in a state of the empty room is obtained.
- Embodiments of the present invention further disclose a household appliance including the foregoing voice recognition module 100.
- the household appliance may be a refrigerator, a washing machine, a cooker hood, a cooktop, a coffee machine, a dishwasher, or the like.
- a refrigerator is taken as an example below, the refrigerator is placed in a room 1 , and the refrigerator is provided with the voice recognition module 100 through which a voice recognition function and a voice control function can be realized.
- the voice recognition module 100 When there is no one in the room 1 , an echo graph X of an empty room of the room 1 is obtained and stored.
- the voice recognition module 100 of the refrigerator is in a standby state to save electric energy, where at least one microphone is left in an operating state.
- the speaker 103 is controlled to send a sound wave pulse signal
- the microphone 102 receives an echo of the pulse signal and obtains an echo graph Y
- the echo graph Y is compared with a preset echo graph X of the empty room. If Y is different from X, it indicates that there is someone entering the room 1 and the voice recognition function needs to be enabled, and the controller 101 wakes up the remaining microphones. Otherwise, the voice recognition module 100 continues to be on standby.
- a person of ordinary skill in the art may understand that all or part of the steps of all methods of the foregoing embodiments may be completed by a program instructing related hardware, the program may be stored in a computer-readable storage medium, and the storage medium may include: a ROM, a RAM, a magnetic disk, an optical disc, or the like.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Telephone Function (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910589401.8A CN112185386B (en) | 2019-07-02 | 2019-07-02 | Control method of voice recognition module, voice recognition module and household appliance |
| PCT/EP2020/067855 WO2021001255A1 (en) | 2019-07-02 | 2020-06-25 | Method for controlling voice recognition module, voice recognition module, and household appliance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP3994685A1 true EP3994685A1 (en) | 2022-05-11 |
Family
ID=71170602
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP20734921.8A Ceased EP3994685A1 (en) | 2019-07-02 | 2020-06-25 | Method for controlling voice recognition module, voice recognition module, and household appliance |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP3994685A1 (en) |
| CN (1) | CN112185386B (en) |
| WO (1) | WO2021001255A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113948080A (en) * | 2021-10-08 | 2022-01-18 | 珠海格力电器股份有限公司 | Distributed voice device control method, system, computer device and storage medium |
| CN116798451A (en) * | 2023-07-11 | 2023-09-22 | 珠海格力电器股份有限公司 | Information generation method, device, computer equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180308490A1 (en) * | 2017-04-21 | 2018-10-25 | Lg Electronics Inc. | Voice recognition apparatus and voice recognition method |
| EP3404655A1 (en) * | 2017-05-19 | 2018-11-21 | LG Electronics Inc. | Home appliance and method for operating the same |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160044394A1 (en) * | 2014-08-07 | 2016-02-11 | Nxp B.V. | Low-power environment monitoring and activation triggering for mobile devices through ultrasound echo analysis |
| CN107369445A (en) * | 2016-05-11 | 2017-11-21 | 上海禹昌信息科技有限公司 | The method for supporting voice wake-up and Voice command intelligent terminal simultaneously |
| EP3472831B8 (en) * | 2016-06-15 | 2020-07-01 | Cerence Operating Company | Techniques for wake-up word recognition and related systems and methods |
| CN106679326A (en) * | 2017-01-25 | 2017-05-17 | 北京通远科技有限公司 | Intelligent refrigerator controlled on basis of voice recognition |
| KR102391298B1 (en) * | 2017-04-24 | 2022-04-28 | 삼성전자주식회사 | electronic device providing speech recognition service and method thereof |
| CN107577449B (en) * | 2017-09-04 | 2023-06-23 | 百度在线网络技术(北京)有限公司 | Wake-up voice pickup method, device, equipment and storage medium |
| CN108231079B (en) * | 2018-02-01 | 2021-12-07 | 北京百度网讯科技有限公司 | Method, apparatus, device and computer-readable storage medium for controlling electronic device |
| CN108447479B (en) * | 2018-02-02 | 2020-11-24 | 上海大学 | Robotic voice control system in noisy environment |
-
2019
- 2019-07-02 CN CN201910589401.8A patent/CN112185386B/en active Active
-
2020
- 2020-06-25 WO PCT/EP2020/067855 patent/WO2021001255A1/en not_active Ceased
- 2020-06-25 EP EP20734921.8A patent/EP3994685A1/en not_active Ceased
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180308490A1 (en) * | 2017-04-21 | 2018-10-25 | Lg Electronics Inc. | Voice recognition apparatus and voice recognition method |
| EP3404655A1 (en) * | 2017-05-19 | 2018-11-21 | LG Electronics Inc. | Home appliance and method for operating the same |
Non-Patent Citations (1)
| Title |
|---|
| See also references of WO2021001255A1 * |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021001255A1 (en) | 2021-01-07 |
| CN112185386B (en) | 2025-03-14 |
| CN112185386A (en) | 2021-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105830397B (en) | Method, portable operating device, system for switching household appliances between at-home mode and away-from-home mode | |
| CN108195133B (en) | A refrigerator and its control method and control device | |
| CN106200386B (en) | Household electrical appliance | |
| CN108231079A (en) | For the method, apparatus, equipment and computer readable storage medium of control electronics | |
| CN103994539A (en) | Heating and ventilation device with work mode automatically switched and control method thereof | |
| CN105517299B (en) | Intelligent switch component | |
| CN106527165B (en) | Human body monitoring device, intellectual water closet and controlling intelligent household appliances | |
| EP3994685A1 (en) | Method for controlling voice recognition module, voice recognition module, and household appliance | |
| CN203897997U (en) | Electric cooker | |
| CN111164854A (en) | Non-contact power transmission device and non-contact power transmission and reception system | |
| CN105627513A (en) | Control method, device and system of air conditioner | |
| JP2019501476A (en) | Electromagnetic heating system, control method thereof, and apparatus | |
| CN112233673A (en) | Control method of kitchen system, kitchen system, and computer-readable storage medium | |
| JP6122467B2 (en) | Control system and method | |
| CN111380097B (en) | Range hood, range hood kitchen range linkage system and control method thereof | |
| CN105223862A (en) | A kind of household electrical appliance and audio control method thereof and system | |
| CN109236700A (en) | Fan energy-saving control method, energy-saving control system and fan thereof | |
| CN206560262U (en) | A kind of electromagnetic cooking appliance | |
| CN112176640A (en) | Control method of washing machine | |
| CN110708219A (en) | Household appliance control method and household appliance | |
| CN113835606B (en) | Electronic equipment, interaction control system and method thereof and interaction controller | |
| CN105186615A (en) | Intelligent power supply module | |
| CN114062908B (en) | Relay state detection method, device and equipment of electromagnetic heating appliance | |
| CN116009728A (en) | Detection method, detection circuit, touch device and electronic equipment | |
| CN114413422A (en) | Control method and control system of air conditioner, air conditioner and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20220202 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20230720 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R003 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
| 18R | Application refused |
Effective date: 20250317 |