US20220199072A1 - Voice wake-up device and method of controlling same - Google Patents
Voice wake-up device and method of controlling same Download PDFInfo
- Publication number
- US20220199072A1 US20220199072A1 US17/545,883 US202117545883A US2022199072A1 US 20220199072 A1 US20220199072 A1 US 20220199072A1 US 202117545883 A US202117545883 A US 202117545883A US 2022199072 A1 US2022199072 A1 US 2022199072A1
- Authority
- US
- United States
- Prior art keywords
- wake
- voice
- electronic device
- sound signal
- ambient sounds
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims description 22
- 230000005236 sound signal Effects 0.000 claims abstract description 56
- 230000006266 hibernation Effects 0.000 claims abstract description 46
- 238000012545 processing Methods 0.000 claims description 30
- 239000003381 stabilizer Substances 0.000 claims description 9
- 230000002618 waking effect Effects 0.000 claims description 7
- 239000013078 crystal Substances 0.000 claims description 5
- 238000002592 echocardiography Methods 0.000 claims 1
- 230000006870 function Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 6
- 238000005265 energy consumption Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 241000699670 Mus sp. Species 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 241000699666 Mus <mouse, genus> Species 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000007958 sleep Effects 0.000 description 1
- 230000000087 stabilizing effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/3296—Power saving characterised by the action undertaken by lowering the supply or operating voltage
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3215—Monitoring of peripheral devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3231—Monitoring the presence, absence or movement of users
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/324—Power saving characterised by the action undertaken by lowering clock frequency
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L2015/088—Word spotting
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Power Sources (AREA)
Abstract
A voice wake-up device includes a microphone module, an electrical connector, and a microcontroller unit. The microcontroller unit includes at least one microcontroller and a memory for storing microcontroller-executable instructions. The microcontroller-executable instructions enable the microcontroller unit to execute multiple tasks including detecting whether a sound signal is in ambient sounds received by the microphone module, and generating an input sound signal according to the sound signal; determining whether the input sound signal includes a predetermined wake-up voice; and confirming the predetermined wake-up voice is comprised in the input sound signal and outputting a wake-up instruction to wake up the electronic device entering the non-hibernation mode from the hibernation mode.
Description
- This application claims the priority of Taiwan Patent Application serial No. 109145369, filed Dec. 21, 2020, the disclosure of which is incorporated herein by reference in their entirety.
- The present disclosure relates to a voice device, and particularly to a voice wake-up device for waking up an electronic device and a control method thereof.
- With development of information technologies, the use of electronic devices, such as computers or tablets, has been an indispensable necessity in our daily lives. People rely on computers to complete tasks, which can also improve work efficiency. The way of human-computer interaction between users and the computers or other electronic devices, that is, the way of communication or control continues to evolve. General human-computer interaction methods can be achieved through mechanical devices (for example, keyboards or mice, etc.) or electrical devices (for example, touch screens or touch pads). Nowadays, human-computer interaction has been developed through the sound of the users' voice.
- The human-computer interaction of voice audio is carried out through a voice device that collects and responds to human voice. Conventional voice devices (or smart speakers) can receive voice signals and perform corresponding functions on the electronic devices on an application side after signal processing. Users do not need to use mechanical devices, such as keyboards or mice, or touch screens with their fingers to control the electronic device. When controlling by a voice device, users' do not need to touch the electronic devices with their hands, therefore additional works can be performed at the same time. However, for the conventional voice devices or smart speakers, after the electronic device (such as a computer) is idle for a period of time, it enters a power saving mode or a hibernation mode, and an internal voice device (smart speaker) also enters the power saving mode or the hibernation mode. Users cannot wake up the electronic device with a specific voice in a normal way through the smart speaker, but must use a keyboard, mouse or touch screen instead. Therefore, it is imperative to solve the aforementioned problems so that the voice device can achieve the wake-up function in various operating modes.
- One objective of the present disclosure is to provide a voice wake-up device for waking up an electronic device that can solve the problem that conventional electronic devices cannot be woke by voice in a hibernation mode.
- Another objective of the present disclosure is to provide a voice wake-up device that can reduce a power consumption of an electronic device for a wake-up function.
- Another objective of the present disclosure is to provide a voice wake-up device that can be externally connected to an electronic device and include a simplified structure and a low energy consumption design.
- Another objective of the present disclosure is to provide a control method of a voice wake-up device for waking up an electronic device in a hibernation mode.
- To achieve the foregoing objectives, the present disclosure provides a voice wake-up device including a microphone module for receiving ambient sounds when an electronic device is in a hibernation mode; an electrical connector for electrically connecting to a connection port of the electronic device to connect the voice wake-up device to the electronic device; and a microcontroller unit coupled to the microphone module and the electrical connector and comprising at least one microcontroller and a memory for storing executable instructions of the microcontroller which enable the microcontroller unit to execute multiple tasks comprising: detecting whether a sound signal is in the ambient sounds received by the microphone module, and generating an input sound signal according to the sound signal; determining whether the input sound signal comprises a predetermined wake-up voice; and confirming the predetermined wake-up voice is comprised in the input sound signal and outputting a wake-up instruction to wake up the electronic device entering the non-hibernation mode from the hibernation mode.
- Preferably, the multiple tasks performed by the microcontroller unit further comprise performing a noise canceling processing by the microcontroller unit before the task of determining the predetermined wake-up voice is comprised in the input sound signal for canceling noises of the ambient sounds received by the microphone module, and comprise performing an echo processing for canceling the echo in the ambient sounds.
- Preferably, the microphone module comprises a microphone array composed of a plurality of microphones, and the microcontroller unit comprises at least one beamforming component, wherein the microphone array is configured to receive the ambient sounds from different directions, and the beamforming component generates concentrated directional input sound signals according to the ambient sounds in the different directions.
- The present disclosure provides a control method of a voice wake-up device comprising a microphone module, an electrical connector, and a microcontroller unit comprising at least one microcontroller and a memory and being configured for waking up an electronic device comprising a connecting port in a hibernation mode, the control method comprises electrically connecting the electrical connector and the connecting port of the electronic device to connect the voice wake-up device to the electronic device and setting a wake-up voice; determining whether the electronic device is in a hibernation mode or in a non-hibernation mode by the microcontroller unit; receiving ambient sounds by the microphone module when the electronic device is in the hibernation mode; detecting whether a sound signal is in the ambient sounds received by the microphone module, generating an input sound signal according to the sound signal, and judging whether the wake-up voice predetermined is comprised in the input sound signal; and confirming the wake-up voice predetermined is comprised in the input sound signal and outputting a wake-up instruction to wake up the electronic device entering the non-hibernation mode from the hibernation mode.
- The voice wake-up device of the present disclosure utilizes a system-on-chip architecture to connect to a host system of the electronic device through an external connection. Not only is the control method simple, but it can also solve the problem that conventional electronic devices cannot be woke up by voice in the hibernation mode. Secondly, for sounds received by the microphone module, the voice wake-up device of the present disclosure uses the microcontroller unit to perform audio processing, which greatly reduces hardware requirements, effectively lowering manufacturing costs, and reduces energy consumption. In addition, the voice wake-up device of the present disclosure greatly reduces the power requirements of the electronic device for the voice wake-up function through the setting of a separate power supply module and its own low-energy working mode, thereby achieving effects of power saving and energy saving. Furthermore, the present disclosure effectively optimizes the human voice signal by using the microcontroller unit to perform audio processing, noise canceling processing, and echo processing, which improves a missing judging problem of a conventional voice wake-up device.
-
FIG. 1 is a structural block diagram of a voice wake-up device of the present disclosure. -
FIG. 2 is a flowchart of a control method of the voice wake-up device of the present disclosure. -
FIG. 3 is a functional block diagram of the voice wake-up device of the present disclosure. -
FIG. 4 is a flowchart of the voice wake-up device while processing sound signals of the present disclosure. -
FIG. 5 is a schematic status diagram of the voice wake-up device of the present disclosure. - In order to make the objectives, technical solutions, and effects of the present disclosure clearer, the present disclosure will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present disclosure, and the word “embodiment” used in the specification of the present disclosure means serving as an example, example, or illustration, and is not intended to limit the present disclosure. In addition, the article “a” used in the scope of the present disclosure and the appended application can generally be interpreted as meaning “one or more”, unless otherwise specified or the singular form can be clearly determined from the context. In addition, in the accompanying drawings, elements with similar or identical structures and functions are denoted by the same element numbers.
- The present disclosure relates to a voice device, in particular to a voice wake-up device for waking up an electronic device in a hibernation mode. According to an embodiment, the voice wake-up device of the present disclosure realizes a function of the voice wake-up device by creating an electrical connection with the electronic device through an external connection or by being built in the electronic device. The electronic device can be a notebook computer, a desktop computer, a tablet computer, or other electronic devices that can switch between a hibernation mode and an active mode (non-hibernation mode). The hibernation mode means that a host system of the electronic device enters a hibernation state.
- Please refer to achieving effects
FIG. 1 , which is a structural block diagram of a voice wake-up device of the present disclosure. The voice wake-updevice 1 of the present disclosure includes astabilizer 11, a quartz-crystal oscillator 12, amicrophone module 2, a microcontroller unit 3 (MCU), and anelectrical connector 4. Specifically, the voice wake-updevice 1 includes a system on chip (SOC). As shown inFIG. 1 , themicrophone module 2 includes a microphone array composed of a plurality ofmicrophones 21 spaced arranged, which are configured to receive ambient sounds from different directions when anelectronic device 7 is in a hibernation mode. The ambient sounds may include human voice or sounds excluding human voices, that is, includes various sounds of a surrounding environment of the microphone module. In addition, according to signal processing requirements of the electronic device in an analog form or in a digital form, themicrophone module 2 of the present disclosure can be further coupled to an analog-to-digital converter (not shown) for performing an analog-to-digital conversion of the ambient sounds received by themicrophone module 2. Particularly, theelectronic device 7 of the present disclosure is, for example, a notebook but it is not limited thereto. - The
electrical connector 4 and themicrophone module 2 are configured on a circuit board (not shown). Theelectrical connector 4 includes a plug-and-play interface, such as a universal serial bus (USB). Accordingly, theelectronic device 7 further includes a port supporting the plug-and-play interface to connect to theelectrical connector 4 of the voice wake-updevice 1. In another embodiment, theelectrical connector 4 of the present disclosure can be configured and applied to an inter-integrated circuit (I2C) inside theelectronic device 7. That is, the voice wake-updevice 1 of the present disclosure can be built on a circuit board inside theelectronic device 7. - Referring to
FIG. 1 , themicrocontroller unit 3 is coupled to themicrophone module 2 and theelectrical connector 4, and is jointly configured on the same circuit board. Themicrocontroller unit 3 includes amicrocontroller 31 and amemory 32. Thememory 32 may include an application program in a form of instructions, and the instructions are executed by themicrocontroller 31 for performing tasks or actions for achieving necessary functions of the voice wake-updevice 1. Thememory 32 may be a type of computer storage medium, which may include volatile and non-volatile memory. That is, thememory 32 may include, but is not limited to, random access memory (RAM), read-only memory (ROM), flash memory, or other storage technologies. In addition, as shown inFIG. 1 , thestabilizer 11 is coupled to themicrocontroller unit 3 and theelectrical connector 4 for stabilizing a voltage provided to the voice wake-updevice 1. For example, an input voltage from a power supply terminal is 5V, and thestabilizer 11 is configured to adjust the input voltage to a working voltage suitable for the voice wake-updevice 1, for example, 3.3V. The quartz-crystal oscillator 12 is coupled to themicrocontroller unit 3 and is configured to make themicrocontroller unit 3 work at a predetermined operating frequency. - Please refer to
FIG. 2 , which is a flowchart of a control method of the voice wake-updevice 1 of the present disclosure. The control method of the voice wake-up device of the present disclosure is configured to wake up an electronic device in a hibernation mode, and the control method includes the following actions. - Action 501: connecting and setting wake-up voice. The electrical connector of the voice wake-up device is connected to the connecting port of the electronic device, so that the voice wake-up device is electrically connected to the electronic device to set the wake-up voice. In one embodiment, a user can set the wake-up voice through a wake-up voice setting program pre-installed on the electronic device after the voice wake-up device is electrically connected to the electronic device. The wake-up voice can be a user-defined wake-up word or a tone pronounced by the user. Particularly, the voice wake-up device of the present disclosure can recognize different wake-up voices set by multiple users to perform the wake-up function.
- Action 502: determining whether the electronic device is in a hibernation mode or a non-hibernation mode by the microcontroller unit. Specifically, after the voice wake-up device of the present disclosure is connected to the electronic device for the first time, since the connecting port of the electronic device (for example, a notebook computer) has the plug-and-play interface, the insertion of the voice wake-up device can be detected immediately, so that the electronic device can be set in the non-hibernation mode, i.e., an active mode. When the electronic device is idle for a period of time, it enters the hibernate mode. The hibernate mode, which is a working state other than the active mode, includes a sleep mode and a hibernation mode, and also includes a state in which the electronic device has been shut down but is still receiving power. In addition, after the voice wake-up device of the present disclosure is connected to the electronic device, the voice wake-up device will actively receive wake-up voice(s) pre-installed in the electronic device and store the wake-up voice(s) in the memory. In the state that there is no pre-installed wake-up voice, the voice wake-up device will return to
action 501 and wait for the setting of the wake-up voice. - Action 503: receiving ambient sounds by the microphone module when the electronic device is in the hibernation mode. Particularly, the microphone module of the present disclosure only receives ambient sounds when the electronic device is in the hibernate mode, and automatically stops receiving the ambient sounds in the active mode.
- Action 504: determining whether an input sound signal includes a predetermined wake-up voice by the microcontroller unit. Specifically, the microcontroller unit is configured to detect whether a sound signal is in the ambient sounds received by the microphone module, an input sound signal is generated according to the sound signal, and the microcontroller unit determines whether the input sound signal includes the predetermined wake-up voice. After judging that the input sound signal does not include the predetermined wake-up voice, the voice wake-up device will return to
action 503. - Action 505: confirming that the input sound signal includes the predetermined wake-up voice and outputting a wake-up instruction to wake up the electronic device entering the non-hibernation mode from the hibernation mode. Particularly, once the electronic device is awakened, it means that the electronic device is in the non-hibernation mode, and the voice wake-up device of the present disclosure stops receiving ambient sounds and stops subsequent actions. That is, the voice wake-up device of the present disclosure returns to action 502 to determine whether the electronic device is in the hibernation mode or the non-hibernation mode.
-
FIG. 2 has illustrated the control method of the voice wake-up device of the present disclosure.FIG. 3 is a functional block diagram of the voice wake-up device of the present disclosure to illustrate the detailed functions of the voice wake-up device. Referring toFIG. 3 in conjunction withFIG. 2 for reference, the voice wake-updevice 1 of the present disclosure further includes a time-division multiplexor 13 coupled to themicrophone module 2 to enable the voice wake-updevice 1 to perform real-time tasks. In this embodiment, themicrophone module 2 receives ambient sounds every 10 milliseconds to realize the purpose of real-time wake-up. As shown inFIG. 3 , themicrocontroller unit 3 further includes avoice detecting component 33, abeamforming component 34, anoise canceling component 35, anecho processing component 36, and a wake-upvoice processing component 37. The voice wake-updevice 1 is electrically connected to theelectronic device 7 through theelectrical connector 4. In addition, themicrocontroller unit 3 further includes a pulse-code modulation component 14 for adjusting a pulse signal processed by themicrocontroller unit 3 in accordance with the signal requirements of theelectronic device 7. The aforementioned components are stored in thememory 32 in a form of an application program, and are configured to perform different tasks. The detailed description is as follows. Particularly, thebeamforming component 34, thenoise canceling component 35, and theecho processing component 36 of the present disclosure can be configured in the voice wake-up device of the present disclosure according to actual requirements. That is, the aforementioned components for optimizing sound signal processing can be one of them, a combination of any two or more of them, or none of them is configured. The configuration of the aforementioned components for optimizing sound signal processing will not affect the operation of themicrocontroller unit 3. -
FIG. 4 is a flowchart of the voice wake-up device while processing sound signals of the present disclosure. Please refer toFIG. 4 in conjunction withFIGS. 2 and 3 for reference. Corresponding toFIG. 2 for the control method of the voice wake-up device disclosed in the present disclosure, the detailed flow of the control method includes the actions shown inFIG. 4 , which includes action 601: receiving ambient sounds. Specifically, a microphone array composed of a plurality of microphones included in themicrophone module 2 is configured to receive ambient sounds from different directions and different distances. - Action 602: detecting sound signals. That is, the
voice detecting component 33 is configured to detect whether the ambient sounds received by themicrophone module 2 has sound signals, and the input sound signal is generated according to the sound signals of the ambient sounds. Specifically, when thevoice detecting component 33 does not detect the presence of a sound signal in the ambient sounds, the work energy consumption of thevoice detecting component 33 is extremely low. Because it does not detect the presence of a sound signal in the ambient sounds, it has not yet entered the execution of subsequent actions so that the energy consumption of the voice wake-updevice 1 can be further reduced. - Action 603: forming a beam. The
beamforming component 34 is configured to generate concentrated input sound signals in different directions. Specifically, thebeamforming component 34 is configured for responding to the spatial separation formed by the microphone array, and generating concentrated directional input sound signals according to the ambient sounds from different directions and different distances, so as to distinguish signals of different sound sources more clearly. - Action 604: noise canceling processing. The
noise canceling component 35 is configured to perform a noise canceling processing for reducing the noise of the ambient sounds received by themicrophone module 2. For example, noise in the environment or traffic noise can be eliminated by thenoise canceling component 35. - Action 605: echo processing. That is, the
echo processing component 36 is configured to perform an echo processing to cancel the echo contained in the ambient sounds. - Action 606: detecting of the wake-up voice. The wake-up
voice processing component 37 is configured to detect whether the input sound signal includes the wake-up voice. That is, it detects whether the input sound signal has human voice, so as to avoid the wake-up voice judgment for all sounds, which affects the efficiency of voice judgment. - Action 607: judging wake-up voice. The wake-up
voice processing component 37 is configured to determine whether the input sound signal includes a predetermined wake-up voice. That is, whether the user-defined wake-up word or the tone pronounced by the user is included is judged according to the input sound signal with human voice. It is determined based on the input sound signal that the predetermined wake-up voice is not included, and then it returns toaction 602. - Action 608: waking up the electronic device. That is, it is confirmed that the input sound signal includes the predetermined wake-up voice, and the wake-up instruction is output to wake up the electronic device entering the non-hibernation mode from the hibernation mode.
-
FIG. 5 is a usage status schematic diagram of the voice wake-up device of the present disclosure. As shown inFIG. 5 , the voice wake-updevice 1 of the present disclosure is a portable device with a plug-and-play interface. In specific implementation, the voice wake-updevice 1 of the present disclosure further includes a case 10 with an accommodating space in the case 10 for accommodating themicrophone module 2, themicrocontroller unit 3, and theelectrical connector 4. Theelectrical connector 4 has a USB connector for connecting to the connecting port 71 of theelectronic device 7 with a corresponding interface so that the voice wake-updevice 1 can be plugged and electrically connected to theelectronic device 7. - Referring to
FIG. 5 , particularly, the voice wake-updevice 1 of the present disclosure further includes a power supply module 15 coupled to thestabilizer 11. The power supply module 15 serves as a power supply source of the voice wake-updevice 1 independent to the electronic device 71. In one embodiment, the power supply module 15 may be equipped with a battery (not shown) to provide the power required by the voice wake-updevice 1. In another embodiment, the power supply module 15 can be additionally connected to a cable to provide power through the transmission of an external power source. For example, the power supply module 15 may have a port having a micro USB interface (not shown), which is connected to the external power source through the cable for power transmission. With the configuration of the power supply module 15, the voice wake-updevice 1 of the present disclosure has a separate power supply and does not consume the power of theelectronic device 7. In addition, as mentioned above, the voice wake-updevice 1 of the present disclosure can also be built into a host system of the electronic device, for example, the voice wake-updevice 1 can be connected to the host system through an I2C architecture. Since the energy consumption of the voice wake-updevice 1 of the present disclosure is extremely low, which meets the requirements of environmental protection and energy saving standards in the mainstream market. Therefore, it will not cause excessive energy consumption of electronic devices even built in the electronic device. - In summary, the disclosed voice wake-up device utilizes a system-on-chip architecture to connect to the host system of the electronic device through an external connection. Not only is the control method simple, but it can also solve the problem that conventional electronic devices cannot be awakened by voice in the hibernation mode. Secondly, for sounds received by the microphone module, the voice wake-up device of the present disclosure uses the microcontroller unit to perform audio processing, which greatly reduces the hardware requirements, effectively lowers the manufacturing cost, and further reduces the energy loss. In addition, the voice wake-up device of the present disclosure greatly reduces the power requirements of the electronic device for the voice wake-up function through the setting of a separate power supply module and its own low-energy working mode, and achieves the effects of power saving and energy saving. Furthermore, the present disclosure effectively optimizes the human voice signal by using the microcontroller unit to perform audio processing, noise canceling processing, and echo processing, which improves the missing judging problem of a conventional voice wake-up device.
- The above-described embodiments can be implemented as a data signal processor, an analog processor, etc. by using a programming method (such as using a computer or a processor). However, in other embodiments, professional or dedicated circuits (including analog circuits and/or digital logic circuits) may be configured to implement one or more of the elements, functions, or elements. The term ‘component’ or ‘element’ as used herein is intended to include any hardware, software, logic, or combination of the foregoing for implementing the functions attributed to the component or element.
- The above-mentioned embodiments are used to illustrate the technical ideas of the present disclosure, but are not used to limit the technical ideas of the present disclosure. Therefore, the scope of rights of the present disclosure is not limited to this embodiment. The scope of protection of this disclosure should be interpreted by the claims, and it should be interpreted that all technical ideas that are the same or equivalent to the above-mentioned protection scope are included in the scope of rights of this disclosure.
- Accordingly, although the present invention has been disclosed as a preferred embodiment, it is not intended to limit the present invention. Those skilled in the art without departing from the scope of the present invention may make various changes or modifications, and thus the scope of the present invention should be after the appended claims and their equivalents.
Claims (10)
1. A voice wake-up device, comprising:
a microphone module for receiving ambient sounds when an electronic device is in a hibernation mode;
an electrical connector for electrically connecting to a connection port of the electronic device to connect the voice wake-up device to the electronic device; and
a microcontroller unit coupled to the microphone module and the electrical connector and comprising at least one microcontroller and a memory for storing executable instructions of the microcontroller which enable the microcontroller unit to execute multiple tasks comprising:
detecting whether a sound signal is in the ambient sounds received by the microphone module, and generating an input sound signal according to the sound signal;
determining whether the input sound signal comprises a predetermined wake-up voice; and
confirming the predetermined wake-up voice is comprised in the input sound signal and outputting a wake-up instruction to wake up the electronic device entering the non-hibernation mode from the hibernation mode.
2. The voice wake-up device of claim 1 , wherein the multiple tasks performed by the microcontroller unit further comprise performing a noise canceling processing by the microcontroller unit before the task of determining the predetermined wake-up voice is comprised in the input sound signal for canceling noises of the ambient sounds received by the microphone module, and comprise performing an echo processing for canceling the echo in the ambient sounds.
3. The voice wake-up device of claim 1 , wherein the microphone module comprises a microphone array composed of a plurality of microphones, and the microcontroller unit comprises at least one beamforming component, wherein the microphone array is configured to receive the ambient sounds from different directions, and the beamforming component generates concentrated directional input sound signals according to the ambient sounds in the different directions
4. The voice wake-up device of claim 1 , further comprising a stabilizer and a quartz-crystal oscillator respectively coupled to the microcontroller unit.
5. The voice wake-up device of claim 4 , further comprising a power supply module coupled to the stabilizer and serving as a power supply source for the voice wake-up device independent to the electronic equipment.
6. A control method of a voice wake-up device for waking up an electronic device in a hibernation mode, the electronic device having a connecting port, the voice wake-up device comprising a microphone module, an electrical connector, and a microcontroller unit comprising at least one microcontroller and a memory, and the control method comprising:
electrically connecting the electrical connector and the connecting port of the electronic device to connect the voice wake-up device to the electronic device and setting a wake-up voice;
determining whether the electronic device is in a hibernation mode or in a non-hibernation mode by the microcontroller unit;
receiving ambient sounds by the microphone module when the electronic device is in the hibernation mode;
detecting whether a sound signal is in the ambient sounds received by the microphone module, generating an input sound signal according to the sound signal, and judging whether the wake-up voice predetermined is comprised in the input sound signal; and
confirming the wake-up voice predetermined is comprised in the input sound signal and outputting a wake-up instruction to wake up the electronic device entering the non-hibernation mode from the hibernation mode.
7. The control method of the voice wake-up device of claim 6 , further comprising performing a noise canceling processing by the microcontroller unit before determining the wake-up voice predetermined is comprised in the input sound signal for canceling noises of the ambient sounds received by the microphone module, and comprising performing an echo processing for canceling echoes in the ambient sounds.
8. The control method of the voice wake-up device according to claim 6 , wherein receiving the ambient sounds by the microphone module when the electronic device is in the hibernation mode comprises: receiving the ambient sounds from different directions by a microphone array composed of a plurality of microphones of the microphone module, and generating concentrated directional input sound signals according to the ambient sounds in the different directions by at least one beamforming component of the microcontroller unit.
9. The control method of a voice wake-up device of claim 6 , wherein the voice wake-up device further comprises a stabilizer coupled to the microcontroller unit, a quartz-crystal oscillator coupled to the microcontroller unit , and a power supply module coupled to the stabilizer, the power supply module is configured as a power supply source for the voice wake-up device independent to the electronic device, the stabilizer is configured to stabilize the voltage supplied to the voice wake-up device, and the quartz-crystal oscillator is configured to make the microcontroller unit operate at a predetermined operating frequency.
10. The control method of the voice wake-up device of claim 6 , wherein the microphone module repeatedly executes an action of receiving the ambient sounds after a specified interval time has elapsed to make the voice wake-up device be able to wake up the electronic device instantly.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109145369A TWI765485B (en) | 2020-12-21 | 2020-12-21 | External voice wake-up device and method of controlling same |
TW109145369 | 2020-12-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
US20220199072A1 true US20220199072A1 (en) | 2022-06-23 |
Family
ID=82022464
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/545,883 Abandoned US20220199072A1 (en) | 2020-12-21 | 2021-12-08 | Voice wake-up device and method of controlling same |
Country Status (2)
Country | Link |
---|---|
US (1) | US20220199072A1 (en) |
TW (1) | TWI765485B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024051199A1 (en) * | 2022-09-09 | 2024-03-14 | 青岛海尔空调器有限总公司 | Method and apparatus for controlling voice control device, and device for controlling voice control |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120051716A1 (en) * | 2010-08-24 | 2012-03-01 | Allen Ku | Keyboard having video and audio recording function |
US20130289994A1 (en) * | 2012-04-26 | 2013-10-31 | Michael Jack Newman | Embedded system for construction of small footprint speech recognition with user-definable constraints |
US20140281628A1 (en) * | 2013-03-15 | 2014-09-18 | Maxim Integrated Products, Inc. | Always-On Low-Power Keyword spotting |
US20160232899A1 (en) * | 2015-02-06 | 2016-08-11 | Fortemedia, Inc. | Audio device for recognizing key phrases and method thereof |
US20180275737A1 (en) * | 2014-12-16 | 2018-09-27 | Stmicroelectronics (Rousset) Sas | Electronic device with a wake up module distinct from a core domain |
US20190027138A1 (en) * | 2017-07-24 | 2019-01-24 | Midea Group Co., Ltd. | Customizable Wake-up Voice Commands |
US20190027139A1 (en) * | 2017-07-21 | 2019-01-24 | Primax Electronics Ltd. | Digital voice assistant operation system |
US20190174226A1 (en) * | 2017-12-06 | 2019-06-06 | Honeywell International Inc. | Systems and methods for automatic speech recognition |
US20200013407A1 (en) * | 2019-05-21 | 2020-01-09 | Lg Electronics Inc. | Method and apparatus for recognizing a voice |
US10601599B2 (en) * | 2017-12-29 | 2020-03-24 | Synaptics Incorporated | Voice command processing in low power devices |
US10824391B2 (en) * | 2010-08-23 | 2020-11-03 | Nokia Technologies Oy | Audio user interface apparatus and method |
US20210005181A1 (en) * | 2019-06-10 | 2021-01-07 | Knowles Electronics, Llc | Audible keyword detection and method |
US20210065693A1 (en) * | 2019-02-20 | 2021-03-04 | Google Llc | Utilizing pre-event and post-event input streams to engage an automated assistant |
US20210125611A1 (en) * | 2019-10-29 | 2021-04-29 | Lg Electronics Inc. | Voice recognition method and device |
US20210195274A1 (en) * | 2018-05-29 | 2021-06-24 | Konka Group Co., Ltd. | Circuit integrated with voice wake-up function, television and voice control method |
US20210287671A1 (en) * | 2015-04-10 | 2021-09-16 | Honor Device Co., Ltd. | Speech recognition method, speech wakeup apparatus, speech recognition apparatus, and terminal |
US20210373596A1 (en) * | 2019-04-02 | 2021-12-02 | Talkgo, Inc. | Voice-enabled external smart processing system with display |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9063731B2 (en) * | 2012-08-27 | 2015-06-23 | Samsung Electronics Co., Ltd. | Ultra low power apparatus and method to wake up a main processor |
CN111199733A (en) * | 2018-11-19 | 2020-05-26 | 珠海全志科技股份有限公司 | Multi-stage recognition voice awakening method and device, computer storage medium and equipment |
CN109949810B (en) * | 2019-03-28 | 2021-09-07 | 荣耀终端有限公司 | Voice wake-up method, device, equipment and medium |
-
2020
- 2020-12-21 TW TW109145369A patent/TWI765485B/en active
-
2021
- 2021-12-08 US US17/545,883 patent/US20220199072A1/en not_active Abandoned
Patent Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10824391B2 (en) * | 2010-08-23 | 2020-11-03 | Nokia Technologies Oy | Audio user interface apparatus and method |
US20120051716A1 (en) * | 2010-08-24 | 2012-03-01 | Allen Ku | Keyboard having video and audio recording function |
US20130289994A1 (en) * | 2012-04-26 | 2013-10-31 | Michael Jack Newman | Embedded system for construction of small footprint speech recognition with user-definable constraints |
US20140281628A1 (en) * | 2013-03-15 | 2014-09-18 | Maxim Integrated Products, Inc. | Always-On Low-Power Keyword spotting |
US20180275737A1 (en) * | 2014-12-16 | 2018-09-27 | Stmicroelectronics (Rousset) Sas | Electronic device with a wake up module distinct from a core domain |
US20160232899A1 (en) * | 2015-02-06 | 2016-08-11 | Fortemedia, Inc. | Audio device for recognizing key phrases and method thereof |
US20210287671A1 (en) * | 2015-04-10 | 2021-09-16 | Honor Device Co., Ltd. | Speech recognition method, speech wakeup apparatus, speech recognition apparatus, and terminal |
US20190027139A1 (en) * | 2017-07-21 | 2019-01-24 | Primax Electronics Ltd. | Digital voice assistant operation system |
US20190027138A1 (en) * | 2017-07-24 | 2019-01-24 | Midea Group Co., Ltd. | Customizable Wake-up Voice Commands |
US20190174226A1 (en) * | 2017-12-06 | 2019-06-06 | Honeywell International Inc. | Systems and methods for automatic speech recognition |
US10601599B2 (en) * | 2017-12-29 | 2020-03-24 | Synaptics Incorporated | Voice command processing in low power devices |
US20210195274A1 (en) * | 2018-05-29 | 2021-06-24 | Konka Group Co., Ltd. | Circuit integrated with voice wake-up function, television and voice control method |
US20210065693A1 (en) * | 2019-02-20 | 2021-03-04 | Google Llc | Utilizing pre-event and post-event input streams to engage an automated assistant |
US20210373596A1 (en) * | 2019-04-02 | 2021-12-02 | Talkgo, Inc. | Voice-enabled external smart processing system with display |
US20200013407A1 (en) * | 2019-05-21 | 2020-01-09 | Lg Electronics Inc. | Method and apparatus for recognizing a voice |
US20210005181A1 (en) * | 2019-06-10 | 2021-01-07 | Knowles Electronics, Llc | Audible keyword detection and method |
US20210125611A1 (en) * | 2019-10-29 | 2021-04-29 | Lg Electronics Inc. | Voice recognition method and device |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024051199A1 (en) * | 2022-09-09 | 2024-03-14 | 青岛海尔空调器有限总公司 | Method and apparatus for controlling voice control device, and device for controlling voice control |
Also Published As
Publication number | Publication date |
---|---|
TWI765485B (en) | 2022-05-21 |
TW202225910A (en) | 2022-07-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9310838B2 (en) | Power management method for switching power mode of a computer system based on detection of a human interface device | |
KR101770932B1 (en) | Always-on audio control for mobile device | |
US10409482B2 (en) | Electronic system, touch sensitive processing apparatus and method thereof for switching to normal operation mode upon receiving touch gesture in power saving mode | |
KR101994569B1 (en) | Clock Switching on Constant-On Components | |
JP5635628B2 (en) | Power management method and apparatus for network access module | |
JP2019159305A (en) | Method, equipment, system, and storage medium for implementing far-field speech function | |
US9401141B2 (en) | Computer system having voice-control function and voice-control method | |
TWI713016B (en) | Speech detection processing system and speech detection method | |
TWI574148B (en) | Embedded controller for power-saving and method thereof | |
JP7471213B2 (en) | Voice Chips and Electronics | |
US20220199072A1 (en) | Voice wake-up device and method of controlling same | |
US20180338206A1 (en) | Control method and control system for audio device | |
CN111741518A (en) | WiFi chip circuit and WiFi device | |
CN110853644B (en) | Voice wake-up method, device, equipment and storage medium | |
US20240028103A1 (en) | Mechanism for Saving Power on a Bus Interface | |
CN113031749A (en) | Electronic device | |
KR101978323B1 (en) | An apparatus and method for managing a efficient power supply by using GPIO ports | |
JP7133055B2 (en) | Signal processing method, apparatus, electronic equipment and computer program product | |
CN114649000A (en) | Voice wake-up device and control method thereof | |
US20230115005A1 (en) | Flashing apparatus, booting and recovery appartus, and electronic device | |
CN108376059B (en) | Universal computer voice starting awakening device | |
CN113311933B (en) | Equipment peripheral setting method and device of large-screen intelligent equipment and large-screen intelligent equipment | |
US20140121796A1 (en) | Audio processing device | |
CN210295081U (en) | Electronic device | |
KR20070061625A (en) | Micro controller unit of multi-chip module, multi-chip module including the micro controller unit, and method of synchronizing power mode in multi-chip module |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
AS | Assignment |
Owner name: SILICON INTEGRATED SYSTEMS CORP., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WANG, KAI-PING;TING, KUN-TIEN;LO, PIN-HAN;REEL/FRAME:059802/0031 Effective date: 20201221 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |