US20180317019A1 - Acoustic activity detecting microphone - Google Patents
Acoustic activity detecting microphone Download PDFInfo
- Publication number
- US20180317019A1 US20180317019A1 US16/020,932 US201816020932A US2018317019A1 US 20180317019 A1 US20180317019 A1 US 20180317019A1 US 201816020932 A US201816020932 A US 201816020932A US 2018317019 A1 US2018317019 A1 US 2018317019A1
- Authority
- US
- United States
- Prior art keywords
- electrical circuit
- clock signal
- host interface
- microphone
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000000694 effects Effects 0.000 title claims abstract description 40
- 238000001514 detection method Methods 0.000 claims abstract description 57
- 230000004044 response Effects 0.000 claims abstract description 12
- 238000000034 method Methods 0.000 claims description 27
- 230000008569 process Effects 0.000 claims description 23
- 239000000872 buffer Substances 0.000 claims description 19
- 238000012545 processing Methods 0.000 claims description 8
- 238000013459 approach Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 9
- 230000008859 change Effects 0.000 description 8
- 238000004519 manufacturing process Methods 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 5
- 230000001413 cellular effect Effects 0.000 description 4
- 230000007704 transition Effects 0.000 description 4
- 238000012360 testing method Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R17/00—Piezoelectric transducers; Electrostrictive transducers
- H04R17/02—Microphones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3215—Monitoring of peripheral devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/08—Mouthpieces; Microphones; Attachments therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R19/00—Electrostatic transducers
- H04R19/005—Electrostatic transducers using semiconductor materials
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R19/00—Electrostatic transducers
- H04R19/04—Microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/324—Power saving characterised by the action undertaken by lowering clock frequency
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
- H04R2201/003—Mems transducers or their use
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
- H04R2460/03—Aspects of the reduction of energy consumption in hearing devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
-
- Y02D10/126—
Definitions
- This application relates to microphones and more specifically to acoustic activity detection by such microphones and methods therefor.
- Microphones are used to detect voice signals and other acoustic activity. Once obtained, the signal can be processed in a number of different ways. A wide variety of functions can be provided by today's microphones and they can interface with and utilize a variety of different algorithms. Some microphones are composed of a microelectromechanical systems (MEMS) transducer or sensor that generates an electrical signal in response to acoustic input and an integrated circuit that processes the electrical signal.
- MEMS microelectromechanical systems
- Voice triggering for example, as used in mobile communication devices is an increasingly popular feature.
- a user may wish to speak commands into a mobile device and have the device react in response to the commands.
- DSP programmable digital signal processor
- VAD voice activity detection
- FIG. 1 comprises a block diagram of a system with a microphone that uses a VAD algorithm and includes power savings features ;
- FIG. 2 comprises a diagram of the various states of a system that uses a microphone that uses a VAD algorithm and includes power savings features;
- FIG. 3 comprises a block diagram of a microphone that uses a VAD algorithm and includes power savings features
- FIG. 4 comprises a block diagram of an application specific integrated circuit (ASIC);
- ASIC application specific integrated circuit
- FIG. 5 comprises a block diagram of a host
- FIG. 6 comprises a timing diagram showing the operation of a microphone that uses a VAD algorithm and includes power savings features.
- FIG. 7 comprises a block diagram of a system that uses frequency detection in a microphone.
- FIG. 8 comprises a chart showing operation of the frequency detection approaches.
- FIG. 9 comprises a block diagram of an integrated circuit (IC).
- the present approaches change the way that present mobile systems are partitioned, the functionality of the microphone, and the modes in which it can operate.
- a microphone with a voice or event detection block is presented and this enables the microphone to generate an interrupt signal which can wake the system up.
- the microphones described herein include five external connections.
- the first connection may be a power connection and the second connection may be a ground connection.
- the third, fourth, and fifth connections are connections from the microphone to a host device (e.g., host circuitry in the device in which the microphone resides). More specifically, the third connection may be a data connection, the fourth connection may be an interrupt (sent from the microphone to the host), and the fifth connection may be a clock signal (sent from the host to the microphone).
- the microphone may have several modes of operation and these are controlled by a clock signal.
- the host receives a data signal from the microphone as well as an interrupt signal.
- the host has multiple power modes controlled by the interrupt signal generated by the microphone.
- the host generates the clock signal for the microphone and thereby controls the mode of operation of the microphone. In one example, the absence of a clock causes the microphone to enter voice activity detection (VAD) mode.
- VAD voice activity detection
- the microphone includes a VAD mode of operation.
- the microphone In this mode of operation, the microphone has a very low power consumption, and it runs on a relatively low clock frequency which can be supplied either externally (from the host) or from an on-chip oscillator.
- the analog signal processing blocks of the microphone (such as the microphone preamplifier, the analog to digital converter, the voltage regulators and the charge pump supplying the bias voltage for the microelectromechanical systems (MEMS) microphone) operate at lower power. In this mode, these blocks are operated at reduced power enough for achieving the bandwidth and signal to noise ratio (SNR) needed for the VAD or event detector to function. For example, a bandwidth of operation of approximately 8 kHz after decimation and an SNR of approximately 60 dB can be achieved.
- SNR signal to noise ratio
- the VAD or event detector can be implemented using well known techniques. For example, short term energy measures vs. long term energy measures, zero crossing and so forth can be used to detect voice signals.
- the interface (the connections between the host and the microphone) is not limited to the exact signals described herein. In these regards, other signals or other combinations of signals may be used.
- the physical implementation of the interface may also vary. For example, it may be a single physical bi-directional line, or multiple uni-directional lines.
- the microphone further includes a delay buffer. Audio data is sequentially written to the buffer.
- buffered data upon wake up, buffered data is transmitted over a first transmission line and real-time data is transmitted simultaneously over a second and separate output line.
- buffered data is flushed or discarded upon switching modes.
- the microphone is over-clocked to catch up buffered data to real-time data.
- the microphone can also be used for multi-microphone voice triggered applications.
- the microphone wakes up and enables data synchronizations of a second microphone either in a buffered or a real-time mode.
- the frequency of the input clock is compared to an internally generated clock signal.
- the frequency of the input clock is indicative of the operational mode of an application specific integrated circuit (ASIC) or other device.
- ASIC application specific integrated circuit
- the comparison allows for accurate detection of the input frequency.
- the current provided to different operational blocks of the ASIC can be changed based upon the frequency (which now has been measured accurately). In other words, the current (or power) consumption of the ASIC (or portions of the ASIC) follows the frequency change of the input clock. Additional, different operation modes dependent on the frequency of the input clock are followed and their specific current and power needs are addressed because of the flexibility of changing the current according to these approaches.
- the internal oscillator signal (from the ASIC) is temperature compensated for its frequency.
- the internal oscillator signal (from the ASIC) is not process compensated for frequency, but rather the process compensation is performed during manufacturing test of the ASIC, where trim test for process compensation is done and then the trim value is stored to One Time Programmable (OTP) memory.
- OTP One Time Programmable
- the current consumption values for a given operational mode or frequency is determined by the requirements on noise and current consumption.
- noise is also a parameter that is considered and controlled, as there is a well-known relation between noise and current consumption in analog mixed-mode integrated circuit (IC) design.
- an application specific integrated circuit is coupled to an acoustic device.
- the ASIC includes at least one operational block and a frequency detection block.
- the frequency detection block is configured to receive an input clock signal, determine the frequency of the input clock signal, the frequency indicative of one of a plurality of operational modes of the ASIC.
- the frequency detection block is further configured to based upon the determined frequency, change an amount current provided to the at least one operational block.
- the frequency detection block compares the input clock to an internally generated clock signal that runs independently of temperature and process.
- the acoustic device is a micro-electro-mechanical system (MEMS) microphone.
- MEMS micro-electro-mechanical system
- each of the plurality of modes has a different discrete current consumption.
- the modes may be a stand-by mode, a low power mode, a standard performance mode, or a high performance mode. Other examples are possible.
- an application specific integrated circuit is used with an acoustic device.
- An input clock signal is received.
- the frequency of the input clock signal is determined, and the frequency is indicative of one of a plurality of operational modes of the ASIC. Based upon the determined frequency, an amount of current provided to one or more operational blocks of the ASIC is changed or adjusted.
- the microphone 102 may in one example, include a MEMS chip (with MEMS die, diaphragm, and charge plate) and an application specific integrated circuit (ASIC).
- the system also includes a host 104 .
- the host 104 may include various processing functions and may be part of a device (e.g., a personal computer or cellular phone, mobile handset, or tablet) where the microphone 102 resides.
- a VDD power signal 112 and a ground signal 114 are coupled to the microphone 102 .
- An interrupt signal 108 and a data signal 110 are sent from the microphone 102 to the host 104 .
- a clock signal 106 is sent from the host 104 to the microphone 102 .
- the microphone 102 has several modes of operation and these are controlled by the clock signal 106 .
- the host 104 receives the data signal 110 from the microphone 102 as well as an interrupt signal 108 .
- the host 104 has multiple power modes controlled by the interrupt signal 108 that is generated by the microphone 102 upon the detection of voice activity or a particular voice event (e.g., a specific spoken word).
- the host 104 generates the clock signal 106 for the microphone 102 and thereby controls the mode of operation of the microphone 102 .
- the microphone 102 includes a VAD mode of operation.
- the microphone 102 has a very low power consumption, and it runs on a relatively low clock frequency which can be supplied either externally (from the clock signal 106 supplied by the host 104 ) or from an internal on-chip oscillator in the microphone 102 . Consequently, when an interrupt is made, the low power operation can be changed to a higher powered mode of operation. As will be recognized, the interrupt allows the system to be operated in both a low power mode of operation and a high power mode of operation.
- the integrated circuit and the MEMS circuit receive a clock signal from an external host.
- the clock signal is effective to cause the MEMS circuit and integrated circuit to operate in full system operation mode during a first time period and in a voice activity mode of operation during a second time period.
- the voice activity mode has a first power consumption or level and the full system operation mode has a second power consumption or level.
- the first power consumption is less than the second power consumption.
- the integrated circuit is configured to generate an interrupt upon the detection of voice activity, and send the interrupt to the host. The absence of a clock causes the microphone to enter a voice activity detection mode.
- the clock circuit may be located on the same chip as the other components or located externally.
- the present approaches provide the ability to operate the internal clock at a third power consumption or level and thereafter generate an external data stream and clock to signal the system to operate at a fourth power consumption or level.
- the third power level is less than the fourth power level
- the fourth power level is less than the first power level.
- the external clock may be detected and this may be applied after the detection of voice activity. Then, the internal clock is synchronized to the external clock. Furthermore, the VAD signal processing is also synchronized to the external clock after synchronization.
- system may fall back to the internal clock for power savings at the first or second power level when the external clock is removed to reduce overall system power.
- an external signal may be generated from the internal combination of the clock and the acoustic activity detection that acts as a signal and clock combination to signal the host to interrupt/wake up and recognize the voice signal.
- the bandwidth of the input signal after buffering may be in one example approximately 8 kHz. Other examples are possible.
- Data may be provided in PCM or PDM formats. Other examples of formats are possible.
- FIG. 2 various operational states of a system that uses a microphone that uses a VAD algorithm is described.
- the approach of FIG. 2 has three modes of operation: a VAD mode 202 , a wake up host (partially) mode 204 , and a full system operation mode 206 .
- the mode 202 In the VAD mode 202 , no data is transmitted out of the microphone.
- the host is sleeping in this mode. In one aspect, when the host is sleeping only the functionality needed to react to a generated interrupt signal from the microphone is enabled. In this mode, the host is clocked at a very low clock to lower power and all unnecessary functionality is powered down. This mode has the absolute lowest power consumption possible as all unnecessary blocks are powered down and no switching of clock or data signals occur. In other words, the mode 202 is a low power mode, where VAD is enabled and no external clock is being received from the host.
- the external clock is received from the host. Data is transmitted out of the microphone.
- the host becomes partially awake due to the detection of a keyword and/ or the detection of voice activity. Subsequently, the external clock for the microphone is enabled with a clock frequency corresponding to a higher performance level enough for doing reliable keyword detection.
- the full system operation mode 206 is the high power or standard operating mode of the microphone.
- the system begins in mode 202 .
- the VAD algorithm detects an event which will trigger the transition from VAD mode 202 to partially wake up/ wake up mode 204 .
- the host detects a keyword/speech and decides that a specific key word, phrase, or sentence is recognized. This determination triggers the transition from the mode 204 to the full system wake up 206 .
- the host keyword detect/speech recognition algorithm decides that no key word, phrase, or sentence is recognized which triggers the transition back to the VAD mode 202 .
- another mode or state (not shown here in FIG. 2 ) determines that the system should enter partially wake up/wake up mode 204 or go directly to the VAD mode 202 .
- the microphone 300 includes a microphone chip or device 302 .
- the microphone chip 302 includes a MEMS die, diaphragm, and charge plate.
- the system also includes an ASIC 304 .
- the ASIC 304 may include various processing functions.
- the MEMS chip 302 receives a charge pump signal 315 from the ASIC 304 to power the MEMS chip 302 .
- a VDD power signal 312 and a ground signal 314 are coupled to the ASIC 304 .
- An interrupt signal 308 and a data signal 310 are sent by the ASIC 304 to a host (e.g., the host 104 of FIG. 1 ).
- a clock signal 306 sent from the host is received by the ASIC 304 .
- the microphone 300 has several modes of operation and these are controlled by the clock signal 306 .
- a voice signal is received by the MEMS chip 302 and this sound is converted into an electrical signal and sent over data lead 311 to the ASIC 304 .
- the ASIC 304 processes the signal into a data signal and then transmits the data signal 310 from the ASIC 304 as well as creating an interrupt signal 308 .
- the host e.g., the host 104 of FIG. 1 ) generates the clock signal 306 and this controls the mode of operation of the microphone 300 .
- the microphone 300 includes a VAD mode of operation.
- the microphone 300 has a very low power consumption, and it runs on a relatively low clock frequency which can be supplied either externally (from the clock signal 306 supplied by the host) or from an internal on-chip oscillator in the microphone 300 . Consequently, when an interrupt is made, the low power operation can be changed to a higher powered operation.
- the interrupt allows the system to be operated in both a low power mode of operation and a high power mode of operation.
- the ASIC 400 includes a charge pump (CHP) 402 , an amplifier 404 , an analog-to-digital converter 406 , a voice activity detector (VAD) 408 , a control block 410 (with oscillator 412 ), and a switch 414 .
- CHP charge pump
- VAD voice activity detector
- the charge pump CHP 402 charges the MEMS element (e.g., the MEMS chip 302 of FIG. 3 ) to convert changes in capacitance to voltage.
- the amplifier 404 buffers the electrical signal of the MEMS element (e.g., the MEMS chip 302 of FIG. 3 ) and subsequently amplifies the signal with a gain of A.
- the A/D converter 406 converts the analog signal from the amplifier 404 to a digital signal.
- the VAD 408 processes the digital signal from the A/D converter 406 and generates an interrupt signal 411 if voice is detected.
- the control block 410 controls the internal states of the ASIC 400 in response to an external clock signal 413 (received from a host) and the interrupt signal 411 from the VAD 408 .
- the switch 414 is controlled by the control block 410 to allow data 415 to be sent to an external host.
- a data buffer may be included at the output of the A/D converter 406 .
- the buffer may buffer data representing the audio signal and correspond to or approximate the delay of the VAD 408 (e.g., 10 ms-360 ms to mention one example range with other ranges being possible).
- a decimation filter stage could be included at the output of the A/D converter in order to reduce buffer size (sampler RAM) and power, this will limit the bandwidth. In this case an interpolation stage at the buffer output must be added as well.
- the delay may be around 200 msec. In another example, the delay may be around 360 msec. Other examples of delay values are possible.
- the buffer is provided to allow any recognition algorithm the latency required to wake up the host, collect sufficient background noise statistics, and recognize the key phrase within the ambient noise.
- the buffered data may be sent to the host via some connection such as the interrupt line 411 or the data line 415 . If sending data via the data line 415 , it may be sent at an increased clock rate compared to the sampling clock.
- the parameters or settings of the VAD 408 may be changed or controlled.
- the reading or writing settings of registers and memory (both erasable and non-erasable) of the VAD 408 may be changed or controlled to, for example, account for various levels of background noise.
- the functionality of the VAD 408 may be enhanced or changed. For example, voice or phrase detection may be used. Other functions may also be included.
- the host 500 includes an interface block 502 , a digital signal processing (DSP) block 504 (including a keyword detection block 506 and word/voice recognition block 508 ), a control block 510 (clocked by an on-chip oscillator 511 ), and a memory 512 .
- DSP digital signal processing
- the interface block 502 provides interfacing functionality with respect to a microphone (e.g., the microphone 102 in FIG. 1 ).
- the interface block transmits the clock signal 520 to the microphone and receives from the microphone an interrupt signal 522 and a data signal 524 .
- the DSP block processes the data signal in two steps using the keyword detection block 506 (detecting a keyword) and the word/voice recognition block 508 (detecting a word or voice).
- the control block 510 controls the power states of the microphone (e.g., the microphone 102 of FIG. 1 ), the blocks of the host 500 , and the entire system including other blocks and functions outside the host and microphone (not shown here in FIG. 5 ).
- the memory 512 stores the states of the system, data, and other information.
- the on chip oscillator 511 is controllable from the control block 510 and enables at least two clock modes corresponding to at least two power modes.
- FIG. 6 a timing diagram showing the operation of a microphone that uses a VAD algorithm and includes power savings features is described.
- the signals of FIG. 6 show how the system and in particular how the microphone reacts to a voice/event signal and generates an interrupt signal. Subsequent to the interrupt signal, the diagrams show how the host reacts to the interrupt signal by changing its mode and afterwards changing the frequency of the clock signal to change the mode of the microphone.
- Signal 602 shows an audio signal.
- the microphone Upon detection of an audio signal, the microphone generates an interrupt as shown by signal 604 .
- Data is also generated by the microphone as shown by signal 606 .
- the host in response to the interrupt changes the clock signal (sent to the microphone) from a low frequency signal to a high frequency signal.
- the host in low power mode (before the event), the host may not send a clock signal and may only start the high frequency clock signal upon detection of the event.
- the microphone assembly includes a MEMS device 702 , and an application specific integrated circuit (ASIC) 704 .
- the assembly couples to external circuitry 706 that is part of a host device 709 .
- the host device may be a cellular phone, personal computer, or any other device that uses microphones.
- the circuitry of the host device is any type of electronic circuitry that performs any type of processing function.
- the circuitry may be divided into functional modules as appropriate and may be any combination of hardware and software elements (e.g., it may include microprocessors that execute programmed instructions).
- the host device circuitry 706 includes a clock 708 that is coupled to the ASIC 704 of the microphone assembly 700 .
- the MEMS device 702 is any type of MEMS microphone device (i.e., a transducer) that converts sound energy 701 into an analog electrical signal that is transmitted to the ASIC.
- the ASIC may be any type of integrated circuit that performs various types of functions such as buffering or amplification, among other functions described herein.
- the ASIC operates in various modes and each of these modes of operation utilizes or requires different power levels. If the power level is incorrect, the ASIC will either not operate or not operate properly.
- the ASIC processes the signal received from the MEMS device for use by the host device.
- a frequency detection block 714 is configured to provide current adjustment based upon the received input frequency from the external clock 708 of the host device.
- the frequency of the external clock represents the mode of operation of the ASIC and more generally the microphone assembly.
- the frequency of the external clock is compared by block 714 to an internally generated clock signal from an internal oscillator 710 on the ASIC.
- the frequency of the external clock is indicative of the operational mode of the ASIC.
- the comparison by block 714 allows for accurate detection of the frequency of the external clock 108 .
- the current provided to different operational blocks 712 of the ASIC can be changed by block 714 based upon this detected frequency (which now has been measured accurately). In other words, the current consumption of the ASIC or portions thereof follows the frequency change of the external clock. Additional and/or different operation modes dependent on the frequency of the external clock are followed and their specific current and power needs are addressed because of the flexibility of changing the current.
- the operation of the microphone is divided into four modes 802 , 804 , 806 and 808 . It will be understood that fewer or additional numbers of modes can be defined based on the requirements from the ASIC including current consumption and noise. These modes have different discrete levels of current consumption as shown on the vertical axis and these current levels are adjusted according to the present approaches. It can be seen that these current levels change in discrete steps, rather than along a linear sloped pattern.
- the standby mode 802 is where the current consumption is at a minimum, but the microphone is not functional.
- the low power mode 804 is where the current consumption is kept at a minimum but the microphone is functional with reduced performance.
- the standard performance mode 806 is where the current consumption is higher compared to the low power mode 804 and at the same time performance of the microphone is increased.
- the high performance mode 808 is where both the current consumption and the performance are at maximum.
- the current consumption is further increased (or decreased) and follows the detected frequency of the external clock.
- clock driven circuits by nature require higher current consumption for higher clock frequency for a given performance or require higher current consumption for better noise performance.
- Examples of circuits needing varying power levels include analog-to-digital (A-to-D) converters and switch-capacitor filters, both of which are commonly used in digital microphones. Other examples are possible.
- FIG. 9 one example of a frequency detect and current adjustment block 900 (e.g., block 714 of FIG. 7 ) are described.
- FIG. 9 illustrates one possible implementation about how to make bias current following the frequency of input clock independent of process, and temperature variations.
- the block 900 includes an internal oscillator 902 , a clock divider 904 , a frequency detection device 906 , a bias current generator 908 , one-time programmable (OTP) memory bits 910 and 911 , and a clock input pad 912 that couples to the frequency detection device 906 .
- the block 900 may be disposed on an ASIC 916 .
- the ASIC may be disposed in a device 918 that includes a clock 920 , which is coupled to the clock input pad 912 .
- the device 918 may be a cellular phone or personal computer to mention two examples.
- the internal oscillator 902 outputs a signal received by the clock divider 904 .
- the OTP bits 910 may be used to compensate for process variations during the manufacturing process. For example, the oscillator frequency may be measured, compared to what is desired, and the bits applied to make the oscillator operate at the desired frequency.
- the output of the oscillator 902 is a temperature compensated clock signal.
- OTP bits 911 are applied to the clock divider 904 in the form of a division ratio 913 to compensate for various tolerances amongst oscillators/ASICs. This may occur during manufacturing where the division ratio is changed based upon the particular oscillators/ASIC.
- the output of the divider 904 is a temperature and process compensated clock signal. In other words, the output of the divider 904 can be considered an accurate clock since both temperature and process have been considered and compensation was made to the clock signal based upon these factors.
- the frequency detection device 906 compares the input clock (from the device 918 ) to the accurate clock to find out the frequency of the input clock. It sends an n-bit control signal to the bias current generator 908 .
- the bias current generator 908 may also be adjusted by the OTP bits during manufacturing to compensate for process variations.
- the n-bits are a digital bit representation of the input clock frequency. For example, if the digital representation is 1, frequency may be 100 Khz, if it is 2, frequency may be between 100 kHz and 200 kHz, and so forth. This n-bit signal activates various ones of the switches 921 within the generator 908 . The more switches 912 that are closed, the more current that is supplied.
- the current is adjusted based upon the frequency (which represents mode) of the clock 920 .
- the current from 908 may flow to different blocks 922 of the ASIC, thereby operating the ASIC as needed.
- the approaches utilized in FIG. 9 result in a stepped current response, rather than a linear progression.
- the present approaches provide digital microphone that operate in multiple modes with different performance aspects including current consumption and noise. Changes in performance aspects are controlled through the change in the clock input frequency. Detection of change in the clock input frequency is done by comparing the clock input to an internally generated accurate clock source from an oscillator on the ASIC. The internally generated clock signals (on the ASIC) run independently of both temperature and process. Temperature independency can be achieved by using process independent current source in the oscillator. Process independency can be achieved by using OTP registration of process variation compensation during ASIC production tests.
- a microphone apparatus includes an acoustic sensor configured to produce an electrical signal at an output of the acoustic sensor in response to sensing an acoustic signal; an electrical circuit including an acoustic activity detector, a frequency detection circuit and a control block, the electrical circuit having an input coupled to the output of the acoustic sensor, the electrical circuit configured to process the electrical signal; an internal clock signal generator coupled to the electrical circuit; and a host interface with external connections coupled to the electrical circuit, the external connections including a connection for an external clock signal and data, the external clock signal connection coupled to the frequency detection circuit.
- the microphone assembly has an acoustic activity detection mode of operation when the electrical circuit is clocked using the internal clock signal generator in the absence of an external clock signal at the host interface, and the electrical circuit is configured to provide an interrupt signal to the host interface upon detection of acoustic activity by the electrical circuit.
- the electrical circuit is configured to control the operating mode of the microphone assembly based on a frequency of an external clock signal received at the host interface in response to providing the interrupt signal.
- the electrical circuit is configured to provide data representing the electrical signal to the host interface using the external clock signal received at the host interface.
- a microphone apparatus includes an acoustic sensor; an electrical circuit having an input coupled to an output of the acoustic sensor, the electrical circuit including an acoustic activity detector and a frequency determination circuit; an internal clock signal generator coupled to the electrical circuit; and a host interface with external connections coupled to the electrical circuit, the host interface including a connection for an external clock signal and data.
- the acoustic activity detector is configured to process, in an acoustic activity detection mode, data representing an electrical signal output by the acoustic sensor for acoustic activity when the electrical circuit is clocked by a clock signal of the internal clock signal generator in the absence of an external clock signal on the host interface.
- the electrical circuit is configured to provide an interrupt signal to the host interface after detection of acoustic activity, and the electrical circuit is configured to control an operating mode of the microphone assembly based on a frequency of an external clock signal received at the host interface in response to the interrupt signal.
- the electrical circuit is configured to provide data representing the electrical signal to the host interface using the external clock signal received at the host interface.
Abstract
Description
- This patent is a continuation in part of copending U.S. application Ser. No. 14/824,736 filed on 12 Aug. 2015, which is a continuation of 14/522,158 filed on 23 Oct. 2014, which is a continuation of 14/282,101 filed on 20 May 2014, now U.S. Pat. No. 9,712,923, which claims benefit under 35 U.S.C. § 119 (e) to U.S. Provisional Application No. 61/826,587 filed on 23 May 2013, all of which are entitled “VAD detection Microphone and Method of Operating the Same”. This patent is also a continuation in part of copending U.S. application Ser. No. 14/512,846 filed on 13 Oct. 2014, which claims benefits under 35 U.S.C. § 119 (e) to U.S. Provisional Application No. 61/893,453 filed on 21 Oct. 2013, both of which are entitled “Apparatus and Method For Frequency Detection”. The entire contents of these priority applications are incorporated herein by reference.
- This application relates to microphones and more specifically to acoustic activity detection by such microphones and methods therefor.
- Microphones are used to detect voice signals and other acoustic activity. Once obtained, the signal can be processed in a number of different ways. A wide variety of functions can be provided by today's microphones and they can interface with and utilize a variety of different algorithms. Some microphones are composed of a microelectromechanical systems (MEMS) transducer or sensor that generates an electrical signal in response to acoustic input and an integrated circuit that processes the electrical signal.
- Voice triggering, for example, as used in mobile communication devices is an increasingly popular feature. In such devices, a user may wish to speak commands into a mobile device and have the device react in response to the commands. In these cases, a programmable digital signal processor (DSP) will first use a voice activity detection algorithm to detect if there is voice in an audio signal captured by a microphone, and then, subsequently, analysis is performed on the signal to predict the spoken word in the received audio signal. Various voice activity detection (VAD) approaches have been developed and deployed in various types of devices such as cellular phone and personal computers.
- In the use of these approaches, power consumption becomes a concern. Lower power consumption gives longer standby time. For today's smart-phones (in particular), the use of power is a key parameter. Unfortunately, present approaches of operating microphones use and waste much power. This has resulted in user dissatisfaction with these previous approaches and systems.
- For a more complete understanding of the disclosure, reference should be made to the following detailed description and accompanying drawings wherein:
-
FIG. 1 comprises a block diagram of a system with a microphone that uses a VAD algorithm and includes power savings features ; -
FIG. 2 comprises a diagram of the various states of a system that uses a microphone that uses a VAD algorithm and includes power savings features; -
FIG. 3 comprises a block diagram of a microphone that uses a VAD algorithm and includes power savings features; -
FIG. 4 comprises a block diagram of an application specific integrated circuit (ASIC); -
FIG. 5 comprises a block diagram of a host; and -
FIG. 6 comprises a timing diagram showing the operation of a microphone that uses a VAD algorithm and includes power savings features. -
FIG. 7 comprises a block diagram of a system that uses frequency detection in a microphone. -
FIG. 8 comprises a chart showing operation of the frequency detection approaches. -
FIG. 9 comprises a block diagram of an integrated circuit (IC). - Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity. It will be further appreciated that certain actions and/or steps may be described or depicted in a particular order of occurrence while those skilled in the art will understand that such specificity with respect to sequence is not actually required. It will also be understood that the terms and expressions used herein have the ordinary meaning as is accorded to such terms and expressions with respect to their corresponding respective areas of inquiry and study except where specific meanings have otherwise been set forth herein.
- The present approaches change the way that present mobile systems are partitioned, the functionality of the microphone, and the modes in which it can operate. In these regards, a microphone with a voice or event detection block is presented and this enables the microphone to generate an interrupt signal which can wake the system up.
- In some aspects, the microphones described herein include five external connections. The first connection may be a power connection and the second connection may be a ground connection. The third, fourth, and fifth connections are connections from the microphone to a host device (e.g., host circuitry in the device in which the microphone resides). More specifically, the third connection may be a data connection, the fourth connection may be an interrupt (sent from the microphone to the host), and the fifth connection may be a clock signal (sent from the host to the microphone).
- The microphone may have several modes of operation and these are controlled by a clock signal. The host receives a data signal from the microphone as well as an interrupt signal. The host has multiple power modes controlled by the interrupt signal generated by the microphone. The host generates the clock signal for the microphone and thereby controls the mode of operation of the microphone. In one example, the absence of a clock causes the microphone to enter voice activity detection (VAD) mode.
- In one example, the microphone includes a VAD mode of operation. In this mode of operation, the microphone has a very low power consumption, and it runs on a relatively low clock frequency which can be supplied either externally (from the host) or from an on-chip oscillator.
- This operation enables very low power consumption levels as only the most necessary signal processing is active during this mode. In one aspect, the analog signal processing blocks of the microphone (such as the microphone preamplifier, the analog to digital converter, the voltage regulators and the charge pump supplying the bias voltage for the microelectromechanical systems (MEMS) microphone) operate at lower power. In this mode, these blocks are operated at reduced power enough for achieving the bandwidth and signal to noise ratio (SNR) needed for the VAD or event detector to function. For example, a bandwidth of operation of approximately 8 kHz after decimation and an SNR of approximately 60 dB can be achieved.
- The VAD or event detector can be implemented using well known techniques. For example, short term energy measures vs. long term energy measures, zero crossing and so forth can be used to detect voice signals.
- It should also be noted that the interface (the connections between the host and the microphone) is not limited to the exact signals described herein. In these regards, other signals or other combinations of signals may be used. The physical implementation of the interface may also vary. For example, it may be a single physical bi-directional line, or multiple uni-directional lines.
- In other aspects, the microphone further includes a delay buffer. Audio data is sequentially written to the buffer. In other examples, upon wake up, buffered data is transmitted over a first transmission line and real-time data is transmitted simultaneously over a second and separate output line. In still other examples, buffered data is flushed or discarded upon switching modes.
- In still other aspects, the microphone is over-clocked to catch up buffered data to real-time data. The microphone can also be used for multi-microphone voice triggered applications. In one example, the microphone wakes up and enables data synchronizations of a second microphone either in a buffered or a real-time mode.
- Approaches are provided that implement a multimode microphone, where the microphone works in multiple modes and, at the same time, current consumption (and power usage) of the microphone follows the frequency of the input clock.
- In many of these embodiments, the frequency of the input clock is compared to an internally generated clock signal. The frequency of the input clock is indicative of the operational mode of an application specific integrated circuit (ASIC) or other device. The comparison allows for accurate detection of the input frequency. The current provided to different operational blocks of the ASIC can be changed based upon the frequency (which now has been measured accurately). In other words, the current (or power) consumption of the ASIC (or portions of the ASIC) follows the frequency change of the input clock. Additional, different operation modes dependent on the frequency of the input clock are followed and their specific current and power needs are addressed because of the flexibility of changing the current according to these approaches.
- In other aspects, the internal oscillator signal (from the ASIC) is temperature compensated for its frequency. In still other aspects and to reduce the design complexity, the internal oscillator signal (from the ASIC) is not process compensated for frequency, but rather the process compensation is performed during manufacturing test of the ASIC, where trim test for process compensation is done and then the trim value is stored to One Time Programmable (OTP) memory.
- The current consumption values for a given operational mode or frequency is determined by the requirements on noise and current consumption. In these regards, noise is also a parameter that is considered and controlled, as there is a well-known relation between noise and current consumption in analog mixed-mode integrated circuit (IC) design.
- In many of these embodiments, an application specific integrated circuit (ASIC) is coupled to an acoustic device. The ASIC includes at least one operational block and a frequency detection block. The frequency detection block is configured to receive an input clock signal, determine the frequency of the input clock signal, the frequency indicative of one of a plurality of operational modes of the ASIC. The frequency detection block is further configured to based upon the determined frequency, change an amount current provided to the at least one operational block.
- In other aspects, the frequency detection block compares the input clock to an internally generated clock signal that runs independently of temperature and process. In other examples, the acoustic device is a micro-electro-mechanical system (MEMS) microphone.
- In some examples, each of the plurality of modes has a different discrete current consumption. In other examples, the modes may be a stand-by mode, a low power mode, a standard performance mode, or a high performance mode. Other examples are possible.
- In others of these embodiments, an application specific integrated circuit (ASIC) is used with an acoustic device. An input clock signal is received. The frequency of the input clock signal is determined, and the frequency is indicative of one of a plurality of operational modes of the ASIC. Based upon the determined frequency, an amount of current provided to one or more operational blocks of the ASIC is changed or adjusted.
- Referring now to
FIG. 1 , asystem 100 that uses amicrophone 102 having a VAD algorithm and includes power savings features is described. Themicrophone 102 may in one example, include a MEMS chip (with MEMS die, diaphragm, and charge plate) and an application specific integrated circuit (ASIC). The system also includes ahost 104. Thehost 104 may include various processing functions and may be part of a device (e.g., a personal computer or cellular phone, mobile handset, or tablet) where themicrophone 102 resides. - A
VDD power signal 112 and aground signal 114 are coupled to themicrophone 102. An interruptsignal 108 and adata signal 110 are sent from themicrophone 102 to thehost 104. Aclock signal 106 is sent from thehost 104 to themicrophone 102. - In one example of the operation of the
system 100 ofFIG. 1 , themicrophone 102 has several modes of operation and these are controlled by theclock signal 106. Thehost 104 receives the data signal 110 from themicrophone 102 as well as an interruptsignal 108. Thehost 104 has multiple power modes controlled by the interruptsignal 108 that is generated by themicrophone 102 upon the detection of voice activity or a particular voice event (e.g., a specific spoken word). Thehost 104 generates theclock signal 106 for themicrophone 102 and thereby controls the mode of operation of themicrophone 102. - In one example, the
microphone 102 includes a VAD mode of operation. In this mode, themicrophone 102 has a very low power consumption, and it runs on a relatively low clock frequency which can be supplied either externally (from theclock signal 106 supplied by the host 104) or from an internal on-chip oscillator in themicrophone 102. Consequently, when an interrupt is made, the low power operation can be changed to a higher powered mode of operation. As will be recognized, the interrupt allows the system to be operated in both a low power mode of operation and a high power mode of operation. - In some aspects, the integrated circuit and the MEMS circuit receive a clock signal from an external host. The clock signal is effective to cause the MEMS circuit and integrated circuit to operate in full system operation mode during a first time period and in a voice activity mode of operation during a second time period. The voice activity mode has a first power consumption or level and the full system operation mode has a second power consumption or level. The first power consumption is less than the second power consumption. The integrated circuit is configured to generate an interrupt upon the detection of voice activity, and send the interrupt to the host. The absence of a clock causes the microphone to enter a voice activity detection mode. The clock circuit may be located on the same chip as the other components or located externally.
- In other aspects, the present approaches provide the ability to operate the internal clock at a third power consumption or level and thereafter generate an external data stream and clock to signal the system to operate at a fourth power consumption or level. The third power level is less than the fourth power level, and the fourth power level is less than the first power level.
- In still other aspects, the external clock may be detected and this may be applied after the detection of voice activity. Then, the internal clock is synchronized to the external clock. Furthermore, the VAD signal processing is also synchronized to the external clock after synchronization.
- In yet other aspects, the system may fall back to the internal clock for power savings at the first or second power level when the external clock is removed to reduce overall system power.
- In another example, an external signal may be generated from the internal combination of the clock and the acoustic activity detection that acts as a signal and clock combination to signal the host to interrupt/wake up and recognize the voice signal. The bandwidth of the input signal after buffering may be in one example approximately 8 kHz. Other examples are possible. Data may be provided in PCM or PDM formats. Other examples of formats are possible.
- Referring now to
FIG. 2 various operational states of a system that uses a microphone that uses a VAD algorithm is described. The approach ofFIG. 2 has three modes of operation: aVAD mode 202, a wake up host (partially)mode 204, and a fullsystem operation mode 206. - In the
VAD mode 202, no data is transmitted out of the microphone. The host is sleeping in this mode. In one aspect, when the host is sleeping only the functionality needed to react to a generated interrupt signal from the microphone is enabled. In this mode, the host is clocked at a very low clock to lower power and all unnecessary functionality is powered down. This mode has the absolute lowest power consumption possible as all unnecessary blocks are powered down and no switching of clock or data signals occur. In other words, themode 202 is a low power mode, where VAD is enabled and no external clock is being received from the host. - In the wake up host (partially)
mode 204, the external clock is received from the host. Data is transmitted out of the microphone. The host becomes partially awake due to the detection of a keyword and/ or the detection of voice activity. Subsequently, the external clock for the microphone is enabled with a clock frequency corresponding to a higher performance level enough for doing reliable keyword detection. - The full
system operation mode 206 is the high power or standard operating mode of the microphone. - In one example of the operation of the state transition diagram of
FIG. 2 , the system begins inmode 202. The VAD algorithm detects an event which will trigger the transition fromVAD mode 202 to partially wake up/ wake upmode 204. - In the
mode 204, the host detects a keyword/speech and decides that a specific key word, phrase, or sentence is recognized. This determination triggers the transition from themode 204 to the full system wake up 206. - In the
mode 206, the host keyword detect/speech recognition algorithm decides that no key word, phrase, or sentence is recognized which triggers the transition back to theVAD mode 202. In this respect, another mode or state (not shown here inFIG. 2 ) determines that the system should enter partially wake up/wake upmode 204 or go directly to theVAD mode 202. - Referring now to
FIG. 3 , amicrophone 300 that uses a VAD algorithm and includes power savings features is described. Themicrophone 300 includes a microphone chip ordevice 302. Themicrophone chip 302 includes a MEMS die, diaphragm, and charge plate. The system also includes anASIC 304. TheASIC 304 may include various processing functions. TheMEMS chip 302 receives a charge pump signal 315 from theASIC 304 to power theMEMS chip 302. - A VDD power signal 312 and a
ground signal 314 are coupled to theASIC 304. An interrupt signal 308 and adata signal 310 are sent by theASIC 304 to a host (e.g., thehost 104 ofFIG. 1 ). Aclock signal 306 sent from the host is received by theASIC 304. - In one example of the operation of the
microphone 300 ofFIG. 3 , themicrophone 300 has several modes of operation and these are controlled by theclock signal 306. A voice signal is received by theMEMS chip 302 and this sound is converted into an electrical signal and sent over data lead 311 to theASIC 304. TheASIC 304 processes the signal into a data signal and then transmits the data signal 310 from theASIC 304 as well as creating an interrupt signal 308. The host (e.g., thehost 104 ofFIG. 1 ) generates theclock signal 306 and this controls the mode of operation of themicrophone 300. - In one example, the
microphone 300 includes a VAD mode of operation. In this mode, themicrophone 300 has a very low power consumption, and it runs on a relatively low clock frequency which can be supplied either externally (from theclock signal 306 supplied by the host) or from an internal on-chip oscillator in themicrophone 300. Consequently, when an interrupt is made, the low power operation can be changed to a higher powered operation. The interrupt allows the system to be operated in both a low power mode of operation and a high power mode of operation. - Referring now
FIG. 4 , a block diagram of an application specific integrated circuit (ASIC) 400 is described. TheASIC 400 includes a charge pump (CHP) 402, anamplifier 404, an analog-to-digital converter 406, a voice activity detector (VAD) 408, a control block 410 (with oscillator 412), and aswitch 414. - The
charge pump CHP 402 charges the MEMS element (e.g., theMEMS chip 302 ofFIG. 3 ) to convert changes in capacitance to voltage. Theamplifier 404 buffers the electrical signal of the MEMS element (e.g., theMEMS chip 302 ofFIG. 3 ) and subsequently amplifies the signal with a gain of A. - The A/
D converter 406 converts the analog signal from theamplifier 404 to a digital signal. TheVAD 408 processes the digital signal from the A/D converter 406 and generates an interruptsignal 411 if voice is detected. Thecontrol block 410 controls the internal states of theASIC 400 in response to an external clock signal 413 (received from a host) and the interruptsignal 411 from theVAD 408. Theswitch 414 is controlled by thecontrol block 410 to allowdata 415 to be sent to an external host. - A data buffer may be included at the output of the A/
D converter 406. The buffer may buffer data representing the audio signal and correspond to or approximate the delay of the VAD 408 (e.g., 10 ms-360 ms to mention one example range with other ranges being possible). A decimation filter stage could be included at the output of the A/D converter in order to reduce buffer size (sampler RAM) and power, this will limit the bandwidth. In this case an interpolation stage at the buffer output must be added as well. In this case, the delay may be around 200 msec. In another example, the delay may be around 360 msec. Other examples of delay values are possible. The buffer is provided to allow any recognition algorithm the latency required to wake up the host, collect sufficient background noise statistics, and recognize the key phrase within the ambient noise. - The buffered data may be sent to the host via some connection such as the interrupt
line 411 or thedata line 415. If sending data via thedata line 415, it may be sent at an increased clock rate compared to the sampling clock. - Additionally, the parameters or settings of the
VAD 408 may be changed or controlled. For example, the reading or writing settings of registers and memory (both erasable and non-erasable) of theVAD 408 may be changed or controlled to, for example, account for various levels of background noise. - The functionality of the
VAD 408 may be enhanced or changed. For example, voice or phrase detection may be used. Other functions may also be included. - Referring now
FIG. 5 , a block diagram ofhost 500 is described. Thehost 500 includes aninterface block 502, a digital signal processing (DSP) block 504 (including akeyword detection block 506 and word/voice recognition block 508), a control block 510 (clocked by an on-chip oscillator 511), and amemory 512. - The
interface block 502 provides interfacing functionality with respect to a microphone (e.g., themicrophone 102 inFIG. 1 ). The interface block transmits theclock signal 520 to the microphone and receives from the microphone an interruptsignal 522 and adata signal 524. The DSP block processes the data signal in two steps using the keyword detection block 506 (detecting a keyword) and the word/voice recognition block 508 (detecting a word or voice). - The
control block 510 controls the power states of the microphone (e.g., themicrophone 102 ofFIG. 1 ), the blocks of thehost 500, and the entire system including other blocks and functions outside the host and microphone (not shown here inFIG. 5 ). - The
memory 512 stores the states of the system, data, and other information. The onchip oscillator 511 is controllable from thecontrol block 510 and enables at least two clock modes corresponding to at least two power modes. - Referring now
FIG. 6 , a timing diagram showing the operation of a microphone that uses a VAD algorithm and includes power savings features is described. The signals ofFIG. 6 show how the system and in particular how the microphone reacts to a voice/event signal and generates an interrupt signal. Subsequent to the interrupt signal, the diagrams show how the host reacts to the interrupt signal by changing its mode and afterwards changing the frequency of the clock signal to change the mode of the microphone. -
Signal 602 shows an audio signal. Upon detection of an audio signal, the microphone generates an interrupt as shown bysignal 604. Data is also generated by the microphone as shown bysignal 606. As can be seen bysignal 608, the host in response to the interrupt changes the clock signal (sent to the microphone) from a low frequency signal to a high frequency signal. Alternatively (as shown by signal 610), in low power mode (before the event), the host may not send a clock signal and may only start the high frequency clock signal upon detection of the event. - Referring now to
FIG. 7 , one example of amicrophone assembly 700 is described. The microphone assembly includes aMEMS device 702, and an application specific integrated circuit (ASIC) 704. The assembly couples toexternal circuitry 706 that is part of ahost device 709. The host device may be a cellular phone, personal computer, or any other device that uses microphones. The circuitry of the host device is any type of electronic circuitry that performs any type of processing function. The circuitry may be divided into functional modules as appropriate and may be any combination of hardware and software elements (e.g., it may include microprocessors that execute programmed instructions). Thehost device circuitry 706 includes aclock 708 that is coupled to theASIC 704 of themicrophone assembly 700. - The
MEMS device 702 is any type of MEMS microphone device (i.e., a transducer) that convertssound energy 701 into an analog electrical signal that is transmitted to the ASIC. The ASIC may be any type of integrated circuit that performs various types of functions such as buffering or amplification, among other functions described herein. The ASIC operates in various modes and each of these modes of operation utilizes or requires different power levels. If the power level is incorrect, the ASIC will either not operate or not operate properly. The ASIC processes the signal received from the MEMS device for use by the host device. - In
FIG. 7 , in order that the ASIC operate properly for a certain mode of operation, afrequency detection block 714 is configured to provide current adjustment based upon the received input frequency from theexternal clock 708 of the host device. In these regards, the frequency of the external clock represents the mode of operation of the ASIC and more generally the microphone assembly. The frequency of the external clock is compared byblock 714 to an internally generated clock signal from aninternal oscillator 710 on the ASIC. The frequency of the external clock is indicative of the operational mode of the ASIC. The comparison byblock 714 allows for accurate detection of the frequency of theexternal clock 108. The current provided to differentoperational blocks 712 of the ASIC can be changed byblock 714 based upon this detected frequency (which now has been measured accurately). In other words, the current consumption of the ASIC or portions thereof follows the frequency change of the external clock. Additional and/or different operation modes dependent on the frequency of the external clock are followed and their specific current and power needs are addressed because of the flexibility of changing the current. - The frequency detection aspects of the ASIC and particularly the operation of
block 114 are described in further detail below with respect toFIG. 8 andFIG. 9 . - In
FIG. 8 , the operation of the microphone is divided into fourmodes - The
standby mode 802 is where the current consumption is at a minimum, but the microphone is not functional. Thelow power mode 804 is where the current consumption is kept at a minimum but the microphone is functional with reduced performance. Thestandard performance mode 806 is where the current consumption is higher compared to thelow power mode 804 and at the same time performance of the microphone is increased. Thehigh performance mode 808 is where both the current consumption and the performance are at maximum. - In each mode, the current consumption is further increased (or decreased) and follows the detected frequency of the external clock. For instance, several clock driven circuits by nature require higher current consumption for higher clock frequency for a given performance or require higher current consumption for better noise performance. Examples of circuits needing varying power levels include analog-to-digital (A-to-D) converters and switch-capacitor filters, both of which are commonly used in digital microphones. Other examples are possible.
- In
FIG. 9 , one example of a frequency detect and current adjustment block 900 (e.g., block 714 ofFIG. 7 ) are described. In these regards,FIG. 9 illustrates one possible implementation about how to make bias current following the frequency of input clock independent of process, and temperature variations. Other examples are possible. Theblock 900 includes aninternal oscillator 902, aclock divider 904, afrequency detection device 906, a biascurrent generator 908, one-time programmable (OTP)memory bits clock input pad 912 that couples to thefrequency detection device 906. Theblock 900 may be disposed on anASIC 916. The ASIC may be disposed in adevice 918 that includes aclock 920, which is coupled to theclock input pad 912. Thedevice 918 may be a cellular phone or personal computer to mention two examples. - In operation, the
internal oscillator 902 outputs a signal received by theclock divider 904. TheOTP bits 910 may be used to compensate for process variations during the manufacturing process. For example, the oscillator frequency may be measured, compared to what is desired, and the bits applied to make the oscillator operate at the desired frequency. The output of theoscillator 902 is a temperature compensated clock signal.OTP bits 911 are applied to theclock divider 904 in the form of adivision ratio 913 to compensate for various tolerances amongst oscillators/ASICs. This may occur during manufacturing where the division ratio is changed based upon the particular oscillators/ASIC. The output of thedivider 904 is a temperature and process compensated clock signal. In other words, the output of thedivider 904 can be considered an accurate clock since both temperature and process have been considered and compensation was made to the clock signal based upon these factors. - The
frequency detection device 906 compares the input clock (from the device 918) to the accurate clock to find out the frequency of the input clock. It sends an n-bit control signal to the biascurrent generator 908. The biascurrent generator 908 may also be adjusted by the OTP bits during manufacturing to compensate for process variations. The n-bits are a digital bit representation of the input clock frequency. For example, if the digital representation is 1, frequency may be 100 Khz, if it is 2, frequency may be between 100 kHz and 200 kHz, and so forth. This n-bit signal activates various ones of theswitches 921 within thegenerator 908. The more switches 912 that are closed, the more current that is supplied. In this way, the current is adjusted based upon the frequency (which represents mode) of theclock 920. The current from 908 may flow todifferent blocks 922 of the ASIC, thereby operating the ASIC as needed. As can be seen inFIG. 8 , the approaches utilized inFIG. 9 result in a stepped current response, rather than a linear progression. - Accordingly, the present approaches provide digital microphone that operate in multiple modes with different performance aspects including current consumption and noise. Changes in performance aspects are controlled through the change in the clock input frequency. Detection of change in the clock input frequency is done by comparing the clock input to an internally generated accurate clock source from an oscillator on the ASIC. The internally generated clock signals (on the ASIC) run independently of both temperature and process. Temperature independency can be achieved by using process independent current source in the oscillator. Process independency can be achieved by using OTP registration of process variation compensation during ASIC production tests.
- In some embodiments, a microphone apparatus includes an acoustic sensor configured to produce an electrical signal at an output of the acoustic sensor in response to sensing an acoustic signal; an electrical circuit including an acoustic activity detector, a frequency detection circuit and a control block, the electrical circuit having an input coupled to the output of the acoustic sensor, the electrical circuit configured to process the electrical signal; an internal clock signal generator coupled to the electrical circuit; and a host interface with external connections coupled to the electrical circuit, the external connections including a connection for an external clock signal and data, the external clock signal connection coupled to the frequency detection circuit. The microphone assembly has an acoustic activity detection mode of operation when the electrical circuit is clocked using the internal clock signal generator in the absence of an external clock signal at the host interface, and the electrical circuit is configured to provide an interrupt signal to the host interface upon detection of acoustic activity by the electrical circuit. The electrical circuit is configured to control the operating mode of the microphone assembly based on a frequency of an external clock signal received at the host interface in response to providing the interrupt signal. The electrical circuit is configured to provide data representing the electrical signal to the host interface using the external clock signal received at the host interface.
- In some embodiments, a microphone apparatus includes an acoustic sensor; an electrical circuit having an input coupled to an output of the acoustic sensor, the electrical circuit including an acoustic activity detector and a frequency determination circuit; an internal clock signal generator coupled to the electrical circuit; and a host interface with external connections coupled to the electrical circuit, the host interface including a connection for an external clock signal and data. The acoustic activity detector is configured to process, in an acoustic activity detection mode, data representing an electrical signal output by the acoustic sensor for acoustic activity when the electrical circuit is clocked by a clock signal of the internal clock signal generator in the absence of an external clock signal on the host interface. The electrical circuit is configured to provide an interrupt signal to the host interface after detection of acoustic activity, and the electrical circuit is configured to control an operating mode of the microphone assembly based on a frequency of an external clock signal received at the host interface in response to the interrupt signal. The electrical circuit is configured to provide data representing the electrical signal to the host interface using the external clock signal received at the host interface.
- Preferred embodiments of this disclosure are described herein, including the best mode known to the inventors. It should be understood that the illustrated embodiments are exemplary only, and should not be taken as limiting the scope of the appended claims.
Claims (20)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/020,932 US20180317019A1 (en) | 2013-05-23 | 2018-06-27 | Acoustic activity detecting microphone |
US16/752,673 US11172312B2 (en) | 2013-05-23 | 2020-01-26 | Acoustic activity detecting microphone |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361826587P | 2013-05-23 | 2013-05-23 | |
US201361893453P | 2013-10-21 | 2013-10-21 | |
US14/282,101 US9712923B2 (en) | 2013-05-23 | 2014-05-20 | VAD detection microphone and method of operating the same |
US14/512,846 US10028054B2 (en) | 2013-10-21 | 2014-10-13 | Apparatus and method for frequency detection |
US14/522,158 US9113263B2 (en) | 2013-05-23 | 2014-10-23 | VAD detection microphone and method of operating the same |
US14/824,736 US10313796B2 (en) | 2013-05-23 | 2015-08-12 | VAD detection microphone and method of operating the same |
US16/020,932 US20180317019A1 (en) | 2013-05-23 | 2018-06-27 | Acoustic activity detecting microphone |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/512,846 Continuation-In-Part US10028054B2 (en) | 2013-05-23 | 2014-10-13 | Apparatus and method for frequency detection |
US14/824,736 Continuation-In-Part US10313796B2 (en) | 2013-05-23 | 2015-08-12 | VAD detection microphone and method of operating the same |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/752,673 Continuation US11172312B2 (en) | 2013-05-23 | 2020-01-26 | Acoustic activity detecting microphone |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180317019A1 true US20180317019A1 (en) | 2018-11-01 |
Family
ID=63917632
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/020,932 Abandoned US20180317019A1 (en) | 2013-05-23 | 2018-06-27 | Acoustic activity detecting microphone |
US16/752,673 Active US11172312B2 (en) | 2013-05-23 | 2020-01-26 | Acoustic activity detecting microphone |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/752,673 Active US11172312B2 (en) | 2013-05-23 | 2020-01-26 | Acoustic activity detecting microphone |
Country Status (1)
Country | Link |
---|---|
US (2) | US20180317019A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10360926B2 (en) | 2014-07-10 | 2019-07-23 | Analog Devices Global Unlimited Company | Low-complexity voice activity detection |
US20210201894A1 (en) * | 2020-03-12 | 2021-07-01 | Beijing Baidu Netcom Science And Technology Co., Ltd. | N/a |
US11373637B2 (en) * | 2019-01-03 | 2022-06-28 | Realtek Semiconductor Corporation | Processing system and voice detection method |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ITTO20130910A1 (en) * | 2013-11-08 | 2015-05-09 | St Microelectronics Srl | MICRO-ELECTROMECHANICAL ACOUSTIC TRANSDUCER DEVICE WITH IMPROVED DETECTION FUNCTIONALITY AND ITS ELECTRONIC DEVICE |
US11758334B2 (en) | 2021-08-06 | 2023-09-12 | Invensense, Inc. | Acoustic activity detection |
US20240073598A1 (en) * | 2022-08-23 | 2024-02-29 | Invensense, Inc. | Event activity detection signaling |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060164151A1 (en) * | 2004-11-25 | 2006-07-27 | Stmicroelectronics Pvt. Ltd. | Temperature compensated reference current generator |
US7546498B1 (en) * | 2006-06-02 | 2009-06-09 | Lattice Semiconductor Corporation | Programmable logic devices with custom identification systems and methods |
US20090257289A1 (en) * | 2008-04-14 | 2009-10-15 | Sang-Jin Byeon | Internal voltage generator and semiconductor memory device including the same |
US20110107010A1 (en) * | 2009-10-29 | 2011-05-05 | Freescale Semiconductor, Inc. | One-time programmable memory device and methods thereof |
US20110170714A1 (en) * | 2008-05-05 | 2011-07-14 | Epcos Pte Ltd | Fast precision charge pump |
US20110293115A1 (en) * | 2008-11-25 | 2011-12-01 | Audioasics A/S | Dynamically biased amplifier |
US20120177227A1 (en) * | 2011-01-12 | 2012-07-12 | Ricoh Company, Ltd. | Sound volume control circuit |
US20120250910A1 (en) * | 2005-07-19 | 2012-10-04 | Audioasics A/S | Programmable microphone |
Family Cites Families (174)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3989897A (en) | 1974-10-25 | 1976-11-02 | Carver R W | Method and apparatus for reducing noise content in audio signals |
US4831558A (en) | 1986-08-26 | 1989-05-16 | The Slope Indicator Company | Digitally based system for monitoring physical phenomena |
US4812996A (en) | 1986-11-26 | 1989-03-14 | Tektronix, Inc. | Signal viewing instrumentation control system |
US4811404A (en) | 1987-10-01 | 1989-03-07 | Motorola, Inc. | Noise suppression system |
IL84948A0 (en) | 1987-12-25 | 1988-06-30 | D S P Group Israel Ltd | Noise reduction system |
GB8910981D0 (en) | 1989-05-12 | 1989-06-28 | Hi Med Instr Limited | Digital waveform encoder and generator |
JPH0566795A (en) | 1991-09-06 | 1993-03-19 | Gijutsu Kenkyu Kumiai Iryo Fukushi Kiki Kenkyusho | Noise suppressing device and its adjustment device |
JP3176474B2 (en) | 1992-06-03 | 2001-06-18 | 沖電気工業株式会社 | Adaptive noise canceller device |
US5555287A (en) | 1992-07-21 | 1996-09-10 | Advanced Micro Devices, Inc. | Integrated circuit and cordless telephone using the integrated circuit |
US5340316A (en) | 1993-05-28 | 1994-08-23 | Panasonic Technologies, Inc. | Synthesis-based speech training system |
US5675808A (en) | 1994-11-02 | 1997-10-07 | Advanced Micro Devices, Inc. | Power control of circuit modules within an integrated circuit |
US6070140A (en) | 1995-06-05 | 2000-05-30 | Tran; Bao Q. | Speech recognizer |
US5828997A (en) | 1995-06-07 | 1998-10-27 | Sensimetrics Corporation | Content analyzer mixing inverse-direction-probability-weighted noise to input signal |
EP0766494B1 (en) | 1995-09-29 | 2002-08-14 | STMicroelectronics S.r.l. | Digital microphonic device |
DE19546168C1 (en) | 1995-12-11 | 1997-02-20 | Siemens Ag | Digital signal processor for speech processing or pattern recognition |
US5825898A (en) | 1996-06-27 | 1998-10-20 | Lamar Signal Processing Ltd. | System and method for adaptive interference cancelling |
US5822598A (en) | 1996-07-12 | 1998-10-13 | Ast Research, Inc. | Audio activity detection circuit to increase battery life in portable computers |
JP3328532B2 (en) | 1997-01-22 | 2002-09-24 | シャープ株式会社 | Digital data encoding method |
EP0867856B1 (en) | 1997-03-25 | 2005-10-26 | Koninklijke Philips Electronics N.V. | Method and apparatus for vocal activity detection |
JP3541339B2 (en) | 1997-06-26 | 2004-07-07 | 富士通株式会社 | Microphone array device |
JP3216704B2 (en) | 1997-08-01 | 2001-10-09 | 日本電気株式会社 | Adaptive array device |
US6081143A (en) * | 1997-09-26 | 2000-06-27 | Sun Microsystems, Inc. | Frequency comparison and generation in an integrated processor |
US6057791A (en) | 1998-02-18 | 2000-05-02 | Oasis Design, Inc. | Apparatus and method for clocking digital and analog circuits on a common substrate to enhance digital operation and reduce analog sampling error |
SE512228C2 (en) | 1998-06-24 | 2000-02-14 | Bjoern Svedberg | Method and apparatus for magnetic orientation of fibers |
JP2000174615A (en) | 1998-11-27 | 2000-06-23 | Renyo Handotai Kofun Yugenkoshi | Method and device for automatically correcting internal clock frequency of integrated circuit |
US6381570B2 (en) | 1999-02-12 | 2002-04-30 | Telogy Networks, Inc. | Adaptive two-threshold method for discriminating noise from speech in a communication signal |
US6249757B1 (en) | 1999-02-16 | 2001-06-19 | 3Com Corporation | System for detecting voice activity |
US6549587B1 (en) | 1999-09-20 | 2003-04-15 | Broadcom Corporation | Voice and data exchange over a packet based network with timing recovery |
US6594367B1 (en) | 1999-10-25 | 2003-07-15 | Andrea Electronics Corporation | Super directional beamforming design and implementation |
US6397186B1 (en) | 1999-12-22 | 2002-05-28 | Ambush Interactive, Inc. | Hands-free, voice-operated remote control transmitter |
US6912498B2 (en) | 2000-05-02 | 2005-06-28 | Scansoft, Inc. | Error correction in speech recognition by correcting text around selected area |
US7346176B1 (en) | 2000-05-11 | 2008-03-18 | Plantronics, Inc. | Auto-adjust noise canceling microphone with position sensor |
JP4880176B2 (en) | 2000-07-05 | 2012-02-22 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | A / D converter for microphone with integrated bias |
US6829244B1 (en) | 2000-12-11 | 2004-12-07 | Cisco Technology, Inc. | Mechanism for modem pass-through with non-synchronized gateway clocks |
US20030004720A1 (en) | 2001-01-30 | 2003-01-02 | Harinath Garudadri | System and method for computing and transmitting parameters in a distributed voice recognition system |
AU2002248510A1 (en) | 2001-03-02 | 2002-09-19 | Regeneron Pharmaceuticals, Inc. | Methods of identifying agents affecting atrophy and hypertrophy |
US6876859B2 (en) | 2001-07-18 | 2005-04-05 | Trueposition, Inc. | Method for estimating TDOA and FDOA in a wireless location system |
US6792118B2 (en) | 2001-11-14 | 2004-09-14 | Applied Neurosystems Corporation | Computation of multi-sensor time delays |
DE10160830A1 (en) | 2001-12-11 | 2003-06-26 | Infineon Technologies Ag | Micromechanical sensor comprises a counter element lying opposite a moving membrane over a hollow chamber and containing openings which are formed by slits |
US8098844B2 (en) | 2002-02-05 | 2012-01-17 | Mh Acoustics, Llc | Dual-microphone spatial noise suppression |
WO2007106399A2 (en) | 2006-03-10 | 2007-09-20 | Mh Acoustics, Llc | Noise-reducing directional microphone array |
US20030171907A1 (en) | 2002-03-06 | 2003-09-11 | Shay Gal-On | Methods and Apparatus for Optimizing Applications on Configurable Processors |
US6756700B2 (en) | 2002-03-13 | 2004-06-29 | Kye Systems Corp. | Sound-activated wake-up device for electronic input devices having a sleep-mode |
US7319959B1 (en) | 2002-05-14 | 2008-01-15 | Audience, Inc. | Multi-source phoneme classification for noise-robust automatic speech recognition |
AU2003252143A1 (en) | 2002-08-29 | 2004-03-19 | Bae Systems Information And Electronic Systems Integration, Inc. | Method for separating interferering signals and computing arrival angles |
KR100477699B1 (en) | 2003-01-15 | 2005-03-18 | 삼성전자주식회사 | Quantization noise shaping method and apparatus |
US6853733B1 (en) * | 2003-06-18 | 2005-02-08 | National Semiconductor Corporation | Two-wire interface for digital microphones |
JP4212591B2 (en) | 2003-06-30 | 2009-01-21 | 富士通株式会社 | Audio encoding device |
US7386451B2 (en) | 2003-09-11 | 2008-06-10 | Microsoft Corporation | Optimization of an objective measure for estimating mean opinion score of synthesized speech |
GB2405949A (en) | 2003-09-12 | 2005-03-16 | Canon Kk | Voice activated device with periodicity determination |
US7418392B1 (en) | 2003-09-25 | 2008-08-26 | Sensory, Inc. | System and method for controlling the operation of a device by voice commands |
US20050078841A1 (en) | 2003-10-14 | 2005-04-14 | Boor Steven E. | Method and apparatus for resetting a buffer amplifier |
DE602004031044D1 (en) | 2003-11-24 | 2011-02-24 | Epcos Pte Ltd | MICROPHONE WITH AN INTEGRAL MULTIPLE LEVEL QUANTIZER AND BIT IMPROVERS |
US7636855B2 (en) | 2004-01-30 | 2009-12-22 | Panasonic Corporation | Multiple choice challenge-response user authorization system and method |
WO2005076466A1 (en) | 2004-02-09 | 2005-08-18 | Audioasics A/S | Digital microphone |
DE102004011149B3 (en) | 2004-03-08 | 2005-11-10 | Infineon Technologies Ag | Microphone and method of making a microphone |
CN1947171B (en) | 2004-04-28 | 2011-05-04 | 皇家飞利浦电子股份有限公司 | Adaptive beamformer, sidelobe canceller, automatic speech communication device |
CA2573002A1 (en) | 2004-06-04 | 2005-12-22 | Benjamin Firooz Ghassabian | Systems to enhance data entry in mobile and fixed environment |
US20060013415A1 (en) | 2004-07-15 | 2006-01-19 | Winchester Charles E | Voice activation and transmission system |
US20060074658A1 (en) | 2004-10-01 | 2006-04-06 | Siemens Information And Communication Mobile, Llc | Systems and methods for hands-free voice-activated devices |
US7268006B2 (en) | 2004-12-30 | 2007-09-11 | E.I. Du Pont De Nemours And Company | Electronic device including a guest material within a layer and a process for forming the same |
US7102452B1 (en) | 2004-12-31 | 2006-09-05 | Zilog, Inc. | Temperature-compensated RC oscillator |
US7795695B2 (en) | 2005-01-27 | 2010-09-14 | Analog Devices, Inc. | Integrated microphone |
DE102005008511B4 (en) | 2005-02-24 | 2019-09-12 | Tdk Corporation | MEMS microphone |
US7825484B2 (en) | 2005-04-25 | 2010-11-02 | Analog Devices, Inc. | Micromachined microphone and multisensor and method for producing same |
WO2007018293A1 (en) | 2005-08-11 | 2007-02-15 | Asahi Kasei Kabushiki Kaisha | Sound source separating device, speech recognizing device, portable telephone, and sound source separating method, and program |
SG130158A1 (en) | 2005-08-20 | 2007-03-20 | Bse Co Ltd | Silicon based condenser microphone and packaging method for the same |
US20070053522A1 (en) | 2005-09-08 | 2007-03-08 | Murray Daniel J | Method and apparatus for directional enhancement of speech elements in noisy environments |
CA2621940C (en) | 2005-09-09 | 2014-07-29 | Mcmaster University | Method and device for binaural signal enhancement |
JP4742226B2 (en) | 2005-09-28 | 2011-08-10 | 国立大学法人九州大学 | Active silencing control apparatus and method |
US7813923B2 (en) | 2005-10-14 | 2010-10-12 | Microsoft Corporation | Calibration based beamforming, non-linear adaptive filtering, and multi-sensor headset |
DE102005053765B4 (en) | 2005-11-10 | 2016-04-14 | Epcos Ag | MEMS package and method of manufacture |
DE102005053767B4 (en) | 2005-11-10 | 2014-10-30 | Epcos Ag | MEMS microphone, method of manufacture and method of installation |
US7856283B2 (en) | 2005-12-13 | 2010-12-21 | Sigmatel, Inc. | Digital microphone interface, audio codec and methods for use therewith |
US8345890B2 (en) | 2006-01-05 | 2013-01-01 | Audience, Inc. | System and method for utilizing inter-microphone level differences for speech enhancement |
US9185487B2 (en) | 2006-01-30 | 2015-11-10 | Audience, Inc. | System and method for providing noise suppression utilizing null processing noise subtraction |
US8744844B2 (en) | 2007-07-06 | 2014-06-03 | Audience, Inc. | System and method for adaptive intelligent noise suppression |
US8194880B2 (en) | 2006-01-30 | 2012-06-05 | Audience, Inc. | System and method for utilizing omni-directional microphones for speech enhancement |
WO2007097176A1 (en) | 2006-02-23 | 2007-08-30 | Nec Corporation | Speech recognition dictionary making supporting system, speech recognition dictionary making supporting method, and speech recognition dictionary making supporting program |
GB0605576D0 (en) | 2006-03-20 | 2006-04-26 | Oligon Ltd | MEMS device |
US8180067B2 (en) | 2006-04-28 | 2012-05-15 | Harman International Industries, Incorporated | System for selectively extracting components of an audio input signal |
KR100722686B1 (en) | 2006-05-09 | 2007-05-30 | 주식회사 비에스이 | Silicon condenser microphone having additional back chamber and sound hole in pcb |
US20070274297A1 (en) | 2006-05-10 | 2007-11-29 | Cross Charles W Jr | Streaming audio from a full-duplex network through a half-duplex device |
US8204253B1 (en) | 2008-06-30 | 2012-06-19 | Audience, Inc. | Self calibration of audio device |
DE602007003605D1 (en) | 2006-06-23 | 2010-01-14 | Gn Resound As | AUDIO INSTRUMENT WITH ADAPTIVE SIGNAL SIGNAL PROCESSING |
US7957972B2 (en) | 2006-09-05 | 2011-06-07 | Fortemedia, Inc. | Voice recognition system and method thereof |
EP2062255B1 (en) | 2006-09-13 | 2010-03-31 | Telefonaktiebolaget LM Ericsson (PUBL) | Methods and arrangements for a speech/audio sender and receiver |
WO2008066836A1 (en) | 2006-11-28 | 2008-06-05 | Treyex Llc | Method and apparatus for translating speech during a call |
WO2008067431A2 (en) | 2006-11-30 | 2008-06-05 | Analog Devices, Inc. | Microphone system with silicon microphone secured to package lid |
EP1933303B1 (en) | 2006-12-14 | 2008-08-06 | Harman/Becker Automotive Systems GmbH | Speech dialog control based on signal pre-processing |
TWI327357B (en) | 2007-01-10 | 2010-07-11 | Advanced Semiconductor Eng | Mems microphone package and method thereof |
US7986794B2 (en) | 2007-01-11 | 2011-07-26 | Fortemedia, Inc. | Small array microphone apparatus and beam forming method thereof |
JP5401760B2 (en) | 2007-02-05 | 2014-01-29 | ソニー株式会社 | Headphone device, audio reproduction system, and audio reproduction method |
US8099288B2 (en) | 2007-02-12 | 2012-01-17 | Microsoft Corp. | Text-dependent speaker verification |
US8005238B2 (en) | 2007-03-22 | 2011-08-23 | Microsoft Corporation | Robust adaptive beamforming with enhanced noise suppression |
US7873114B2 (en) | 2007-03-29 | 2011-01-18 | Motorola Mobility, Inc. | Method and apparatus for quickly detecting a presence of abrupt noise and updating a noise estimate |
TWI323242B (en) | 2007-05-15 | 2010-04-11 | Ind Tech Res Inst | Package and packageing assembly of microelectromechanical system microphone |
US20090012786A1 (en) | 2007-07-06 | 2009-01-08 | Texas Instruments Incorporated | Adaptive Noise Cancellation |
US7817808B2 (en) | 2007-07-19 | 2010-10-19 | Alon Konchitsky | Dual adaptive structure for speech enhancement |
DE602007003220D1 (en) | 2007-08-13 | 2009-12-24 | Harman Becker Automotive Sys | Noise reduction by combining beamforming and postfiltering |
EP2202531A4 (en) | 2007-10-01 | 2012-12-26 | Panasonic Corp | Sound source direction detector |
US8175291B2 (en) | 2007-12-19 | 2012-05-08 | Qualcomm Incorporated | Systems, methods, and apparatus for multi-microphone based speech enhancement |
TWM341025U (en) | 2008-01-10 | 2008-09-21 | Lingsen Precision Ind Ltd | Micro electro-mechanical microphone package structure |
US8244528B2 (en) | 2008-04-25 | 2012-08-14 | Nokia Corporation | Method and apparatus for voice activity determination |
WO2010002676A2 (en) | 2008-06-30 | 2010-01-07 | Dolby Laboratories Licensing Corporation | Multi-microphone voice activity detector |
US7619551B1 (en) | 2008-07-29 | 2009-11-17 | Fortemedia, Inc. | Audio codec, digital device and voice processing method |
US8923529B2 (en) | 2008-08-29 | 2014-12-30 | Biamp Systems Corporation | Microphone array system and method for sound acquisition |
US8193596B2 (en) | 2008-09-03 | 2012-06-05 | Solid State System Co., Ltd. | Micro-electro-mechanical systems (MEMS) package |
US8352272B2 (en) | 2008-09-29 | 2013-01-08 | Apple Inc. | Systems and methods for text to speech synthesis |
US8712776B2 (en) | 2008-09-29 | 2014-04-29 | Apple Inc. | Systems and methods for selective text to speech synthesis |
US8724829B2 (en) | 2008-10-24 | 2014-05-13 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for coherence detection |
CN102272826B (en) | 2008-10-30 | 2015-10-07 | 爱立信电话股份有限公司 | Telephony content signal is differentiated |
US8111843B2 (en) | 2008-11-11 | 2012-02-07 | Motorola Solutions, Inc. | Compensation for nonuniform delayed group communications |
US8351634B2 (en) | 2008-11-26 | 2013-01-08 | Analog Devices, Inc. | Side-ported MEMS microphone assembly |
US8170238B2 (en) | 2008-12-02 | 2012-05-01 | Fortemedia, Inc. | Integrated circuit attached to microphone |
US8325951B2 (en) | 2009-01-20 | 2012-12-04 | General Mems Corporation | Miniature MEMS condenser microphone packages and fabrication method thereof |
US8472648B2 (en) | 2009-01-20 | 2013-06-25 | General Mems Corporation | Miniature MEMS condenser microphone package and fabrication method thereof |
US8184822B2 (en) | 2009-04-28 | 2012-05-22 | Bose Corporation | ANR signal processing topology |
CN201438743U (en) | 2009-05-15 | 2010-04-14 | 瑞声声学科技(常州)有限公司 | microphone |
WO2010132929A1 (en) | 2009-05-19 | 2010-11-25 | Moip Pty Ltd | Communications apparatus, system and method |
US9083288B2 (en) | 2009-06-11 | 2015-07-14 | Invensense, Inc. | High level capable audio amplification circuit |
US9547642B2 (en) | 2009-06-17 | 2017-01-17 | Empire Technology Development Llc | Voice to text to voice processing |
CN101651913A (en) | 2009-06-19 | 2010-02-17 | 瑞声声学科技(深圳)有限公司 | Microphone |
CN101651917A (en) | 2009-06-19 | 2010-02-17 | 瑞声声学科技(深圳)有限公司 | Capacitance microphone |
CN101959106A (en) | 2009-07-16 | 2011-01-26 | 鸿富锦精密工业(深圳)有限公司 | Packaging structure of microphone of micro electromechanical system and packaging method thereof |
US8275148B2 (en) | 2009-07-28 | 2012-09-25 | Fortemedia, Inc. | Audio processing apparatus and method |
GB2473267A (en) | 2009-09-07 | 2011-03-09 | Nokia Corp | Processing audio signals to reduce noise |
US8787591B2 (en) | 2009-09-11 | 2014-07-22 | Texas Instruments Incorporated | Method and system for interference suppression using blind source separation |
CN101765047A (en) | 2009-09-28 | 2010-06-30 | 瑞声声学科技(深圳)有限公司 | Capacitance microphone and manufacturing method thereof |
US20110099010A1 (en) | 2009-10-22 | 2011-04-28 | Broadcom Corporation | Multi-channel noise suppression system |
US8626498B2 (en) | 2010-02-24 | 2014-01-07 | Qualcomm Incorporated | Voice activity detection based on plural voice activity detectors |
JP5533042B2 (en) | 2010-03-04 | 2014-06-25 | 富士通株式会社 | Voice search device, voice search method, program, and recording medium |
US8538035B2 (en) | 2010-04-29 | 2013-09-17 | Audience, Inc. | Multi-microphone robust noise suppression |
US8606571B1 (en) | 2010-04-19 | 2013-12-10 | Audience, Inc. | Spatial selectivity noise reduction tradeoff for multi-microphone systems |
US8958572B1 (en) | 2010-04-19 | 2015-02-17 | Audience, Inc. | Adaptive noise cancellation for multi-microphone systems |
US8515089B2 (en) | 2010-06-04 | 2013-08-20 | Apple Inc. | Active noise cancellation decisions in a portable audio device |
US8447045B1 (en) | 2010-09-07 | 2013-05-21 | Audience, Inc. | Multi-microphone active noise cancellation system |
TWI446141B (en) | 2010-11-09 | 2014-07-21 | Nuvoton Technology Corp | A calibration method and apparatus for clock signal and an electronic device |
EP2494545A4 (en) | 2010-12-24 | 2012-11-21 | Huawei Tech Co Ltd | Method and apparatus for voice activity detection |
CN102568480A (en) | 2010-12-27 | 2012-07-11 | 深圳富泰宏精密工业有限公司 | Dual-mode mobile telephone voice transmission system |
JP5289517B2 (en) | 2011-07-28 | 2013-09-11 | 株式会社半導体理工学研究センター | Sensor network system and communication method thereof |
CN102340722B (en) | 2011-07-28 | 2013-11-20 | 杭州硅星科技有限公司 | Digital-analog hybrid microphone |
US20130058495A1 (en) | 2011-09-01 | 2013-03-07 | Claus Erdmann Furst | System and A Method For Streaming PDM Data From Or To At Least One Audio Component |
US8996381B2 (en) | 2011-09-27 | 2015-03-31 | Sensory, Incorporated | Background speech recognition assistant |
DE112011105791B4 (en) | 2011-11-02 | 2019-12-12 | Mitsubishi Electric Corporation | Noise suppression device |
US8666751B2 (en) | 2011-11-17 | 2014-03-04 | Microsoft Corporation | Audio pattern matching for device activation |
GB2499699A (en) | 2011-12-14 | 2013-08-28 | Wolfson Ltd | Digital data transmission involving the position of and duration of data pulses within transfer periods |
US9337722B2 (en) | 2012-01-27 | 2016-05-10 | Invensense, Inc. | Fast power-up bias voltage circuit |
US9838810B2 (en) | 2012-02-27 | 2017-12-05 | Qualcomm Technologies International, Ltd. | Low power audio detection |
US9431012B2 (en) | 2012-04-30 | 2016-08-30 | 2236008 Ontario Inc. | Post processing of natural language automatic speech recognition |
US9093076B2 (en) | 2012-04-30 | 2015-07-28 | 2236008 Ontario Inc. | Multipass ASR controlling multiple applications |
US9479275B2 (en) | 2012-06-01 | 2016-10-25 | Blackberry Limited | Multiformat digital audio interface |
TWI474317B (en) | 2012-07-06 | 2015-02-21 | Realtek Semiconductor Corp | Signal processing apparatus and signal processing method |
CN102983868B (en) | 2012-11-02 | 2015-01-28 | 小米科技有限责任公司 | Signal processing method and signal processing device and signal processing system |
KR20140060040A (en) | 2012-11-09 | 2014-05-19 | 삼성전자주식회사 | Display apparatus, voice acquiring apparatus and voice recognition method thereof |
US9704486B2 (en) | 2012-12-11 | 2017-07-11 | Amazon Technologies, Inc. | Speech recognition power management |
CN103117065B (en) | 2013-01-09 | 2015-09-30 | 上海大唐移动通信设备有限公司 | Mean opinion score tone testing device and control method, tone testing method |
US20140244273A1 (en) | 2013-02-27 | 2014-08-28 | Jean Laroche | Voice-controlled communication connections |
US10395651B2 (en) | 2013-02-28 | 2019-08-27 | Sony Corporation | Device and method for activating with voice input |
US9349386B2 (en) | 2013-03-07 | 2016-05-24 | Analog Device Global | System and method for processor wake-up based on sensor data |
US9361885B2 (en) | 2013-03-12 | 2016-06-07 | Nuance Communications, Inc. | Methods and apparatus for detecting a voice command |
US9112984B2 (en) | 2013-03-12 | 2015-08-18 | Nuance Communications, Inc. | Methods and apparatus for detecting a voice command |
US11393461B2 (en) | 2013-03-12 | 2022-07-19 | Cerence Operating Company | Methods and apparatus for detecting a voice command |
US20140270260A1 (en) | 2013-03-13 | 2014-09-18 | Aliphcom | Speech detection using low power microelectrical mechanical systems sensor |
US9703350B2 (en) | 2013-03-15 | 2017-07-11 | Maxim Integrated Products, Inc. | Always-on low-power keyword spotting |
WO2014172167A1 (en) | 2013-04-19 | 2014-10-23 | Audience, Inc. | Vocal keyword training from text |
US9043211B2 (en) | 2013-05-09 | 2015-05-26 | Dsp Group Ltd. | Low power activation of a voice activated device |
US20140343949A1 (en) | 2013-05-17 | 2014-11-20 | Fortemedia, Inc. | Smart microphone device |
EP3000241B1 (en) | 2013-05-23 | 2019-07-17 | Knowles Electronics, LLC | Vad detection microphone and method of operating the same |
US9111548B2 (en) | 2013-05-23 | 2015-08-18 | Knowles Electronics, Llc | Synchronization of buffered data in multiple microphones |
US9984705B2 (en) | 2013-07-25 | 2018-05-29 | Dsp Group Ltd. | Non-intrusive quality measurements for use in enhancing audio quality |
US9245527B2 (en) | 2013-10-11 | 2016-01-26 | Apple Inc. | Speech recognition wake-up of a handheld portable electronic device |
US20150112690A1 (en) | 2013-10-22 | 2015-04-23 | Nvidia Corporation | Low power always-on voice trigger architecture |
US10079019B2 (en) | 2013-11-12 | 2018-09-18 | Apple Inc. | Always-on audio control for mobile device |
-
2018
- 2018-06-27 US US16/020,932 patent/US20180317019A1/en not_active Abandoned
-
2020
- 2020-01-26 US US16/752,673 patent/US11172312B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060164151A1 (en) * | 2004-11-25 | 2006-07-27 | Stmicroelectronics Pvt. Ltd. | Temperature compensated reference current generator |
US20120250910A1 (en) * | 2005-07-19 | 2012-10-04 | Audioasics A/S | Programmable microphone |
US7546498B1 (en) * | 2006-06-02 | 2009-06-09 | Lattice Semiconductor Corporation | Programmable logic devices with custom identification systems and methods |
US20090257289A1 (en) * | 2008-04-14 | 2009-10-15 | Sang-Jin Byeon | Internal voltage generator and semiconductor memory device including the same |
US8274856B2 (en) * | 2008-04-14 | 2012-09-25 | Hynix Semiconductor Inc. | Internal voltage generator and semiconductor memory device including the same |
US20110170714A1 (en) * | 2008-05-05 | 2011-07-14 | Epcos Pte Ltd | Fast precision charge pump |
US20110293115A1 (en) * | 2008-11-25 | 2011-12-01 | Audioasics A/S | Dynamically biased amplifier |
US20110107010A1 (en) * | 2009-10-29 | 2011-05-05 | Freescale Semiconductor, Inc. | One-time programmable memory device and methods thereof |
US20120177227A1 (en) * | 2011-01-12 | 2012-07-12 | Ricoh Company, Ltd. | Sound volume control circuit |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10360926B2 (en) | 2014-07-10 | 2019-07-23 | Analog Devices Global Unlimited Company | Low-complexity voice activity detection |
US10964339B2 (en) | 2014-07-10 | 2021-03-30 | Analog Devices International Unlimited Company | Low-complexity voice activity detection |
US11373637B2 (en) * | 2019-01-03 | 2022-06-28 | Realtek Semiconductor Corporation | Processing system and voice detection method |
US20210201894A1 (en) * | 2020-03-12 | 2021-07-01 | Beijing Baidu Netcom Science And Technology Co., Ltd. | N/a |
Also Published As
Publication number | Publication date |
---|---|
US20200162823A1 (en) | 2020-05-21 |
US11172312B2 (en) | 2021-11-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10313796B2 (en) | VAD detection microphone and method of operating the same | |
US11172312B2 (en) | Acoustic activity detecting microphone | |
US10332544B2 (en) | Microphone and corresponding digital interface | |
US9111548B2 (en) | Synchronization of buffered data in multiple microphones | |
CN110164451B (en) | Speech recognition | |
US20190116428A1 (en) | Ultrasonic operation of a digital microphone | |
CN104867495B (en) | Sound recognition apparatus and method of operating the same | |
US9711166B2 (en) | Decimation synchronization in a microphone | |
US9177546B2 (en) | Cloud based adaptive learning for distributed sensors | |
US9799215B2 (en) | Low power acoustic apparatus and method of operation | |
US20150066495A1 (en) | Robust Feature Extraction Using Differential Zero-Crossing Countes | |
US20150066498A1 (en) | Analog to Information Sound Signature Detection | |
US11716579B2 (en) | Micro-electro-mechanical acoustic transducer device with improved detection features and corresponding electronic apparatus | |
WO2018097969A1 (en) | Methods and systems for locating the end of the keyword in voice sensing | |
US11677413B2 (en) | Audio ADC for supporting voice wake-up and electronic device | |
CN106104686B (en) | Method in a microphone, microphone assembly, microphone arrangement |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
AS | Assignment |
Owner name: KNOWLES ELECTRONICS, LLC, ILLINOIS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FURST, CLAUS ERDMANN;THOMSEN, HENRIK;DERUGINSKY, MICHAEL;AND OTHERS;SIGNING DATES FROM 20190212 TO 20190902;REEL/FRAME:051541/0748 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |