WO2017112063A1 - Automated equalization - Google Patents
Automated equalization Download PDFInfo
- Publication number
- WO2017112063A1 WO2017112063A1 PCT/US2016/057735 US2016057735W WO2017112063A1 WO 2017112063 A1 WO2017112063 A1 WO 2017112063A1 US 2016057735 W US2016057735 W US 2016057735W WO 2017112063 A1 WO2017112063 A1 WO 2017112063A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- dut
- spectral profile
- correction filter
- signal
- delta
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
- H04R3/04—Circuits for transducers for correcting frequency response
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/20—Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0316—Speech enhancement, e.g. noise reduction or echo cancellation by changing the amplitude
Definitions
- the present disclosure relates generally to techniques for equalization of a microphone internal to a device to improve the accuracy of speech recognition by the device. More specifically, the present techniques relate to the calculation of a correction filter which is applied to a signal produced by the microphone.
- ASR Automatic speech recognition
- FIG. 1 is a block diagram of an electronic device for improving automatic speech recognition
- FIG. 2 is a process flow diagram of a method for improving automatic speech recognition
- FIG. 3 is a block diagram showing a medium that contains logic for improving automatic speech recognition
- Fig. 4A is an example of a reference spectral profile obtained using the present techniques
- Fig. 4B is an example of a spectral profile for a device under test (DUT) obtained using the present techniques
- Fig. 4C is an example of a DUT spectral profile after application of a correction filter obtained using the present techniques
- Fig. 4D is an example of a magnitude response of a correction filter obtained using the present techniques
- Fig. 4E is an example of accuracy improvements in automatic speech recognition (ASR) resulting from application of a correction filter obtained using the present techniques.
- Fig. 4F is an example of accuracy improvements in ASR resulting from application of a correction filter obtained using the present techniques.
- a reference signal may be calculated from a set of speech recordings.
- a device signal may be obtained by recording a speech utterance.
- a reference spectral profile may be extracted from the reference signal and a device spectral profile may be extracted from the device signal.
- the reference spectral profile and the device spectral profile may be compared.
- a delta between the reference spectral profile and the device spectral profile may be calculated.
- a correction filter may be designed using the computed delta.
- the correction filter may be applied to a signal produced by the device's microphone. Correction filters may be designed for different circumstances and for various microphones in multi- microphone devices.
- connection along with their derivatives, may be used. It should be understood that these terms are not intended as synonyms for each other. Rather, in particular embodiments, “connected” may be used to indicate that two or more elements are in direct physical or electrical contact with each other. "Coupled” may mean that two or more elements are in direct physical or electrical contact. However, “coupled” may also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other.
- Fig. 1 is a block diagram of an electronic device 1 00 for improving automatic speech recognition.
- the electronic device 100 may be a desktop computer, laptop computer, tablet computer, mobile phone, smart phone, or any other suitable electronic device.
- the electronic device 100 may include a central processing unit (CPU) 102 that is configured to execute stored instructions, as well as a memory device 104 that stores instructions that are executable by the CPU 102.
- the CPU 102 may be coupled to the memory device 1 04 by a bus 106.
- the CPU 102 may be a single core processor, a multi-core processor, a computing cluster, or any number of other configurations.
- the CPU 102 may be implemented as a
- the CPU 102 includes dual-core processor(s), dual-core mobile processor(s), or the like.
- the memory device 104 may include random access memory (e.g., SRAM, DRAM, zero capacitor RAM, SONOS, eDRAM, EDO RAM, DDR RAM, RRAM, PRAM, etc.), read only memory (e.g., Mask ROM, PROM, EPROM,
- random access memory e.g., SRAM, DRAM, zero capacitor RAM, SONOS, eDRAM, EDO RAM, DDR RAM, RRAM, PRAM, etc.
- read only memory e.g., Mask ROM, PROM, EPROM,
- the memory device 1 04 can be used to store data and computer-readable instructions that, when executed by the CPU 102, direct the CPU 102 to perform various operations in accordance with embodiments described herein.
- the electronic device 100 may also include a storage drive 106.
- the storage device 106 is a physical memory device such as a hard drive, an optical drive, a flash drive, an array of drives, or any combinations thereof.
- the storage device 1 06 may store data such as audio signals and spectral profiles, among other types of data.
- the storage device 106 may also store programming code such as device drivers, software applications, operating systems, and the like. The programming code stored by the storage device 106 may be executed by the CPU 102 or any other processors that may be included in the electronic device 100.
- the electronic device 100 may also include an input/output (I/O) device interface 108 configured to connect the electronic device 100 to one or more I/O devices 1 10.
- I/O input/output
- the I/O devices 1 10 may include a printer, a scanner, a keyboard, and a pointing device such as a mouse, touchpad, or touchscreen, among others.
- the I/O devices 1 10 may be built-in components of the electronic device 100, or may be devices that are externally connected to the electronic device 100.
- the electronic device 100 may also include a network interface controller (NIC) 1 12 configured to connect the electronic device 1 00 to a network 1 14.
- the network 1 14 may be a wide area network (WAN), local area network (LAN), or the Internet, among others.
- the electronic device 100 may be a stand-alone device or a component of a device under test (DUT).
- the DUT is the device to which the correction filter will be applied.
- the electronic device 100 may include a first calculating unit (not shown) to calculate a reference signal from a set of recordings.
- a microphone internal to the DUT may receive a speech utterance.
- the speech utterance received by the microphone may be converted into an electrical signal containing information that represents the speech utterance. This signal may be the DUT signal.
- DUT signals may be obtained for different microphones of the DUT, for different orientations of the DUT (e.g., portrait or landscape), different distances from a user to the DUT, and different angles between a user and the DUT.
- the different DUT signals may be used to construct different correction filters that are applied depending on the DUT microphone used, the DUT's orientation, and a user's position relative to the DUT.
- a recording unit (not shown) may record the various DUT signals.
- the DUT itself may record the speech utterances.
- the electronic device 100 may also include an extracting unit 1 1 6 to extract a reference spectral profile from the reference signal and a DUT spectral profile from the DUT signal.
- a comparing unit 1 18 may compare the reference spectral profile and the DUT spectral profile.
- a delta calculating unit 120 may calculate a delta between the two spectral profiles. The computed delta may serve as a basis for the design of the correction filter by the design unit 122.
- An application unit (not shown) may apply the correction filter to the signal emanating from the DUT's microphone.
- Different correction filters may be applied depending on the DUT microphone used, the DUT's orientation, and the user's position relative to the DUT.
- An orientation sensor (not shown) may determine the orientation of the DUT and apply the appropriate correction filter. For example, if a user is speaking and the DUT is in portrait mode, the applied correction filter may be the filter constructed from the DUT signal received while the DUT had a portrait orientation. In another example, different correction filters may be applied depending on whether the lid of the DUT (e.g., a laptop) was open or closed when the user was speaking.
- the electronic device 100 may also include a proximity senor (not shown) to determine the distance from a speaker to the DUT and apply the appropriate correction filter. For example, if the speaker is two feet from the DUT, the applied correction filter may be the filter constructed from the DUT signal received from two feet away.
- the electronic device 100 may include an angle sensor (not shown) to determine the angle between a speaker and the DUT and apply the appropriate correction filter. For example, if the speaker is at an angle of 30° to the DUT, the applied correction filter may be the filter constructed from the DUT signal received at an angle of 30°. In this way, the orientation sensor, proximity sensor, and angle sensor may determine the correction filter that is applied to the signal propagating from the DUT's microphone.
- Busses 106 Communication between various components of the electronic device 100 may be accomplished via one or more busses 106. At least one of the busses 106 may be a D-PHY bus, a Mobile Industry Processor Interface (Ml PI) D-PHY bus, or an M-PHY bus, or any other suitable bus.
- Ml PI Mobile Industry Processor Interface
- the bus architecture shown in Fig. 1 is just one example of a bus architecture that may be used with the techniques disclosed herein.
- the bus 106 may be a single bus that couples all of the components of the electronic device 100 according to a particular communication protocol.
- the electronic device 100 may also include any suitable number of busses 1 06 of varying types, which may use different communication protocols to couple specific components of the electronic device according to the design considerations of a particular implementation.
- FIG. 1 The block diagram of Fig. 1 is not intended to indicate that the computing device 1 00 is to include all of the components shown in Fig. 1 . Rather, the computing system 100 can include fewer or additional components not shown in Fig. 1 , depending on the details of the specific implementation.
- any of the functionalities of the CPU 102 may be partially, or entirely, implemented in hardware and/or by a processor.
- the functionality may be implemented in any combination of Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), logic circuits, and the like.
- embodiments of the present techniques can be implemented in any suitable electronic device, including ultra-compact form factor devices, such as System-On-a-Chip (SOC), and multi-chip modules.
- SOC System-On-a-Chip
- Fig. 2 is a process flow diagram of a method 200 for improving automatic speech recognition.
- the method 200 may be performed by the electronic device 100 shown in Fig. 1 .
- the method 200 may begin by obtaining a reference signal and a DUT signal (not shown).
- the reference signal may be computed using a set of speech recordings.
- the speech recordings may have a high accuracy, i.e., low word error rate, when used with a particular automatic speech recognition (ASR) system.
- ASR automatic speech recognition
- Different speech recordings may be obtained using different ASR systems.
- the different speech recordings may be used to construct correction filters applicable to specific ASR systems. For example, if a speech recording is obtained using a particular ASR system, the correction filter may be used with that particular system.
- Suitable ASR systems are available from a number of manufacturers and/or organizations.
- the DUT signal may be constructed in a series of steps.
- a speech utterance may be recorded using the DUT to obtain a recorded speech utterance.
- the speech utterance may be recorded under different circumstances, i.e., different orientations of the DUT and different positions of the speaker relative to the DUT.
- the circumstances under which the recording was made may determine the circumstances under which the correction filter will be applicable. For example, if the recording was obtained when the DUT was in landscape mode and the speaker was 3 feet away from the DUT at an angle of 45° to the DUT, the resulting correction filter may be applied under the same circumstances.
- the correction filter may have an average spectral profile obtained from recordings made while one condition is held constant (e.g., portrait or landscape mode) and the other conditions are varied.
- the recorded speech utterance may be broadcast using a speaker external to the DUT to obtain a broadcasted speech utterance.
- the broadcasted speech utterance may be received via a microphone or microphones internal to the DUT. Once received by the microphone, the broadcasted speech utterance may become a DUT signal.
- the method 200 may include blocks 202-212.
- a reference spectral profile may be extracted from the reference signal by the extracting unit 1 1 6.
- the amplitude spectra of the reference signal may be time averaged to yield an averaged reference amplitude spectrum.
- the averaged reference amplitude spectrum constitutes the reference spectral profile.
- the reference spectral profile may be computed as an average of short time amplitude spectra of the reference signal. Short time magnitude spectra may also be averaged.
- the average may be calculated across adjacent time frames of the reference signal. Each time frame may be converted to the frequency domain by the fast Fourier transform (FFT), the cosine transform, and the like.
- FFT fast Fourier transform
- the resolution of the spectral profile may be selected to match the Mel-filtering resolution defined in the ETSI ES 201 108 standard, "Speech Processing, Transmission and Quality Aspects.”
- the standard describes a distributed speech recognition system that overcomes the degradation of the performance of speech recognition systems receiving speech transmitted over mobile channels.
- Matching of the spectral resolution to the Mel- filtering resolution may be performed because Mel filters are typically used to analyze signals in ASR systems. In practice, the matching of the resolutions may mean a 512-point FFT is utilized.
- a DUT spectral profile may be extracted from the DUT signal by the extracting unit 1 16.
- the DUT spectral profile may be calculated in the same manner as the reference spectral profile.
- the reference spectral profile and the DUT spectral profile may be compared by the comparing unit 1 18.
- the delta between the reference spectral profile and the DUT spectral profile may be calculated by the delta calculating unit 120. The delta may be defined as:
- D(f) may be used as a reference to design the correction filter. This may be accomplished by the design unit 1 22.
- the correction filter may be designed using a frequency-sampling design method and implemented as a finite impulse response filter or the correction filter may be designed by any other suitable method. It may be possible to construct different correction filters for the different situations simulated during recording of the speech utterance by the DUT. For example, one recording may have occurred with the DUT in landscape mode and the speaker 3 feet away from the DUT at an angle of 45° to the DUT. In that case, ⁇ ( ) may be extracted from the recordings made for that particular set of circumstances. Hence, D(f) and the resulting correction filter may be specific to that situation.
- the correction filter may be applied to the signal produced by the microphone internal to the DUT.
- the correction filter may be applied to the microphone's signal in real time by adding a filtering block to the preprocessing (up-link) pipeline.
- Pipelines of this type are often used for audio stacks in notebook computers, tablet computers, mobile phones, smart phones, and the like.
- Application of the correction filter to the DUT's microphone signal may include determining the orientation of the DUT, the distance of a user from the DUT, the angle between the user and the DUT, and the position of the DUT's lid. These determinations may be made to ascertain which correction filter is appropriate given the set of circumstances. In this manner, the correction filter that is applied may be derived from the recordings made under the same or similar circumstances.
- Blocks 202-210 may be referred to as the tuning stage and may be performed by the manufacturer of the DUT. Block 21 2 may be performed when a user speaks into the DUT's microphone.
- Fig. 3 is a block diagram showing a medium 300 that contains logic for obtaining a correction filter.
- the medium 300 may be a non-transitory computer- readable medium that stores code that can be accessed by a computer processing unit (CPU) 302 via a bus 304.
- the computer-readable medium 300 can be a volatile or non-volatile data storage device.
- the medium 300 can also be a logic unit, such as an Application Specific Integrated Circuit (ASIC), a Field
- FPGA Programmable Gate Array
- the medium 300 may include modules 306-312 configured to perform the techniques described herein.
- a spectral profile extractor 306 may be configured to extract a reference spectral profile from a reference signal and a DUT spectral profile from a DUT signal.
- a spectral profile comparator 308 may be configured to compare the reference spectral profile and the DUT spectral profile.
- a delta calculator 310 may be configured to calculate a delta between the reference spectral profile and the DUT spectral profile.
- a correction filter designer 312 may be configured to design the correction filter using the computed delta.
- the modules 306-312 may be modules of computer code configured to direct the operations of the processor 302.
- Fig. 3 The block diagram of Fig. 3 is not intended to indicate that the medium 300 is to include all of the components shown in Fig. 3. Further, the medium 300 may include any number of additional components not shown in Fig. 3, depending on the details of the specific implementation.
- Fig. 4A is an example according to the present techniques.
- a notebook computer running an exemplary ASR engine was used to evaluate the accuracy of speech recognition.
- a set of high quality recordings was identified by their high ASR scores, i.e., low word error rates (WERs).
- the high quality recordings were used to compute the reference spectral profile shown in FIG. 4A.
- the DUT spectral profile is shown in Fig. 4B.
- Fig. 4C shows the DUT spectral profile after application of the correction filter.
- the x-axes 402A, 402B, and 402C are frequency in Hertz and the y-axes 404A, 404B, and 404C are amplitude on a linear scale.
- Fig. 4D is the magnitude response of the correction filter calculated by techniques described herein.
- the x-axis is frequency in Hertz and the y-axis is amplitude.
- Figs. 4E and 4F show the ASR accuracy improvements obtained when the correction filter was applied to speech signals.
- the speech signals were generated by broadcasting speech recordings over a main loudspeaker external to the DUT.
- the data shown in Fig. 4E was obtained in the absence of an additional loudspeaker.
- Fig. 4F shows the results obtained in the presence of an additional side loudspeaker simulating a second user and masking the speech signals propagated by the main loudspeaker.
- the speech signals were obtained with the main loudspeaker positioned at different angles to the DUT. (At 0° the main loudspeaker is directly in front of the DUT.)
- the angles are given in columns 402E and 402F.
- Rows 406E and 406F give the WERs without the application of the correction filter.
- Rows 408E and 408F show the WERs with application of the correction filter designed by techniques described herein.
- Rows 410E and 41 OF give the delta values used to design the correction filter.
- Column 412E and 412F are the mean values for the rows 406E, 406F, 408E, 408F, 410E, and 41 OF.
- Example 1 is an electronic device for improving speech recognition of a device under test (DUT).
- the electronic device includes an extracting unit to extract a reference spectral profile from a reference signal and a DUT spectral profile from a DUT signal; a comparing unit to compare the reference spectral profile and the DUT spectral profile; a delta calculating unit to compute a delta between the reference spectral profile and the DUT spectral profile to obtain a computed delta; and a design unit to design a correction filter based on the computed delta.
- Example 2 includes the electronic device of example 1 , including or excluding optional features.
- the electronic device includes a first calculating unit to calculate the reference signal from a set of recordings.
- Example 3 includes the electronic device of any one of examples 1 to 2, including or excluding optional features.
- the design unit designs the correction filter using a plurality of recordings, and wherein the plurality of recordings are obtained from one or more devices.
- Example 4 includes the electronic device of any one of examples 1 to 3, including or excluding optional features.
- the electronic device includes an application unit to apply the correction filter to a microphone of the DUT.
- the electronic device includes an orientation sensor to determine an orientation of the DUT and employ an appropriate correction filter.
- the electronic device includes a proximity sensor to determine a distance from a user to the DUT and employ the appropriate correction filter.
- the electronic device includes an angle sensor to determine an angle between the user and the DUT and employ the appropriate correction filter.
- the electronic device includes a lid position sensor to determine a position of a lid of the DUT and employ the appropriate correction filter.
- Example 5 includes the electronic device of any one of examples 1 to 4, including or excluding optional features.
- the electronic device includes one or more microphones to receive the DUT signal.
- the electronic device includes a recording unit to record the DUT signal.
- Example 6 is a method of improving speech recognition of a device under test (DUT).
- the method includes extracting a reference spectral profile from a reference signal; extracting a DUT spectral profile from a DUT signal; comparing the reference spectral profile and DUT spectral profile; calculating a delta between the reference spectral profile and the DUT spectral profile; and designing a correction filter using the delta.
- Example 7 includes the method of example 6, including or excluding optional features.
- the method includes using a set of speech recordings to calculate a reference signal.
- the method includes averaging of amplitude spectra of the reference signal to obtain the reference spectral profile.
- Example 8 includes the method of any one of examples 6 to 7, including or excluding optional features.
- the method includes recording a speech utterance using the DUT to obtain a recorded speech utterance.
- the method includes broadcasting the recorded speech utterance using a speaker to obtain a broadcasted speech utterance; and receiving the broadcasted speech utterance using a microphone internal to the DUT to obtain a DUT signal.
- broadcasting the recorded speech utterance comprises using a speaker external to the DUT.
- broadcasting the recorded speech utterance comprises using a speaker internal to the DUT.
- the method includes averaging of amplitude spectra of the DUT signal to obtain the DUT spectral profile.
- Example 9 includes the method of any one of examples 6 to 8, including or excluding optional features.
- the method includes calculating the correction filter using a frequency-sampling method or any other technique for designing an audio signal filter.
- Example 10 includes the method of any one of examples 6 to 9, including or excluding optional features.
- the method includes applying the correction filter to a signal produced by the microphone internal to the DUT.
- applying the correction filter comprises determining at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT.
- Example 1 1 is a computer-readable medium, comprising instructions that, when executed by the processor, direct the processor to improve speech recognition of a device under test (DUT).
- the computer-readable medium includes instructions that direct the processor to extract a reference spectral profile from a reference signal; extract a DUT spectral profile from a DUT signal; compare the reference spectral profile and the DUT spectral profile; calculate a delta between the reference spectral profile and the DUT spectral profile; and design a correction filter using the delta.
- Example 12 includes the computer-readable medium of example 1 1 , including or excluding optional features.
- the computer-readable medium includes instructions to direct the processor to calculate the reference signal from a set of speech recordings.
- the computer-readable medium includes instructions to direct the processor to average amplitude spectra of the reference signal to obtain the reference spectral profile.
- Example 13 includes the computer-readable medium of any one of examples 1 1 to 12, including or excluding optional features.
- the computer-readable medium includes instructions to direct the processor to receive a speech utterance via a microphone to obtain the DUT signal.
- the computer-readable medium includes instructions to direct the processor to average amplitude spectra of the DUT signal to obtain the DUT spectral profile.
- Example 14 includes the computer-readable medium of any one of examples 1 1 to 13, including or excluding optional features.
- the computer-readable medium includes instructions to direct the processor to apply the correction filter to a signal produced by the microphone.
- the computer- readable medium includes instructions to determine at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT when applying the correction filter.
- Example 15 includes the computer-readable medium of any one of examples 1 1 to 14, including or excluding optional features.
- the computer-readable medium includes instructions to calculate the correction filter using a frequency-sampling method or any other technique for designing an audio signal filter.
- Example 16 is an apparatus for improving speech recognition of a device under test (DUT).
- the apparatus includes instructions that direct the processor to a means for extracting a spectral profile, wherein the means for extracting a spectral profile extracts a reference spectral profile from a reference signal and a DUT spectral profile from a DUT signal; a means for comparing the reference spectral profile and the DUT spectral profile; a means for calculating a delta between the reference spectral profile and the DUT spectral profile; and a means for designing a correction filter using the delta.
- Example 17 includes the apparatus of example 1 6, including or excluding optional features.
- the apparatus includes a means for calculating the reference signal from a set of speech recordings.
- Example 18 includes the apparatus of any one of examples 1 6 to 17, including or excluding optional features.
- the means for extracting a spectral profile averages amplitude spectra of the reference signal to obtain the reference spectral profile.
- Example 19 includes the apparatus of any one of examples 1 6 to 18, including or excluding optional features.
- the apparatus includes a means for recording a speech utterance to obtain a recorded speech utterance.
- the apparatus includes a means for broadcasting the recorded speech utterance to obtain a broadcasted speech utterance; and a means for receiving the broadcasted speech utterance to obtain a DUT signal.
- the means for broadcasting the recorded speech utterance is a speaker external to the DUT.
- the means for broadcasting the recorded speech utterance is a speaker internal to the DUT.
- the means for receiving the broadcasted speech utterance is a microphone internal to the DUT.
- Example 20 includes the apparatus of any one of examples 1 6 to 19, including or excluding optional features.
- the means for extracting a spectral profile averages amplitude spectra of the DUT signal to obtain the DUT spectral profile.
- Example 21 includes the apparatus of any one of examples 1 6 to 20, including or excluding optional features.
- the apparatus includes a means for calculating the correction filter, wherein the means for calculating the correction filter is a frequency-sampling method or any other technique for designing an audio signal filter.
- Example 22 includes the apparatus of any one of examples 1 6 to 21 , including or excluding optional features.
- the apparatus includes a means for applying the correction filter to a signal produced by the microphone internal to the DUT.
- the apparatus includes a means for applying the correction filter, wherein the means for applying the correction filter determines at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT.
- Example 23 is a notebook computer with improved speech recognition.
- the notebook computer with improved speech recognition includes instructions that direct the processor to an extracting unit to extract a reference spectral profile from a reference signal and a notebook computer spectral profile from a notebook computer signal; a comparing unit to compare the reference spectral profile and the notebook computer spectral profile; a delta calculating unit to compute a delta between the reference spectral profile and the notebook computer spectral profile to obtain a computed delta; and a design unit to design a correction filter based on the computed delta.
- Example 24 includes the notebook computer with improved speech recognition of example 23, including or excluding optional features.
- the notebook computer with improved speech recognition includes a first calculating unit to calculate the reference signal from a set of recordings.
- Example 25 includes the notebook computer with improved speech recognition of any one of examples 23 to 24, including or excluding optional features.
- the design unit designs the correction filter using a plurality of recordings, and wherein the plurality of recordings are obtained from one or more devices.
- Example 26 includes the notebook computer with improved speech recognition of any one of examples 23 to 25, including or excluding optional features.
- the notebook computer with improved speech recognition includes an application unit to apply the correction filter to a microphone of the notebook computer.
- the notebook computer with improved speech recognition includes an orientation sensor to determine an orientation of the notebook computer and employ an appropriate correction filter.
- the notebook computer with improved speech recognition includes a proximity sensor to determine a distance from a user to the notebook computer and employ the appropriate correction filter.
- the notebook computer with improved speech recognition includes an angle sensor to determine an angle between the user and the notebook computer and employ the appropriate correction filter.
- the notebook computer with improved speech recognition includes a lid position sensor to determine a position of a lid of the notebook computer and employ the appropriate correction filter.
- Example 27 includes the notebook computer with improved speech recognition of any one of examples 23 to 26, including or excluding optional features.
- the notebook computer with improved speech recognition includes one or more microphones to receive the notebook computer signal.
- the notebook computer with improved speech recognition includes a recording unit to record the notebook computer signal.
- Some embodiments may be implemented in one or a combination of hardware, firmware, and software. Some embodiments may also be implemented as instructions stored on the tangible, non-transitory, machine-readable medium, which may be read and executed by a computing platform to perform the operations described.
- a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine, e.g., a computer.
- a machine-readable medium may include read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; or electrical, optical, acoustical or other form of propagated signals, e.g., carrier waves, infrared signals, digital signals, or the interfaces that transmit and/or receive signals, among others.
- An embodiment is an implementation or example.
- Reference in the specification to "an embodiment,” “one embodiment,” “some embodiments,” “various embodiments,” or “other embodiments” means that a particular feature, structure, or characteristic described in connection with the embodiments is included in at least some embodiments, but not necessarily all embodiments, of the present techniques.
- the various appearances of "an embodiment,” “one embodiment,” or “some embodiments” are not necessarily all referring to the same embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Otolaryngology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Circuit For Audible Band Transducer (AREA)
- Quality & Reliability (AREA)
Abstract
Techniques for improving speech recognition are described. An example of an electronic device includes an extracting unit to extract a reference spectral profile from a reference signal and a device spectral profile from a device signal. A comparing unit compares the reference spectral profile and the device spectral profile. A delta calculating unit calculates a delta between the reference spectral profile and the device spectral profile. A design unit designs a correction filter based on the computed delta.
Description
AUTOMATED EQUALIZATION
Cross Reference to Related Application
[0001] The present application claims the benefit of the filing date of United States Patent Application No. 14/757,884, by Maziewski et al., entitled " Automated Equalization," filed December 24, 201 5, and is incorporated herein by reference.
Technical Field
[0002] The present disclosure relates generally to techniques for equalization of a microphone internal to a device to improve the accuracy of speech recognition by the device. More specifically, the present techniques relate to the calculation of a correction filter which is applied to a signal produced by the microphone.
Background Art
[0003] Automatic speech recognition (ASR) systems enable the translation of spoken language into text by a computer or computerized device. The performance of ASR systems varies from one device to another partly because of the differences in the frequency response of the devices' microphones.
Brief Description of the Drawings
[0004] Fig. 1 is a block diagram of an electronic device for improving automatic speech recognition;
[0005] Fig. 2 is a process flow diagram of a method for improving automatic speech recognition;
[0006] Fig. 3 is a block diagram showing a medium that contains logic for improving automatic speech recognition;
[0007] Fig. 4A is an example of a reference spectral profile obtained using the present techniques;
[0008] Fig. 4B is an example of a spectral profile for a device under test (DUT) obtained using the present techniques;
[0009] Fig. 4C is an example of a DUT spectral profile after application of a correction filter obtained using the present techniques;
[0010] Fig. 4D is an example of a magnitude response of a correction filter obtained using the present techniques;
[0011] Fig. 4E is an example of accuracy improvements in automatic speech recognition (ASR) resulting from application of a correction filter obtained using the present techniques; and
[0012] Fig. 4F is an example of accuracy improvements in ASR resulting from application of a correction filter obtained using the present techniques.
[0013] The same numbers are used throughout the disclosure and the figures to reference like components and features. Numbers in the 100 series refer to features originally found in Fig. 1 ; numbers in the 200 series refer to features originally found in Fig. 2; and so on.
Description of the Embodiments
[0014] The subject matter disclosed herein relates to techniques for improving speech recognition of a computerized device. The present disclosure describes techniques for improving speech recognition by calculating and applying a correction filter. For example, a reference signal may be calculated from a set of speech recordings. A device signal may be obtained by recording a speech utterance. A reference spectral profile may be extracted from the reference signal and a device spectral profile may be extracted from the device signal. The reference spectral profile and the device spectral profile may be compared. A delta between the reference spectral profile and the device spectral profile may be calculated. A correction filter may be designed using the computed delta. The correction filter may be applied to a signal produced by the device's microphone. Correction filters may be designed for different circumstances and for various microphones in multi- microphone devices. Various examples of the present techniques are described further below with reference to the figures.
[0015] In the following description and claims, the terms "coupled" and
"connected," along with their derivatives, may be used. It should be understood that these terms are not intended as synonyms for each other. Rather, in particular embodiments, "connected" may be used to indicate that two or more elements are in direct physical or electrical contact with each other. "Coupled" may mean that two or
more elements are in direct physical or electrical contact. However, "coupled" may also mean that two or more elements are not in direct contact with each other, but yet still co-operate or interact with each other.
[0016] Fig. 1 is a block diagram of an electronic device 1 00 for improving automatic speech recognition. For example, the electronic device 100 may be a desktop computer, laptop computer, tablet computer, mobile phone, smart phone, or any other suitable electronic device. The electronic device 100 may include a central processing unit (CPU) 102 that is configured to execute stored instructions, as well as a memory device 104 that stores instructions that are executable by the CPU 102. The CPU 102 may be coupled to the memory device 1 04 by a bus 106. The CPU 102 may be a single core processor, a multi-core processor, a computing cluster, or any number of other configurations. The CPU 102 may be implemented as a
Complex Instruction Set Computer (CISC) processor, a Reduced Instruction Set Computer (RISC) processor, x86 Instruction set compatible processor, or any other microprocessor or central processing unit. In some embodiments, the CPU 102 includes dual-core processor(s), dual-core mobile processor(s), or the like.
[0017] The memory device 104 may include random access memory (e.g., SRAM, DRAM, zero capacitor RAM, SONOS, eDRAM, EDO RAM, DDR RAM, RRAM, PRAM, etc.), read only memory (e.g., Mask ROM, PROM, EPROM,
EEPROM, etc.), flash memory, or any other suitable memory system. The memory device 1 04 can be used to store data and computer-readable instructions that, when executed by the CPU 102, direct the CPU 102 to perform various operations in accordance with embodiments described herein.
[0018] The electronic device 100 may also include a storage drive 106. The storage device 106 is a physical memory device such as a hard drive, an optical drive, a flash drive, an array of drives, or any combinations thereof. The storage device 1 06 may store data such as audio signals and spectral profiles, among other types of data. The storage device 106 may also store programming code such as device drivers, software applications, operating systems, and the like. The programming code stored by the storage device 106 may be executed by the CPU 102 or any other processors that may be included in the electronic device 100.
[0019] The electronic device 100 may also include an input/output (I/O) device interface 108 configured to connect the electronic device 100 to one or more I/O devices 1 10. For example, the I/O devices 1 10 may include a printer, a scanner, a keyboard, and a pointing device such as a mouse, touchpad, or touchscreen, among others. The I/O devices 1 10 may be built-in components of the electronic device 100, or may be devices that are externally connected to the electronic device 100.
[0020] The electronic device 100 may also include a network interface controller (NIC) 1 12 configured to connect the electronic device 1 00 to a network 1 14. The network 1 14 may be a wide area network (WAN), local area network (LAN), or the Internet, among others.
[0021] The electronic device 100 may be a stand-alone device or a component of a device under test (DUT). The DUT is the device to which the correction filter will be applied.
[0022] The electronic device 100 may include a first calculating unit (not shown) to calculate a reference signal from a set of recordings. To obtain a DUT signal, a microphone internal to the DUT may receive a speech utterance. The speech utterance received by the microphone may be converted into an electrical signal containing information that represents the speech utterance. This signal may be the DUT signal. DUT signals may be obtained for different microphones of the DUT, for different orientations of the DUT (e.g., portrait or landscape), different distances from a user to the DUT, and different angles between a user and the DUT. The different DUT signals may be used to construct different correction filters that are applied depending on the DUT microphone used, the DUT's orientation, and a user's position relative to the DUT. A recording unit (not shown) may record the various DUT signals. In some embodiments, the DUT itself may record the speech utterances.
[0023] The electronic device 100 may also include an extracting unit 1 1 6 to extract a reference spectral profile from the reference signal and a DUT spectral profile from the DUT signal. A comparing unit 1 18 may compare the reference spectral profile and the DUT spectral profile. A delta calculating unit 120 may calculate a delta between the two spectral profiles. The computed delta may serve as a basis for the design of the correction filter by the design unit 122. An
application unit (not shown) may apply the correction filter to the signal emanating from the DUT's microphone.
[0024] Different correction filters may be applied depending on the DUT microphone used, the DUT's orientation, and the user's position relative to the DUT. An orientation sensor (not shown) may determine the orientation of the DUT and apply the appropriate correction filter. For example, if a user is speaking and the DUT is in portrait mode, the applied correction filter may be the filter constructed from the DUT signal received while the DUT had a portrait orientation. In another example, different correction filters may be applied depending on whether the lid of the DUT (e.g., a laptop) was open or closed when the user was speaking.
[0025] The electronic device 100 may also include a proximity senor (not shown) to determine the distance from a speaker to the DUT and apply the appropriate correction filter. For example, if the speaker is two feet from the DUT, the applied correction filter may be the filter constructed from the DUT signal received from two feet away.
[0026] The electronic device 100 may include an angle sensor (not shown) to determine the angle between a speaker and the DUT and apply the appropriate correction filter. For example, if the speaker is at an angle of 30° to the DUT, the applied correction filter may be the filter constructed from the DUT signal received at an angle of 30°. In this way, the orientation sensor, proximity sensor, and angle sensor may determine the correction filter that is applied to the signal propagating from the DUT's microphone.
[0027] Communication between various components of the electronic device 100 may be accomplished via one or more busses 106. At least one of the busses 106 may be a D-PHY bus, a Mobile Industry Processor Interface (Ml PI) D-PHY bus, or an M-PHY bus, or any other suitable bus.
[0028] The bus architecture shown in Fig. 1 is just one example of a bus architecture that may be used with the techniques disclosed herein. In some examples, the bus 106 may be a single bus that couples all of the components of the electronic device 100 according to a particular communication protocol.
Furthermore, the electronic device 100 may also include any suitable number of busses 1 06 of varying types, which may use different communication protocols to
couple specific components of the electronic device according to the design considerations of a particular implementation.
[0029] The block diagram of Fig. 1 is not intended to indicate that the computing device 1 00 is to include all of the components shown in Fig. 1 . Rather, the computing system 100 can include fewer or additional components not shown in Fig. 1 , depending on the details of the specific implementation. Furthermore, any of the functionalities of the CPU 102 may be partially, or entirely, implemented in hardware and/or by a processor. For example, the functionality may be implemented in any combination of Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), logic circuits, and the like. In addition, embodiments of the present techniques can be implemented in any suitable electronic device, including ultra-compact form factor devices, such as System-On-a-Chip (SOC), and multi-chip modules.
[0030] Fig. 2 is a process flow diagram of a method 200 for improving automatic speech recognition. The method 200 may be performed by the electronic device 100 shown in Fig. 1 . The method 200 may begin by obtaining a reference signal and a DUT signal (not shown). The reference signal may be computed using a set of speech recordings. The speech recordings may have a high accuracy, i.e., low word error rate, when used with a particular automatic speech recognition (ASR) system. Different speech recordings may be obtained using different ASR systems. The different speech recordings may be used to construct correction filters applicable to specific ASR systems. For example, if a speech recording is obtained using a particular ASR system, the correction filter may be used with that particular system. Suitable ASR systems are available from a number of manufacturers and/or organizations.
[0031] The DUT signal may be constructed in a series of steps. A speech utterance may be recorded using the DUT to obtain a recorded speech utterance. The speech utterance may be recorded under different circumstances, i.e., different orientations of the DUT and different positions of the speaker relative to the DUT. The circumstances under which the recording was made may determine the circumstances under which the correction filter will be applicable. For example, if the recording was obtained when the DUT was in landscape mode and the speaker was
3 feet away from the DUT at an angle of 45° to the DUT, the resulting correction filter may be applied under the same circumstances. In other examples, the correction filter may have an average spectral profile obtained from recordings made while one condition is held constant (e.g., portrait or landscape mode) and the other conditions are varied.
[0032] The recorded speech utterance may be broadcast using a speaker external to the DUT to obtain a broadcasted speech utterance. The broadcasted speech utterance may be received via a microphone or microphones internal to the DUT. Once received by the microphone, the broadcasted speech utterance may become a DUT signal.
[0033] The method 200 may include blocks 202-212. At block 202, a reference spectral profile may be extracted from the reference signal by the extracting unit 1 1 6. The amplitude spectra of the reference signal may be time averaged to yield an averaged reference amplitude spectrum. The averaged reference amplitude spectrum constitutes the reference spectral profile. For example, the reference spectral profile may be computed as an average of short time amplitude spectra of the reference signal. Short time magnitude spectra may also be averaged. The average may be calculated across adjacent time frames of the reference signal. Each time frame may be converted to the frequency domain by the fast Fourier transform (FFT), the cosine transform, and the like. The resolution of the spectral profile may be selected to match the Mel-filtering resolution defined in the ETSI ES 201 108 standard, "Speech Processing, Transmission and Quality Aspects." The standard describes a distributed speech recognition system that overcomes the degradation of the performance of speech recognition systems receiving speech transmitted over mobile channels. Matching of the spectral resolution to the Mel- filtering resolution may be performed because Mel filters are typically used to analyze signals in ASR systems. In practice, the matching of the resolutions may mean a 512-point FFT is utilized.
[0034] At block 204, a DUT spectral profile may be extracted from the DUT signal by the extracting unit 1 16. The DUT spectral profile may be calculated in the same manner as the reference spectral profile. At block 206, the reference spectral profile and the DUT spectral profile may be compared by the comparing unit 1 18.
[0035] At block 208, the delta between the reference spectral profile and the DUT spectral profile may be calculated by the delta calculating unit 120. The delta may be defined as:
D(f) = PREF(f) / PDUT(f) where
f - frequency
REF(f) - reference spectral profile on linear scale
PDU"r(f) - DUT spectral profile on linear scale
[0036] At block 210, D(f) may be used as a reference to design the correction filter. This may be accomplished by the design unit 1 22. For example, the correction filter may be designed using a frequency-sampling design method and implemented as a finite impulse response filter or the correction filter may be designed by any other suitable method. It may be possible to construct different correction filters for the different situations simulated during recording of the speech utterance by the DUT. For example, one recording may have occurred with the DUT in landscape mode and the speaker 3 feet away from the DUT at an angle of 45° to the DUT. In that case, Ρουτ( ) may be extracted from the recordings made for that particular set of circumstances. Hence, D(f) and the resulting correction filter may be specific to that situation.
[0037] At block 212, the correction filter may be applied to the signal produced by the microphone internal to the DUT. For example, the correction filter may be applied to the microphone's signal in real time by adding a filtering block to the preprocessing (up-link) pipeline. Pipelines of this type are often used for audio stacks in notebook computers, tablet computers, mobile phones, smart phones, and the like.
[0038] Application of the correction filter to the DUT's microphone signal may include determining the orientation of the DUT, the distance of a user from the DUT, the angle between the user and the DUT, and the position of the DUT's lid. These determinations may be made to ascertain which correction filter is appropriate given the set of circumstances. In this manner, the correction filter that is applied may be derived from the recordings made under the same or similar circumstances.
[0039] Blocks 202-210 may be referred to as the tuning stage and may be performed by the manufacturer of the DUT. Block 21 2 may be performed when a user speaks into the DUT's microphone.
[0040] Fig. 3 is a block diagram showing a medium 300 that contains logic for obtaining a correction filter. The medium 300 may be a non-transitory computer- readable medium that stores code that can be accessed by a computer processing unit (CPU) 302 via a bus 304. For example, the computer-readable medium 300 can be a volatile or non-volatile data storage device. The medium 300 can also be a logic unit, such as an Application Specific Integrated Circuit (ASIC), a Field
Programmable Gate Array (FPGA), or an arrangement of logic gates implemented in one or more integrated circuits, for example.
[0041] The medium 300 may include modules 306-312 configured to perform the techniques described herein. For example, a spectral profile extractor 306 may be configured to extract a reference spectral profile from a reference signal and a DUT spectral profile from a DUT signal. A spectral profile comparator 308 may be configured to compare the reference spectral profile and the DUT spectral profile. A delta calculator 310 may be configured to calculate a delta between the reference spectral profile and the DUT spectral profile. A correction filter designer 312 may be configured to design the correction filter using the computed delta. In some embodiments, the modules 306-312 may be modules of computer code configured to direct the operations of the processor 302.
[0042] The block diagram of Fig. 3 is not intended to indicate that the medium 300 is to include all of the components shown in Fig. 3. Further, the medium 300 may include any number of additional components not shown in Fig. 3, depending on the details of the specific implementation.
[0043] Fig. 4A is an example according to the present techniques. A notebook computer running an exemplary ASR engine was used to evaluate the accuracy of speech recognition. A set of high quality recordings was identified by their high ASR scores, i.e., low word error rates (WERs). The high quality recordings were used to compute the reference spectral profile shown in FIG. 4A. The DUT spectral profile is shown in Fig. 4B. Fig. 4C shows the DUT spectral profile after application of the correction filter. In Figs. 4A-4C, the x-axes 402A, 402B, and 402C are frequency in
Hertz and the y-axes 404A, 404B, and 404C are amplitude on a linear scale. Fig. 4D is the magnitude response of the correction filter calculated by techniques described herein. In Fig. 4D, the x-axis is frequency in Hertz and the y-axis is amplitude.
[0044] Figs. 4E and 4F show the ASR accuracy improvements obtained when the correction filter was applied to speech signals. The speech signals were generated by broadcasting speech recordings over a main loudspeaker external to the DUT. The data shown in Fig. 4E was obtained in the absence of an additional loudspeaker. In contrast, Fig. 4F shows the results obtained in the presence of an additional side loudspeaker simulating a second user and masking the speech signals propagated by the main loudspeaker. The speech signals were obtained with the main loudspeaker positioned at different angles to the DUT. (At 0° the main loudspeaker is directly in front of the DUT.) In tables 400E and 400F, the angles are given in columns 402E and 402F. Scores are given as WERs 404E and 404F, thus lower values are better. Rows 406E and 406F give the WERs without the application of the correction filter. Rows 408E and 408F show the WERs with application of the correction filter designed by techniques described herein. Rows 410E and 41 OF give the delta values used to design the correction filter. Column 412E and 412F are the mean values for the rows 406E, 406F, 408E, 408F, 410E, and 41 OF.
[0045] Example 1 is an electronic device for improving speech recognition of a device under test (DUT). The electronic device includes an extracting unit to extract a reference spectral profile from a reference signal and a DUT spectral profile from a DUT signal; a comparing unit to compare the reference spectral profile and the DUT spectral profile; a delta calculating unit to compute a delta between the reference spectral profile and the DUT spectral profile to obtain a computed delta; and a design unit to design a correction filter based on the computed delta.
[0046] Example 2 includes the electronic device of example 1 , including or excluding optional features. In this example, the electronic device includes a first calculating unit to calculate the reference signal from a set of recordings.
[0047] Example 3 includes the electronic device of any one of examples 1 to 2, including or excluding optional features. In this example, the design unit designs the
correction filter using a plurality of recordings, and wherein the plurality of recordings are obtained from one or more devices.
[0048] Example 4 includes the electronic device of any one of examples 1 to 3, including or excluding optional features. In this example, the electronic device includes an application unit to apply the correction filter to a microphone of the DUT. Optionally, the electronic device includes an orientation sensor to determine an orientation of the DUT and employ an appropriate correction filter. Optionally, the electronic device includes a proximity sensor to determine a distance from a user to the DUT and employ the appropriate correction filter. Optionally, the electronic device includes an angle sensor to determine an angle between the user and the DUT and employ the appropriate correction filter. Optionally, the electronic device includes a lid position sensor to determine a position of a lid of the DUT and employ the appropriate correction filter.
[0049] Example 5 includes the electronic device of any one of examples 1 to 4, including or excluding optional features. In this example, the electronic device includes one or more microphones to receive the DUT signal. Optionally, the electronic device includes a recording unit to record the DUT signal.
[0050] Example 6 is a method of improving speech recognition of a device under test (DUT). The method includes extracting a reference spectral profile from a reference signal; extracting a DUT spectral profile from a DUT signal; comparing the reference spectral profile and DUT spectral profile; calculating a delta between the reference spectral profile and the DUT spectral profile; and designing a correction filter using the delta.
[0051] Example 7 includes the method of example 6, including or excluding optional features. In this example, the method includes using a set of speech recordings to calculate a reference signal. Optionally, the method includes averaging of amplitude spectra of the reference signal to obtain the reference spectral profile.
[0052] Example 8 includes the method of any one of examples 6 to 7, including or excluding optional features. In this example, the method includes recording a speech utterance using the DUT to obtain a recorded speech utterance. Optionally, the method includes broadcasting the recorded speech utterance using a speaker to
obtain a broadcasted speech utterance; and receiving the broadcasted speech utterance using a microphone internal to the DUT to obtain a DUT signal. Optionally, broadcasting the recorded speech utterance comprises using a speaker external to the DUT. Optionally, broadcasting the recorded speech utterance comprises using a speaker internal to the DUT. Optionally, the method includes averaging of amplitude spectra of the DUT signal to obtain the DUT spectral profile.
[0053] Example 9 includes the method of any one of examples 6 to 8, including or excluding optional features. In this example, the method includes calculating the correction filter using a frequency-sampling method or any other technique for designing an audio signal filter.
[0054] Example 10 includes the method of any one of examples 6 to 9, including or excluding optional features. In this example, the method includes applying the correction filter to a signal produced by the microphone internal to the DUT. Optionally, applying the correction filter comprises determining at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT.
[0055] Example 1 1 is a computer-readable medium, comprising instructions that, when executed by the processor, direct the processor to improve speech recognition of a device under test (DUT). The computer-readable medium includes instructions that direct the processor to extract a reference spectral profile from a reference signal; extract a DUT spectral profile from a DUT signal; compare the reference spectral profile and the DUT spectral profile; calculate a delta between the reference spectral profile and the DUT spectral profile; and design a correction filter using the delta.
[0056] Example 12 includes the computer-readable medium of example 1 1 , including or excluding optional features. In this example, the computer-readable medium includes instructions to direct the processor to calculate the reference signal from a set of speech recordings. Optionally, the computer-readable medium includes instructions to direct the processor to average amplitude spectra of the reference signal to obtain the reference spectral profile.
[0057] Example 13 includes the computer-readable medium of any one of examples 1 1 to 12, including or excluding optional features. In this example, the
computer-readable medium includes instructions to direct the processor to receive a speech utterance via a microphone to obtain the DUT signal. Optionally, the computer-readable medium includes instructions to direct the processor to average amplitude spectra of the DUT signal to obtain the DUT spectral profile.
[0058] Example 14 includes the computer-readable medium of any one of examples 1 1 to 13, including or excluding optional features. In this example, the computer-readable medium includes instructions to direct the processor to apply the correction filter to a signal produced by the microphone. Optionally, the computer- readable medium includes instructions to determine at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT when applying the correction filter.
[0059] Example 15 includes the computer-readable medium of any one of examples 1 1 to 14, including or excluding optional features. In this example, the computer-readable medium includes instructions to calculate the correction filter using a frequency-sampling method or any other technique for designing an audio signal filter.
[0060] Example 16 is an apparatus for improving speech recognition of a device under test (DUT). The apparatus includes instructions that direct the processor to a means for extracting a spectral profile, wherein the means for extracting a spectral profile extracts a reference spectral profile from a reference signal and a DUT spectral profile from a DUT signal; a means for comparing the reference spectral profile and the DUT spectral profile; a means for calculating a delta between the reference spectral profile and the DUT spectral profile; and a means for designing a correction filter using the delta.
[0061] Example 17 includes the apparatus of example 1 6, including or excluding optional features. In this example, the apparatus includes a means for calculating the reference signal from a set of speech recordings.
[0062] Example 18 includes the apparatus of any one of examples 1 6 to 17, including or excluding optional features. In this example, the means for extracting a spectral profile averages amplitude spectra of the reference signal to obtain the reference spectral profile.
[0063] Example 19 includes the apparatus of any one of examples 1 6 to 18, including or excluding optional features. In this example, the apparatus includes a means for recording a speech utterance to obtain a recorded speech utterance. Optionally, the apparatus includes a means for broadcasting the recorded speech utterance to obtain a broadcasted speech utterance; and a means for receiving the broadcasted speech utterance to obtain a DUT signal. Optionally, the means for broadcasting the recorded speech utterance is a speaker external to the DUT.
Optionally, the means for broadcasting the recorded speech utterance is a speaker internal to the DUT. Optionally, the means for receiving the broadcasted speech utterance is a microphone internal to the DUT.
[0064] Example 20 includes the apparatus of any one of examples 1 6 to 19, including or excluding optional features. In this example, the means for extracting a spectral profile averages amplitude spectra of the DUT signal to obtain the DUT spectral profile.
[0065] Example 21 includes the apparatus of any one of examples 1 6 to 20, including or excluding optional features. In this example, the apparatus includes a means for calculating the correction filter, wherein the means for calculating the correction filter is a frequency-sampling method or any other technique for designing an audio signal filter.
[0066] Example 22 includes the apparatus of any one of examples 1 6 to 21 , including or excluding optional features. In this example, the apparatus includes a means for applying the correction filter to a signal produced by the microphone internal to the DUT. Optionally, the apparatus includes a means for applying the correction filter, wherein the means for applying the correction filter determines at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT.
[0067] Example 23 is a notebook computer with improved speech recognition. The notebook computer with improved speech recognition includes instructions that direct the processor to an extracting unit to extract a reference spectral profile from a reference signal and a notebook computer spectral profile from a notebook computer signal; a comparing unit to compare the reference spectral profile and the notebook computer spectral profile; a delta calculating unit to compute a delta between the
reference spectral profile and the notebook computer spectral profile to obtain a computed delta; and a design unit to design a correction filter based on the computed delta.
[0068] Example 24 includes the notebook computer with improved speech recognition of example 23, including or excluding optional features. In this example, the notebook computer with improved speech recognition includes a first calculating unit to calculate the reference signal from a set of recordings.
[0069] Example 25 includes the notebook computer with improved speech recognition of any one of examples 23 to 24, including or excluding optional features. In this example, the design unit designs the correction filter using a plurality of recordings, and wherein the plurality of recordings are obtained from one or more devices.
[0070] Example 26 includes the notebook computer with improved speech recognition of any one of examples 23 to 25, including or excluding optional features. In this example, the notebook computer with improved speech recognition includes an application unit to apply the correction filter to a microphone of the notebook computer. Optionally, the notebook computer with improved speech recognition includes an orientation sensor to determine an orientation of the notebook computer and employ an appropriate correction filter. Optionally, the notebook computer with improved speech recognition includes a proximity sensor to determine a distance from a user to the notebook computer and employ the appropriate correction filter. Optionally, the notebook computer with improved speech recognition includes an angle sensor to determine an angle between the user and the notebook computer and employ the appropriate correction filter. Optionally, the notebook computer with improved speech recognition includes a lid position sensor to determine a position of a lid of the notebook computer and employ the appropriate correction filter.
[0071] Example 27 includes the notebook computer with improved speech recognition of any one of examples 23 to 26, including or excluding optional features. In this example, the notebook computer with improved speech recognition includes one or more microphones to receive the notebook computer signal. Optionally, the notebook computer with improved speech recognition includes a recording unit to record the notebook computer signal.
[0072] Some embodiments may be implemented in one or a combination of hardware, firmware, and software. Some embodiments may also be implemented as instructions stored on the tangible, non-transitory, machine-readable medium, which may be read and executed by a computing platform to perform the operations described. In addition, a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine, e.g., a computer. For example, a machine-readable medium may include read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; or electrical, optical, acoustical or other form of propagated signals, e.g., carrier waves, infrared signals, digital signals, or the interfaces that transmit and/or receive signals, among others.
[0073] An embodiment is an implementation or example. Reference in the specification to "an embodiment," "one embodiment," "some embodiments," "various embodiments," or "other embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiments is included in at least some embodiments, but not necessarily all embodiments, of the present techniques. The various appearances of "an embodiment," "one embodiment," or "some embodiments" are not necessarily all referring to the same embodiments.
[0074] Not all components, features, structures, characteristics, etc. described and illustrated herein need be included in a particular embodiment or embodiments. If the specification states a component, feature, structure, or characteristic "may", "might", "can" or "could" be included, for example, that particular component, feature, structure, or characteristic is not required to be included. If the specification or claim refers to "a" or "an" element, that does not mean there is only one of the element. If the specification or claims refer to "an additional" element, that does not preclude there being more than one of the additional element.
[0075] It is to be noted that, although some embodiments have been described in reference to particular implementations, other implementations are possible according to some embodiments. Additionally, the arrangement and/or order of circuit elements or other features illustrated in the drawings and/or described herein need not be arranged in the particular way illustrated and described. Many other arrangements are possible according to some embodiments.
[0076] In each system shown in a figure, the elements in some cases may each have a same reference number or a different reference number to suggest that the elements represented could be different and/or similar. However, an element may be flexible enough to have different implementations and work with some or all of the systems shown or described herein. The various elements shown in the figures may be the same or different. Which one is referred to as a first element and which is called a second element is arbitrary.
[0077] It is to be understood that specifics in the aforementioned examples may be used anywhere in one or more embodiments. For instance, all optional features of the computing device described above may also be implemented with respect to either of the method or the computer-readable medium described herein.
Furthermore, although flow diagrams and/or state diagrams may have been used herein to describe embodiments, the techniques are not limited to those diagrams or to corresponding descriptions herein. For example, flow need not move through each illustrated box or state or in exactly the same order as illustrated and described herein.
[0078] The present techniques are not restricted to the particular details listed herein. Indeed, those skilled in the art having the benefit of this disclosure will appreciate that many other variations from the foregoing description and drawings may be made within the scope of the present techniques. Accordingly, it is the following claims including any amendments thereto that define the scope of the present techniques.
Claims
1 . An electronic device for improving speech recognition of a device under test (DUT), comprising:
an extracting unit to extract a reference spectral profile from a reference
signal and a DUT spectral profile from a DUT signal;
a comparing unit to compare the reference spectral profile and the DUT
spectral profile;
a delta calculating unit to compute a delta between the reference spectral profile and the DUT spectral profile to obtain a computed delta; and a design unit to design a correction filter based on the computed delta.
2. The electronic device of claim 1 , comprising a first calculating unit to calculate the reference signal from a set of recordings.
3. The electronic device of claim 1 , wherein the design unit designs the correction filter using a plurality of recordings, and wherein the plurality of recordings are obtained from one or more devices.
4. The electronic device of any one of claims 1 to 3, comprising an application unit to apply the correction filter to a microphone of the DUT.
5. The electronic device of claim 4, comprising an orientation sensor to determine an orientation of the DUT and employ an appropriate correction filter.
6. The electronic device of claim 4, comprising a proximity sensor to determine a distance from a user to the DUT and employ the appropriate correction filter.
7. The electronic device of claim 4, comprising an angle sensor to determine an angle between the user and the DUT and employ the appropriate correction filter.
8. The electronic device of claim 4, comprising a lid position sensor to determine a position of a lid of the DUT and employ the appropriate correction filter.
9. The electronic device of any one of claims 1 to 3, comprising one or more microphones to receive the DUT signal.
10. The electronic device of claim 9, comprising a recording unit to record the DUT signal.
1 1 . A method of improving speech recognition of a device under test (DUT), comprising:
extracting a reference spectral profile from a reference signal;
extracting a DUT spectral profile from a DUT signal;
comparing the reference spectral profile and DUT spectral profile;
calculating a delta between the reference spectral profile and the DUT
spectral profile; and
designing a correction filter using the delta.
12. The method of claim 1 1 , comprising calculating the correction filter using a frequency-sampling method or any other technique for designing an audio signal filter.
13. The method of claim 1 1 , comprising applying the correction filter to a signal produced by a microphone internal to the DUT.
14. The method of claim 13, wherein applying the correction filter comprises determining at least one of an orientation of the DUT, a distance from a
user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT.
15. A computer-readable medium, comprising instructions that, when executed by the processor, direct the processor to improve speech recognition of a device under test (DUT), the instructions to direct the processor to:
extract a reference spectral profile from a reference signal;
extract a DUT spectral profile from a DUT signal;
compare the reference spectral profile and the DUT spectral profile;
calculate a delta between the reference spectral profile and the DUT spectral profile; and
design a correction filter using the delta.
16. The computer-readable medium of claim 15, comprising instructions to direct the processor to apply the correction filter to a signal produced by a microphone internal to the DUT.
17. The computer-readable medium of claim 16, comprising instructions to determine at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT when applying the correction filter.
18. The computer-readable medium of claim 15, comprising instructions to calculate the correction filter using a frequency-sampling method or any other technique for designing an audio signal filter.
19. An apparatus for improving speech recognition of a device under test (DUT), comprising:
a means for extracting a spectral profile, wherein the means for extracting a spectral profile extracts a reference spectral profile from a reference signal and a DUT spectral profile from a DUT signal;
a means for comparing the reference spectral profile and the DUT spectral profile;
a means for calculating a delta between the reference spectral profile and the
DUT spectral profile; and
a means for designing a correction filter using the delta.
20. The apparatus of claim 19, comprising a means for calculating the correction filter, wherein the means for calculating the correction filter is a frequency- sampling method or any other technique for designing an audio signal filter.
21 . The apparatus of claim 19, comprising a means for applying the correction filter to a signal produced by a microphone internal to the DUT.
22. The apparatus of claim 21 , comprising a means for applying the correction filter, wherein the means for applying the correction filter determines at least one of an orientation of the DUT, a distance from a user to the DUT, an angle between the user and the DUT, and a position of a lid of the DUT.
23. A notebook computer with improved speech recognition, comprising: an extracting unit to extract a reference spectral profile from a reference
signal and a notebook computer spectral profile from a notebook computer signal;
a comparing unit to compare the reference spectral profile and the notebook computer spectral profile;
a delta calculating unit to compute a delta between the reference spectral profile and the notebook computer spectral profile to obtain a computed delta; and
a design unit to design a correction filter based on the computed delta.
24. The notebook computer of claim 23, wherein the design unit designs the correction filter using a plurality of recordings, and wherein the plurality of recordings are obtained from one or more devices.
25. The notebook computer of claims 23 or 24, comprising an application unit to apply the correction filter to a microphone of the notebook computer.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/757,884 US10165362B2 (en) | 2015-12-24 | 2015-12-24 | Automated equalization |
| US14/757,884 | 2015-12-24 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017112063A1 true WO2017112063A1 (en) | 2017-06-29 |
Family
ID=59086766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2016/057735 Ceased WO2017112063A1 (en) | 2015-12-24 | 2016-10-19 | Automated equalization |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US10165362B2 (en) |
| WO (1) | WO2017112063A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022115303A1 (en) | 2020-11-27 | 2022-06-02 | Dolby Laboratories Licensing Corporation | Automatic generation and selection of target profiles for dynamic equalization of audio content |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050086058A1 (en) * | 2000-03-03 | 2005-04-21 | Lemeson Medical, Education & Research | System and method for enhancing speech intelligibility for the hearing impaired |
| US20050185813A1 (en) * | 2004-02-24 | 2005-08-25 | Microsoft Corporation | Method and apparatus for multi-sensory speech enhancement on a mobile device |
| US20080288253A1 (en) * | 2007-05-18 | 2008-11-20 | Stmicroelectronics S.R.L. | Automatic speech recognition method and apparatus, using non-linear envelope detection of signal power spectra |
| US20100049516A1 (en) * | 2008-08-20 | 2010-02-25 | General Motors Corporation | Method of using microphone characteristics to optimize speech recognition performance |
| WO2010117711A1 (en) * | 2009-03-29 | 2010-10-14 | University Of Florida Research Foundation, Inc. | Systems and methods for tuning automatic speech recognition systems |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6377919B1 (en) * | 1996-02-06 | 2002-04-23 | The Regents Of The University Of California | System and method for characterizing voiced excitations of speech and acoustic signals, removing acoustic noise from speech, and synthesizing speech |
| US6353809B2 (en) * | 1997-06-06 | 2002-03-05 | Olympus Optical, Ltd. | Speech recognition with text generation from portions of voice data preselected by manual-input commands |
| US6993482B2 (en) * | 2002-12-18 | 2006-01-31 | Motorola, Inc. | Method and apparatus for displaying speech recognition results |
| US7142894B2 (en) * | 2003-05-30 | 2006-11-28 | Nokia Corporation | Mobile phone for voice adaptation in socially sensitive environment |
| US9271074B2 (en) * | 2005-09-02 | 2016-02-23 | Lsvt Global, Inc. | System and method for measuring sound |
| US8149279B2 (en) * | 2008-08-18 | 2012-04-03 | Apple Inc. | Apparatus and method for compensating for variations in digital cameras |
| US20120314086A1 (en) * | 2011-06-08 | 2012-12-13 | Apple Inc. | Camera test and calibration based on spectral monitoring of light |
| KR102658766B1 (en) | 2013-08-07 | 2024-04-18 | 스트리커 코포레이션 | System and method for driving an ultrasonic handpiece as a function of the mechanical impedance of the handpiece |
| CN106537771B (en) * | 2014-06-03 | 2019-05-21 | 英特尔公司 | Method, apparatus, apparatus and computer readable medium for automatic equalization of microphones |
-
2015
- 2015-12-24 US US14/757,884 patent/US10165362B2/en not_active Expired - Fee Related
-
2016
- 2016-10-19 WO PCT/US2016/057735 patent/WO2017112063A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050086058A1 (en) * | 2000-03-03 | 2005-04-21 | Lemeson Medical, Education & Research | System and method for enhancing speech intelligibility for the hearing impaired |
| US20050185813A1 (en) * | 2004-02-24 | 2005-08-25 | Microsoft Corporation | Method and apparatus for multi-sensory speech enhancement on a mobile device |
| US20080288253A1 (en) * | 2007-05-18 | 2008-11-20 | Stmicroelectronics S.R.L. | Automatic speech recognition method and apparatus, using non-linear envelope detection of signal power spectra |
| US20100049516A1 (en) * | 2008-08-20 | 2010-02-25 | General Motors Corporation | Method of using microphone characteristics to optimize speech recognition performance |
| WO2010117711A1 (en) * | 2009-03-29 | 2010-10-14 | University Of Florida Research Foundation, Inc. | Systems and methods for tuning automatic speech recognition systems |
Also Published As
| Publication number | Publication date |
|---|---|
| US20170188148A1 (en) | 2017-06-29 |
| US10165362B2 (en) | 2018-12-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7434137B2 (en) | Speech recognition method, device, equipment and computer readable storage medium | |
| US9640186B2 (en) | Deep scattering spectrum in acoustic modeling for speech recognition | |
| US20230116052A1 (en) | Array geometry agnostic multi-channel personalized speech enhancement | |
| US11043207B2 (en) | System and method for array data simulation and customized acoustic modeling for ambient ASR | |
| US20220343898A1 (en) | Speech recognition method and apparatus, and computer-readable storage medium | |
| US11289109B2 (en) | Systems and methods for audio signal processing using spectral-spatial mask estimation | |
| US10629184B2 (en) | Cepstral variance normalization for audio feature extraction | |
| US11832067B2 (en) | Open-loop multichannel audio impulse response measurement and capture path evaluation | |
| JP6272433B2 (en) | Method and apparatus for detecting pitch cycle accuracy | |
| CN109074814A (en) | A kind of noise detecting method and terminal device | |
| US20180033427A1 (en) | Speech recognition transformation system | |
| CN106098079B (en) | Method and device for extracting audio signal | |
| WO2015103973A1 (en) | Method and device for processing audio signals | |
| US20200202879A1 (en) | Denoising a signal | |
| WO2019232826A1 (en) | I-vector extraction method, speaker recognition method and apparatus, device, and medium | |
| CN113744762A (en) | Signal-to-noise ratio determining method and device, electronic equipment and storage medium | |
| US10165362B2 (en) | Automated equalization | |
| Loweimi et al. | Robust source-filter separation of speech signal in the phase domain | |
| US20210027778A1 (en) | Speech processing apparatus, method, and program | |
| CN107919115A (en) | A kind of feature compensation method based on nonlinear spectral conversion | |
| CN112151053B (en) | Speech enhancement method, system, electronic device and storage medium | |
| US10540990B2 (en) | Processing of speech signals | |
| CN118314919A (en) | Voice repair method, device, audio equipment and storage medium | |
| US20130223639A1 (en) | Signal processing device, signal processing method and signal processing program | |
| CN115130362A (en) | Array element position calibration method and system based on channel matching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16879566 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16879566 Country of ref document: EP Kind code of ref document: A1 |