US7577564B2 - Method and apparatus for detecting illicit activity by classifying whispered speech and normally phonated speech according to the relative energy content of formants and fricatives - Google Patents
Method and apparatus for detecting illicit activity by classifying whispered speech and normally phonated speech according to the relative energy content of formants and fricatives Download PDFInfo
- Publication number
- US7577564B2 US7577564B2 US10/378,513 US37851303A US7577564B2 US 7577564 B2 US7577564 B2 US 7577564B2 US 37851303 A US37851303 A US 37851303A US 7577564 B2 US7577564 B2 US 7577564B2
- Authority
- US
- United States
- Prior art keywords
- speech
- whispered
- magnitude
- phonated
- normally
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/93—Discriminating between voiced and unvoiced parts of speech signals
Definitions
- One object of the present invention is to provide a method and apparatus to differentiate between normally phonated speech and whispered speech.
- Another object of the present invention is to provide a method and apparatus that classifies speech as normal speech or otherwise.
- Yet another object of the present invention is to provide a method and apparatus that improves the performance of speech processors by reducing errors when such processors encounter whispered speech.
- the invention described herein provides a method and apparatus for the classification of speech signals. Speech is classified into two broad classes of speech production—whispered speech and normally phonated speech. Speech classified in this manner will yield increased performance of automated speech processing systems because the erroneous results that occur when typical automated speech processing systems encounter non-typical speech such as whispered speech, will be avoided.
- a method for classifying whispered and normally phonated speech comprising the steps of framing the input audio signal into data windows and advancing said windows; computing the magnitude of the data over a high frequency range; computing the magnitude of the data over a low frequency range; computing the ratio of the magnitude from the high frequency range to the magnitude from the low frequency range; and determining if the ratio is greater than 1.2; if said ratio is greater than 1.2, then labeling the audio signal as whispered speech, otherwise, labeling the audio signal as normally phonated speech.
- a method for classifying whispered and normally phonated speech further comprises the steps of framing 4.8 second windows and advancing at a rate of 2.4 seconds.
- a method for classifying whispered and normally phonated speech the step of computing the magnitude further comprises performing an N-point Discrete Fourier Transform that has starting and stopping points of 2800/(F s /N) and 3000/(F s /N) respectively, for the high frequency range and has starting and stopping points of 450/(F s /N) and 650/(F s /N) respectively, for the low frequency range, where F s is the sampling rate and N is the number of points in the N-point Discrete Fourier Transform.
- a related advantage stems from the fact that the present invention can extend and improve military and law enforcement endeavors to include the content of communications that may be whispered.
- Another advantage is the fact that the present invention may improve the quality of life for those handicapped persons who are in reliance of voice-activated technologies to compensate for their physical disabilities.
- FIG. 1A depicts a spectrogram for normal speech.
- FIG. 1B depicts a spectrogram for whispered speech.
- FIG. 2 depicts a block diagram for determining normal speech from whispered speech.
- FIG. 3 depicts test results for the classification of speech.
- FIG. 1A and FIG. 1B typical spectrograms for normal speech and whispered speech, respectively, for the same male speaker (8 kHz sampling rate) are shown. Note that for the normal speech, there is higher magnitude at the lower frequencies and more harmonic structure compared to the whispered speech. Whispered speech is consistently more noise-like with reduced signal in the low frequency regions because it is generally unvoiced (aperiodic) with restricted airflow.
- a frequency band is selected that is within the bandwidth of all voice communication systems and is broad enough to capture the speech magnitude independent of the speaker characteristics and the content of the conversation.
- a 450 to 650 Hz frequency band was selected.
- the 2800-3000 Hz band which is within the bandwidth of voice communication systems, was chosen.
- the method is depicted in FIG. 2 where a ratio of absolute magnitude in the high bands (2800-3000 Hz) to the magnitude in the low bands (450-650 Hz) is formed.
- a ratio of absolute magnitude in the high bands (2800-3000 Hz) to the magnitude in the low bands (450-650 Hz) is formed.
- the ratio would generally be below 1.0.
- whispered speech the signal in the high band is generally greater than the signal in the low band.
- the ratio would generally be greater than 1.0.
- a ratio of 1.2 was selected. When the magnitude ratio is 1.2 or below, the signal is classified as normally phonated speech. When the magnitude ratio is greater than 1.2, the signal is classified as whispered speech.
- Data is framed 100 into 4.8 second windows that advance at a rate of 2.4 seconds (50% overlap).
- the magnitude is then computed 110 in the 2800 Hz to 3000 Hz frequency range.
- the starting point is given by 2800/(Fs/N) and the stopping point is 3000/(Fs/N)
- the magnitude used for this technique is the average absolute magnitude of the frequency samples between 2800-3000 Hertz.
- the magnitude is then computed 120 in the 450 Hz to 650 Hz frequency range.
- the starting point is given by 450/(Fs/N) and the stopping point is 650/(Fs/N).
- the magnitude used for this technique is the average absolute magnitude of the frequency samples between 450-650 Hertz.
- the ratio of high frequency band magnitude to low frequency band magnitude is next computed 130 , where the audio signal is scored for classification. If the ratio for the window is less than or equal to 1.2, the audio signal for the window is labeled 140 normally phonated speech. If the audio signal is greater than 1.2, the audio signal for the window is labeled 140 whispered speech.
- 3 of the last 5 windows must be greater than 1.2 in order to classify a region of audio as whispered speech.
- the audio signal will continue to be labeled 140 as whispered speech as long as the ratio measurement 130 in 3 of the last 5 windows is greater than 1.2.
- test results are shown from computing the absolute magnitude ratio, the features are independent of signal level. Note that for this ratio method, the performance is extremely good for all SNRs (30 dB, 20 dB, 10 dB, and 5 dB). The mistakes that were made were in classifying whispered speech as normal speech. At no time was normal speech classified as whispered speech. That is, there were no whispered speech false alarms.
- test data consisted of telephone conversations between two people. In total, there were 20 male and 4 female speakers. The conversations were scripted and transitioned several times between speaking modes. For each conversation, there were five regions of either normal or whispered speech (normal-whispered-normal-whispered-normal). Thus, for each SNR level, there were a total of 60 regions (36 normal and 24 whispered regions) of interest for classification.
- the classifier did not produce any errors over the 240 test regions (60 regions ⁇ 4 different SNR levels) evaluated at SNRs of 5 dB, 10 dB, 20 dB and 30 dB.
Abstract
Method and apparatus for the classification of speech signals. Speech is classified into two broad classes of speech production—whispered speech and normally phonated speech. Speech classified in this manner will yield increased performance of automated speech processing systems because the erroneous results that occur when typical automated speech processing systems encounter non-typical speech such as whispered speech, will be avoided.
Description
The invention described herein may be manufactured and used by or for the Government for governmental purposes without the payment of any royalty thereon.
There exists a need to differentiate between normally phonated and whispered speech. To that end, literature searches have uncovered several articles on whispered speech detection. However, very little research has been conducted to classify or quantify whispered speech. Only two sources of work in this area are known and that work was conducted by Jovicic [1] and Wilson [2]. They observed that normally phonated and whispered speech exhibit differences in formant characteristics. These studies, in which Serbian and English vowels were used, show that there is an increase in formant frequency F1 for whispered speech for both male and female speakers. These studies also revealed a general expansion of formant bandwidths for whispered vowels as compared to voiced vowels. The results by Jovicic [1], which were computed using digitized speech data from five male and five female native Serbian speakers, show formant bandwidth increases over voice vowels for all five whispered vowels. However, the results by Wilson [2], which were computed using speech data from five male and five female Native American English speakers, show that the formant bandwidths are not consistently larger for whispered vowels. Therefore, developing a recognition process that solely relies on formant bandwidth would not appear to provide good results. In addition to the above work, Wilson [2] also showed that the amplitude for the first formant F1 was consistently lower in amplitude for whispered speech.
Although the results of this prior work clearly point out some differences between normally phonated and whispered speech, there has been no attempt to automatically distinguish between normally phonated and whispered speech.
- [1] Jovicic, S. T., “Formant Feature Difference Between Whispered and Voice Sustained Vowels,” Acoustica, Vol. 84, 1998, pp. 739-743.
- [2] Wilson, J. B., “A Comparative Analysis of Whispered and Normally Phonated Speech Using An LPC-10 Vocoder”, RADC Final Report TR-85-264.
One object of the present invention is to provide a method and apparatus to differentiate between normally phonated speech and whispered speech.
Another object of the present invention is to provide a method and apparatus that classifies speech as normal speech or otherwise.
Yet another object of the present invention is to provide a method and apparatus that improves the performance of speech processors by reducing errors when such processors encounter whispered speech.
The invention described herein provides a method and apparatus for the classification of speech signals. Speech is classified into two broad classes of speech production—whispered speech and normally phonated speech. Speech classified in this manner will yield increased performance of automated speech processing systems because the erroneous results that occur when typical automated speech processing systems encounter non-typical speech such as whispered speech, will be avoided.
According to an embodiment of the present invention, a method for classifying whispered and normally phonated speech, comprising the steps of framing the input audio signal into data windows and advancing said windows; computing the magnitude of the data over a high frequency range; computing the magnitude of the data over a low frequency range; computing the ratio of the magnitude from the high frequency range to the magnitude from the low frequency range; and determining if the ratio is greater than 1.2; if said ratio is greater than 1.2, then labeling the audio signal as whispered speech, otherwise, labeling the audio signal as normally phonated speech.
According to the same embodiment of the present invention, a method for classifying whispered and normally phonated speech, further comprises the steps of framing 4.8 second windows and advancing at a rate of 2.4 seconds.
According to the same embodiment of the present invention, a method for classifying whispered and normally phonated speech, the step of computing the magnitude further comprises performing an N-point Discrete Fourier Transform that has starting and stopping points of 2800/(Fs/N) and 3000/(Fs/N) respectively, for the high frequency range and has starting and stopping points of 450/(Fs/N) and 650/(Fs/N) respectively, for the low frequency range, where Fs is the sampling rate and N is the number of points in the N-point Discrete Fourier Transform.
Advantages and New Features
There are several advantages attributable to the present invention relative to prior art. An important advantage is the fact that the present invention provides performance improvement for conventional speech processors which would otherwise generate errors in speech detection when non-normally phonated speech is encountered.
A related advantage stems from the fact that the present invention can extend and improve military and law enforcement endeavors to include the content of communications that may be whispered.
Another advantage is the fact that the present invention may improve the quality of life for those handicapped persons who are in reliance of voice-activated technologies to compensate for their physical disabilities.
The application of these aforementioned differences in recognizing normal phonated speech from whispered speech in conversation presents several problems. One of the largest of these problems is the lack of reliable or stationary reference values for using these feature differences. If one attempts to exploit the formant frequency and amplitude differences of F1, it is found that these shifts can be masked by the shifts caused by different speakers, conversation content and widely varying amplitude levels between speakers, and/or different audio sources. Therefore, an analysis on the speech signals was conducted to look for reliable features and a measurement method that could be used on conversational normal and whisper speech, independent of the above sources of shift.
Referring to FIG. 1A and FIG. 1B typical spectrograms for normal speech and whispered speech, respectively, for the same male speaker (8 kHz sampling rate) are shown. Note that for the normal speech, there is higher magnitude at the lower frequencies and more harmonic structure compared to the whispered speech. Whispered speech is consistently more noise-like with reduced signal in the low frequency regions because it is generally unvoiced (aperiodic) with restricted airflow.
Further examination of spectrograms like these shows that whispered speech signals have magnitudes much lower than normal speech in the frequency region below 800 Hz. However, using the whole 800 Hz band could produce erratic results. For instance, in telephone speech, where the voice response of the system could drop off rapidly below 300 Hz, there could be little difference in signal magnitude in the 0-800 Hz band between whispered conversation and normal speech conversation. This is because the magnitude below the 300 Hz voice cutoff frequency is predominantly noise (usually 60 Hz power line hum components). When measurements are made over the whole 0-800 Hz band, the noise signal can dominate the band for whispered speech signals to a degree that prevents classification. To eliminate this problem, a frequency band is selected that is within the bandwidth of all voice communication systems and is broad enough to capture the speech magnitude independent of the speaker characteristics and the content of the conversation. Through observation, a 450 to 650 Hz frequency band was selected. However, in order to capitalize on the difference in signal magnitude between whispered and normal speech in the 450-650 Hz band, it is necessary to establish some relative measure of the strength of the signal. Since both normal and whispered speech have high frequency components, a band that could represent the high frequency signal level so that we could form a ratio of high frequency to low frequency magnitude and thus normalize the measurement, is preferred. Through observations of both normal and whispered speech spectrograms, the 2800-3000 Hz band, which is within the bandwidth of voice communication systems, was chosen. The method is depicted in FIG. 2 where a ratio of absolute magnitude in the high bands (2800-3000 Hz) to the magnitude in the low bands (450-650 Hz) is formed. For normal speech, there is a significant amount of signal in the low band. Thus, the ratio would generally be below 1.0. For whispered speech, the signal in the high band is generally greater than the signal in the low band. Thus, the ratio would generally be greater than 1.0. Through threshold experimentation, a ratio of 1.2 was selected. When the magnitude ratio is 1.2 or below, the signal is classified as normally phonated speech. When the magnitude ratio is greater than 1.2, the signal is classified as whispered speech.
Referring to FIG. 2 , description of the block diagram follows. Data is framed 100 into 4.8 second windows that advance at a rate of 2.4 seconds (50% overlap). The magnitude is then computed 110 in the 2800 Hz to 3000 Hz frequency range. For a sampling rate of Fs and an N-point Discrete Fourier Transform, the starting point is given by 2800/(Fs/N) and the stopping point is 3000/(Fs/N) The magnitude used for this technique is the average absolute magnitude of the frequency samples between 2800-3000 Hertz. The magnitude is then computed 120 in the 450 Hz to 650 Hz frequency range. For a sampling rate of Fs and an N-point Discrete Fourier Transform, the starting point is given by 450/(Fs/N) and the stopping point is 650/(Fs/N). The magnitude used for this technique is the average absolute magnitude of the frequency samples between 450-650 Hertz. The ratio of high frequency band magnitude to low frequency band magnitude is next computed 130, where the audio signal is scored for classification. If the ratio for the window is less than or equal to 1.2, the audio signal for the window is labeled 140 normally phonated speech. If the audio signal is greater than 1.2, the audio signal for the window is labeled 140 whispered speech. Since unvoiced speech can have characteristics similar to whispered speech, 3 of the last 5 windows must be greater than 1.2 in order to classify a region of audio as whispered speech. The audio signal will continue to be labeled 140 as whispered speech as long as the ratio measurement 130 in 3 of the last 5 windows is greater than 1.2.
Referring to FIG. 3 , test results are shown from computing the absolute magnitude ratio, the features are independent of signal level. Note that for this ratio method, the performance is extremely good for all SNRs (30 dB, 20 dB, 10 dB, and 5 dB). The mistakes that were made were in classifying whispered speech as normal speech. At no time was normal speech classified as whispered speech. That is, there were no whispered speech false alarms.
The test data consisted of telephone conversations between two people. In total, there were 20 male and 4 female speakers. The conversations were scripted and transitioned several times between speaking modes. For each conversation, there were five regions of either normal or whispered speech (normal-whispered-normal-whispered-normal). Thus, for each SNR level, there were a total of 60 regions (36 normal and 24 whispered regions) of interest for classification.
An examination of the whispered audio data that produced the errors found that these so called whispered regions were not whispered, but were instead softly spoken pronated speech. During data collection, speakers were instructed to whisper during parts of the conversation and to speak normal in other parts of the conversation. However, some speakers spoke the marked whispered regions in a reduced volume, using pronated speech rather than whispered speech as marked. These low volume regions were detected as normal speech by the algorithm instead of whispered speech. In the true definition of whispered speech, that is, speech produced without pronation (vibrating the vocal cords), the classifier did not produce any errors over the 240 test regions (60 regions×4 different SNR levels) evaluated at SNRs of 5 dB, 10 dB, 20 dB and 30 dB.
While the preferred embodiments have been described and illustrated, it should be understood that various substitutions, equivalents, adaptations and modifications of the invention may be made thereto by those skilled in the art without departing from the spirit and scope of the invention. Accordingly, it is to be understood that the present invention has been described by way of illustration and not limitation.
Claims (2)
1. Method for detecting illicit activity comprising:
classifying whispered and normally phonated speech by determining the relative amounts of fricative and formant energy in each of two separate bandwidth samples of said speech wherein
said step of determining further comprising the steps of:
framing an input audio signal into 4.8 second data windows and advancing said windows at a rate of 2.4 seconds;
computing the magnitude of said data over a high frequency range from 2800 hertz to 3000 hertz;
computing the magnitude of said data over a low frequency range from 450 hertz to 650 hertz;
computing the ratio of the said magnitude from said high frequency range to the said magnitude from said low frequency range by performing an N-point Discrete Fourier Transform; and
determining if said ratio is greater than 1.2;
IF said ratio is greater than 1.2, THEN
labeling said audio signal as whispered speech; and
categorizing the activity as illicit;
OTHERWISE,
labeling said audio signal as normally phonated speech; and
categorizing the activity as non-illicit.
2. Apparatus for detecting illicit activity comprising:
means for classifying whispered and normally phonated speech; by determining the relative amounts of fricative and formant energy in each of two separate bandwidth samples of said speech, wherein
said means for determining further comprising:
means for framing an input audio signal into 4.8 second data windows and advancing said windows at a rate of 2.4 seconds;
means for computing the magnitude of said data over a high frequency range from 2800 hertz to 3000 hertz;
means for computing the magnitude of said data over a low frequency range from 450 hertz to 650 hertz;
means for computing the ratio of the said magnitude from said high frequency range to the said magnitude from said low frequency range by performing an N-point Discrete Fourier Transform; and
means for determining if said ratio is greater than 1.2; where
IF said ratio is greater than 1.2, THEN
means for labeling audio signal as whispered speech; and
means for categorizing the activity as illicit;
OTHERWISE,
means for labeling audio signal normally phonated speech; and
means for categorizing the activity as non-illicit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/378,513 US7577564B2 (en) | 2003-03-03 | 2003-03-03 | Method and apparatus for detecting illicit activity by classifying whispered speech and normally phonated speech according to the relative energy content of formants and fricatives |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/378,513 US7577564B2 (en) | 2003-03-03 | 2003-03-03 | Method and apparatus for detecting illicit activity by classifying whispered speech and normally phonated speech according to the relative energy content of formants and fricatives |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20040176949A1 US20040176949A1 (en) | 2004-09-09 |
| US7577564B2 true US7577564B2 (en) | 2009-08-18 |
Family
ID=32926508
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US10/378,513 Active 2025-08-05 US7577564B2 (en) | 2003-03-03 | 2003-03-03 | Method and apparatus for detecting illicit activity by classifying whispered speech and normally phonated speech according to the relative energy content of formants and fricatives |
Country Status (1)
| Country | Link |
|---|---|
| US (1) | US7577564B2 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090083038A1 (en) * | 2007-09-21 | 2009-03-26 | Kazunori Imoto | Mobile radio terminal, speech conversion method and program for the same |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9196254B1 (en) * | 2009-07-02 | 2015-11-24 | Alon Konchitsky | Method for implementing quality control for one or more components of an audio signal received from a communication device |
| US9196249B1 (en) * | 2009-07-02 | 2015-11-24 | Alon Konchitsky | Method for identifying speech and music components of an analyzed audio signal |
| US9026440B1 (en) * | 2009-07-02 | 2015-05-05 | Alon Konchitsky | Method for identifying speech and music components of a sound signal |
| US8849663B2 (en) | 2011-03-21 | 2014-09-30 | The Intellisis Corporation | Systems and methods for segmenting and/or classifying an audio signal from transformed audio information |
| US9142220B2 (en) | 2011-03-25 | 2015-09-22 | The Intellisis Corporation | Systems and methods for reconstructing an audio signal from transformed audio information |
| US8548803B2 (en) | 2011-08-08 | 2013-10-01 | The Intellisis Corporation | System and method of processing a sound signal including transforming the sound signal into a frequency-chirp domain |
| US8620646B2 (en) | 2011-08-08 | 2013-12-31 | The Intellisis Corporation | System and method for tracking sound pitch across an audio signal using harmonic envelope |
| US9183850B2 (en) | 2011-08-08 | 2015-11-10 | The Intellisis Corporation | System and method for tracking sound pitch across an audio signal |
| US9058820B1 (en) | 2013-05-21 | 2015-06-16 | The Intellisis Corporation | Identifying speech portions of a sound model using various statistics thereof |
| US9484044B1 (en) | 2013-07-17 | 2016-11-01 | Knuedge Incorporated | Voice enhancement and/or speech features extraction on noisy audio signals using successively refined transforms |
| US9530434B1 (en) | 2013-07-18 | 2016-12-27 | Knuedge Incorporated | Reducing octave errors during pitch determination for noisy audio signals |
| US9208794B1 (en) | 2013-08-07 | 2015-12-08 | The Intellisis Corporation | Providing sound models of an input signal using continuous and/or linear fitting |
| US9922668B2 (en) | 2015-02-06 | 2018-03-20 | Knuedge Incorporated | Estimating fractional chirp rate with multiple frequency representations |
| US9870785B2 (en) | 2015-02-06 | 2018-01-16 | Knuedge Incorporated | Determining features of harmonic signals |
| US9842611B2 (en) | 2015-02-06 | 2017-12-12 | Knuedge Incorporated | Estimating pitch using peak-to-peak distances |
| CN110223711B (en) * | 2019-06-03 | 2021-06-01 | 清华大学 | Microphone signal based voice interaction wake-up electronic device, method, and medium |
| US11501758B2 (en) | 2019-09-27 | 2022-11-15 | Apple Inc. | Environment aware voice-assistant devices, and related systems and methods |
| US11610596B2 (en) * | 2020-09-17 | 2023-03-21 | Airoha Technology Corp. | Adjustment method of sound output and electronic device performing the same |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5197113A (en) * | 1989-05-15 | 1993-03-23 | Alcatel N.V. | Method of and arrangement for distinguishing between voiced and unvoiced speech elements |
| US5924066A (en) * | 1997-09-26 | 1999-07-13 | U S West, Inc. | System and method for classifying a speech signal |
| US7065485B1 (en) * | 2002-01-09 | 2006-06-20 | At&T Corp | Enhancing speech intelligibility using variable-rate time-scale modification |
-
2003
- 2003-03-03 US US10/378,513 patent/US7577564B2/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5197113A (en) * | 1989-05-15 | 1993-03-23 | Alcatel N.V. | Method of and arrangement for distinguishing between voiced and unvoiced speech elements |
| US5924066A (en) * | 1997-09-26 | 1999-07-13 | U S West, Inc. | System and method for classifying a speech signal |
| US7065485B1 (en) * | 2002-01-09 | 2006-06-20 | At&T Corp | Enhancing speech intelligibility using variable-rate time-scale modification |
Non-Patent Citations (2)
| Title |
|---|
| J.B. Wilson and J. D. Masko "A Comparative Analysis of Whispered and Normally Phonated Speeh Using an LPC-10 Vocoder", RADC Final Report TR-85-264. * |
| Mahesh L. Chugani, Abhay R. Samant, and Michael Cerna, "LabVIEW Signal Processing" 1998 Prentice Hall PRT, ISBN 0-13-972449-4. * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090083038A1 (en) * | 2007-09-21 | 2009-03-26 | Kazunori Imoto | Mobile radio terminal, speech conversion method and program for the same |
| US8209167B2 (en) * | 2007-09-21 | 2012-06-26 | Kabushiki Kaisha Toshiba | Mobile radio terminal, speech conversion method and program for the same |
Also Published As
| Publication number | Publication date |
|---|---|
| US20040176949A1 (en) | 2004-09-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7577564B2 (en) | Method and apparatus for detecting illicit activity by classifying whispered speech and normally phonated speech according to the relative energy content of formants and fricatives | |
| Kingsbury et al. | Robust speech recognition using the modulation spectrogram | |
| EP1083541B1 (en) | A method and apparatus for speech detection | |
| EP2482277B1 (en) | Method for identifying a speaker using formant equalization | |
| Niyogi et al. | Detecting stop consonants in continuous speech | |
| US7359856B2 (en) | Speech detection system in an audio signal in noisy surrounding | |
| CA2492204A1 (en) | Similar speaking recognition method and system using linear and nonlinear feature extraction | |
| Ali et al. | An acoustic-phonetic feature-based system for automatic phoneme recognition in continuous speech | |
| CN113192535B (en) | Voice keyword retrieval method, system and electronic device | |
| Edwards | Multiple features analysis of intervocalic English plosives | |
| Barker et al. | Speech fragment decoding techniques for simultaneous speaker identification and speech recognition | |
| Wenndt et al. | A study on the classification of whispered and normally phonated speech | |
| Godoy et al. | Unsupervised Acoustic Analyses of Normal and Lombard Speech, with Spectral Envelope Transformation to Improve Intelligibility. | |
| US6470311B1 (en) | Method and apparatus for determining pitch synchronous frames | |
| US8788265B2 (en) | System and method for babble noise detection | |
| CN116230018A (en) | Synthetic voice quality evaluation method for voice synthesis system | |
| Harsha | A noise robust speech activity detection algorithm | |
| Sudhakar et al. | Automatic speech segmentation to improve speech synthesis performance | |
| Seitz et al. | Relational spectral features for place of articulation in nasal consonants | |
| Osanai et al. | Exploring sub-band cepstral distances for more robust speaker classification | |
| Hahn et al. | An improved speech detection algorithm for isolated Korean utterances | |
| CN113611326B (en) | Real-time voice emotion recognition method and device | |
| Ozaydin | Design of a Voice Activity Detection Algorithm based on Logarithmic Signal Energy | |
| US20220366921A1 (en) | Hybrid expansive frequency compression for enhancing speech perception for individuals with high-frequency hearing loss | |
| Verteletskaya et al. | Pitch detection algorithms and voiced/unvoiced classification for noisy speech |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: THE UNITED STATES OF AMERICA AS REPRESENTED BY THE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WENNDT, STANLEY J.;CUPPLES, EDWARD J.;REEL/FRAME:022906/0986 Effective date: 20030303 |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| FPAY | Fee payment |
Year of fee payment: 4 |
|
| FPAY | Fee payment |
Year of fee payment: 8 |
|
| FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| FEPP | Fee payment procedure |
Free format text: 11.5 YR SURCHARGE- LATE PMT W/IN 6 MO, LARGE ENTITY (ORIGINAL EVENT CODE: M1556); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |