US20020010580A1 - Signal dependent method for bandwith savings in voice over packet networks - Google Patents
Signal dependent method for bandwith savings in voice over packet networks Download PDFInfo
- Publication number
- US20020010580A1 US20020010580A1 US09/249,108 US24910899A US2002010580A1 US 20020010580 A1 US20020010580 A1 US 20020010580A1 US 24910899 A US24910899 A US 24910899A US 2002010580 A1 US2002010580 A1 US 2002010580A1
- Authority
- US
- United States
- Prior art keywords
- signal
- noise
- threshold
- energy
- active
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000001419 dependent effect Effects 0.000 title abstract description 3
- 238000009499 grossing Methods 0.000 claims abstract description 19
- 230000003044 adaptive effect Effects 0.000 claims abstract description 18
- 239000013598 vector Substances 0.000 claims description 12
- 238000005070 sampling Methods 0.000 claims description 7
- 230000008859 change Effects 0.000 claims description 6
- 230000009467 reduction Effects 0.000 claims description 4
- 230000002596 correlated effect Effects 0.000 claims 2
- 239000003638 chemical reducing agent Substances 0.000 claims 1
- 230000006835 compression Effects 0.000 abstract description 11
- 238000007906 compression Methods 0.000 abstract description 11
- 230000003247 decreasing effect Effects 0.000 abstract 1
- 238000001514 detection method Methods 0.000 description 21
- 238000012545 processing Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000012935 Averaging Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 230000008030 elimination Effects 0.000 description 4
- 238000003379 elimination reaction Methods 0.000 description 4
- 206010019133 Hangover Diseases 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 3
- 230000015556 catabolic process Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 2
- 206010002953 Aphonia Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- SYHGEUNFJIGTRX-UHFFFAOYSA-N methylenedioxypyrovalerone Chemical compound C=1C=C2OCOC2=CC=1C(=O)C(CCC)N1CCCC1 SYHGEUNFJIGTRX-UHFFFAOYSA-N 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02168—Noise filtering characterised by the method used for estimating noise the estimation exclusively taking place during speech pauses
Definitions
- the invention relates to methods for conservation of bandwidth in a packet network. More specifically, the invention relates to methods for reducing the bandwidth consumption in voice-over packet networks by improved detection of active signals, background noise, and silence.
- a system for bandwidth savings known as time assignment speech interpolation (TASI) was introduced to increase the capacity of submarine telephone cables used in analog telephony. TASI was subsequently replaced with a similar digital system. Such schemes are commonly known as digital speech interpolation (DSI) systems.
- DSI digital speech interpolation
- VAD voice activity detection
- speech signal is transmitted using data packets.
- the general telephone network will limit the bandwidth of the speech signal to 300 to 3,400 Hz range.
- the signal is sampled at 8 Khz resulting in the maximum signal bandwidth of 4 Khz. Each sample is represented with 16 bits, resulting in a 128 kbps bit rate.
- PCM and ADPCM codecs are widely used in telephony applications and are important in high channel density implementation of voice-over packet applications.
- voice activity detection is used to distinguish silence from active signal. The silence packets are not transmitted during any nonspeech interval, effectively increasing the number of channels.
- the input speech level can be varied from ⁇ 50 dBm 0 to 0 dBm 0
- facsimile signal level varies from ⁇ 48dBm 0 to 0 dBm 0
- the noise properties may change considerably during a conversation.
- the energy threshold is adapted to the input signal and noise levels. Because of its adaptive function, the corresponding signal activity detection algorithm herein provides bandwidth savings with low complexity and low delay and performs well for a wide range of signal energy input levels and background noise environments as well as signal energy level changes. Because the bandwidth savings may change based on packet network traffic load, the algorithm is dynamically configurable to adjust the bandwidth savings percentages.
- bandwidth saving method In development of voice-over packet network applications, a reliable bandwidth saving method is crucial to achieve a desirable balance between acceptable perceived sound quality and reduction in bandwidth requirements. Due to a variety of working conditions a number of challenges are imposed upon such a method.
- the bandwidth savings needs to be accomplished with both low delay and low complexity.
- the method must perform well for a wide range of input signal levels, must work in a variety of background noise environments, and must be robust in the presence of active signal and/or background noise level changes. Since the bandwidth requirements may change based on network factors such as load or traffic conditions or because of changing performance needs, the present invention is dynamically configurable to perform well under different requirements. It is common for the noise environment to alter in real-time, and the present invention dynamically adjusts through monitoring such changes to accomplish bandwidth savings and to perform well under a wide variety of conditions.
- the present invention accomplishes efficient savings in bandwidth through a system for active signal (e.g., voice, facsimile, dialtone) and background noise detection and discrimination which utilizes block energy threshold adaptation, adaptive marginal signal/noise discrimination, state control logic, and active signal smoothing.
- the system distinguishes active signal (e.g., voice, speech, etc.) from background noise to allow for the compression or elimination of periods of silence or background noise.
- the system includes a state machine for logic control in establishing a dynamic adaptive threshold, below which the signal is identified as silence or background noise, and above which the signal is identified as active signal.
- the threshold is established by factors, including an active signal estimation technique from discrimination of noise below a first threshold and active signal above a second threshold.
- the system is efficient in detection of active signals and elimination of noise, while maintaining a safety margin to avoid degradation of voice quality by misidentification of low voice signals as background or silence.
- the state machine includes the flow logic, FIG. 3, for updating the adaptive block energy threshold used for threshold detection, FIG. 1.
- Learning state is the initial and default state, where the system does not have any reliable estimates of noise or active signal energy levels.
- the state control logic 6 is in converged state when the current energy level threshold is acceptable and the noise and signal level estimations are reliable.
- the state machine is in the constant envelope state to distinguish facsimile from background noise in order to identify facsimile as active signal, not noise,
- the system utilizes signal energy detection to establish and adjust the adaptive lower and upper thresholds.
- the signal is divided into blocks of a desired length, and signal features relating to the signal energy level are extracted for analysis to determine signal feature characteristics used to establish noise and active signal predictive thresholds. These established thresholds are used to discriminate the signal.
- a signal from a source is first processed to determine the energy E (n) of the signal.
- the energy level is processed into energy vectors corresponding to discrete time intervals, for analysis.
- Each block is first processed by comparison with an initial set of thresholds within a marginal signal and noise discriminator, to discriminate initially between noise and signal. If below a first noise threshold, the block is classified as noise. If above a second voice threshold, the block is classified as active signal. Once discriminated, blocks below the noise threshold are used in noise level estimation, and blocks above the active signal threshold are used in active signal level estimation. Blocks between the thresholds are not used in level estimation. In this manner the present invention creates a clear separation between signal and noise.
- estimation is a continuous processing activity updated as further signal blocks are discriminated and made available to the estimator.
- estimation is performed using a combination RMS/geometric averaging of block energies under the control of the marginal signal and noise discriminator.
- RMS or geometric averaging alone could be used, as could other power estimation techniques, sample based or block based averaging.
- the method of both sampling and averaging can be varied through a change of factors such as time constants, frame size for block energy threshold detection, changing noise and/or signal thresholds, elimination of a discrimination gap between noise and signal, estimate noise/voice division, etc., still within the scope of the invention as herein taught.
- the estimates of noise level and active signal level are later used in establishing the adaptive thresholds used to process the current signal block in the threshold detector to determine if the signal is noise or voice used in establishing an output decision for use in compression for bandwidth savings.
- the determined energy level E (n) of the signal is also supplied to a threshold detector to make the detection between noise and active signals.
- the current values of the adaptive thresholds within the detector as established from the active estimates of noise signal and active signal level based upon the control of the state control logic, are used to classify an input block into “active signal” or “noise” comparing the corresponding block energy E (n) with the adaptive threshold.
- the threshold adaption is performed based upon a current one of several available algorithms selected by a state control logic based upon the dynamics of the signal estimation processing. Different threshold functions are applied to the detection based upon the reliability of these estimates and the consistency of the signal envelope.
- Weak active signals which may present intermittent low signal levels, can be misclassified as noise.
- the output of the threshold detector is smoothed. By smoothing, short term active signal drops are not classified as noise and subsequently improperly compressed.
- the smoothed output of the threshold detector is used as the output decision of the system method.
- the smoothing mechanism is influenced by the traffic load configuration. In the exemplary embodiment, a hang-over period smoothing method is implemented. Alternative delay methods or smoothing algorithms can be implemented. However, the computational processing power needed to perform signal smoothing processing must be considered in implementing the present invention, which relies upon simplification for effective implementation.
- the output decision is then used by the voice-over packet network communication system to implement the desired processing of the current packet for bandwidth savings by appropriate compression based upon the simplified active signal/noise discrimination of the present invention.
- At least one silence frame i.e., a signal frame that does not contain speech sounds
- the short-term statistics (up to 1.5 seconds) of a noise are stationary or pseudo-stationary;
- the block energy threshold should be a function of noise level, active signal level, and signal-to-noise ratio.
- FIG. 1 is an overall block diagram for the signal processing and threshold detection system of the present invention.
- FIG. 2 is a block diagram illustrating the interaction of the states of the state control logic of the present invention.
- FIG. 3 is a logic flow chart illustrating the threshold update process of the state control logic of the present invention.
- FIG. 4 is a graph illustrating the coefficient K(E max /E min ) for the learning state of the state control logic of the present invention.
- FIG. 5 is a graph illustrating the coefficient K(E voice /E noise ) for the learning state of the state control logic of the present invention.
- FIG. 1 is a block diagram illustrating an exemplary embodiment of the overall logic flow of the present invention.
- the signal from a source in a packet network passes through splitter 9 and is inputted into block 1 where the signal energy is calculated.
- the signal energy is calculated using a block energy calculation technique where the input signal is partitioned into nonoverlapped 2.5 ms blocks.
- the 2.5 ms exemplary block size results in 20 samples/block, when an 8 kHz sampling rate is used.
- Table I illustrates an exemplary typical result from the calculation of block energy.
- the calculated block energies are used to extract features from the input signal at block 2 of FIG. 1. Using the calculated block energies, the following features are extracted every 1.28 seconds:
- the minimum and maximum energy vectors are obtained by partitioning a 1.28-second period into eight parts. For each part the minimum and maximum block energies are determined. The minimum and maximum energies are determined from the minimum and maximum energy vectors, respectively. In an exemplary embodiment, 5 ms block energy features are extracted for each threshold update period (1.28 seconds). Other block size and update periods can be used as appropriate for the signal, the desired compression, active signal quality and bandwidth savings.
- Minimum and maximum energy vectors E vct — min and E vct — max are extracted as follows:
- E(n) is 5 ms block energy
- the 2.5 ms block threshold block energy E(l) is extracted for the threshold detector 5 while the 2.5 ms block-based zero crossing rate is considered as an optional feature which can be extracted for consideration in threshold determination by the state control logic 6 . Because zero crossing rate is strongly affected by dc offset, a highpass filter should be used if the input signal has dc components.
- Table II illustrates an exemplary feature extraction from the exemplary block energies illustrated in Table I. TABLE II Min Max Block # Block Energy Emin Vector Emax Vector Energy Energy 1 29 2 18 3 21 4 7 7 29 5 45 6 47 7 75 8 52 45 75 9 6 10 14 11 19 12 55 6 55 6 75
- the purpose of the marginal signal and noise discriminator, block 3 is to keep a distance or gap between noise level and active signal level, so that overlapped parts of active signal and noise block energies can be eliminated before the subsequent noise and active signal energy estimations.
- the noise energy level estimate and the active signal energy level estimate are used by state control logic 6 during threshold establishment in the “converged state.” Establishing a region between a maximum noise level and a minimum active signal level is accomplished by maintaining two energy margins: one for noise, and the other for active signal. When block energy is below the noise margin, it is considered noise and used in noise level estimation. Similarly, when block energy is above the active signal margin, it is considered active signal and used in active signal level estimation. Otherwise, the block energy is not used in level estimation.
- the output of estimator 4 is used by state control logic 6 to select the current state based upon the signal envelope consistency and reliability. Therefore, the estimation of noise and active signal energy are independent of the output results of the bandwidth savings algorithm, and divergence due to misclassification can be avoided.
- the signal and noise level estimation 4 is performed using the geometric averaging of block energies under the control of the marginal signal and noise discriminator.
- the outputs are active signal level and noise level. These outputs represent an ongoing adaptive estimate of the average noise and active signal levels of the processed signal and can be determined according to the exemplary method below:
- T 1 E min + ⁇ fraction (1/32) ⁇ ( E max ⁇ E min )
- T noise min ⁇ 2min ⁇ T 1 ,T 2 ⁇ , ⁇ 21dBm 0
- T voice min ⁇ max ⁇ max ⁇ T 1 ,T 2 ⁇ , ⁇ 65dBm 0 ⁇ , ⁇ 17dBm 0 ⁇
- Both the noise and active signal (e.g., voice) thresholds are based on minimum and maximum block energy during one threshold updating period.
- Active signal and noise energy estimation is calculated by a geometric averaging as follows:
- x is either voice or noise and ⁇ is adjusted for determination of voice or noise as follows:
- E(n) is 5 ms block energy
- k and l are the number of voice and noise blocks respectively, from the marginal signal and noise discriminator 3 .
- control logic 6 The purpose of control logic 6 is to perform the threshold adaptation.
- the threshold used for detection 5 is adaptive in the present invention, based upon a number of factors derived from the block energy calculation, including the discrimination 3 and estimation 4 .
- the adaptation of the block energy threshold is necessary for the effective discrimination based upon the algorithm performance.
- the state control logic 6 performs the adaption of the threshold through processing algorithums based upon the state of the logic.
- State control logic 6 is designed as a state machine with the following states:
- Constant envelope The method is in this state when the input signal has approximately constant envelope as determined by the input from the marginal signal/noise discriminator 3 .
- facsimile signals, dial tone, and stationary noise signals would have a constant envelope.
- the system of the present invention will always start in the learning state until converged or constant envelope state is identified.
- the system state control logic 6 will revert to the learning state when either constant envelope or converged state cannot be identified.
- the method is in this state when the marginal signal/noise discriminator 3 has reliable estimates for the energy margins.
- the converged state threshold update is based on background noise and signal-to-noise ratio. However, the estimations of noise energy and signal-to-noise ratio are based on signal activity decisions. To minimize unstable operation, a marginal signal and noise discriminator is used in noise and signal level estimation.
- the converge state threshold algorithm is a function of average voice energy (E voice ) and noise energy (E noise ). E voice and E noise are estimated according to the marginal signal and noise discriminator 3 .
- the threshold is always bounded.
- the bounds depend on a traffic load.
- State control logic 6 determines the thresholds used by threshold detector 5 .
- the active signal level and noise level outputs of estimator 4 are one factor used by control logic 6 to establish detection thresholds for the threshold detector 5 . Other factors can include zero crossing discrimination.
- the current value of noise and active signal thresholds in adaptive threshold detector, block 5 are used to classify a current input block into “active signal” or “noise” using the corresponding block energy for the current input block calculated in block energy calculation 1 .
- the threshold values inputted to the threshold detector 5 are controlled by the state control logic 6 which determines the threshold function to be applied in the detector 5 based upon the state of control logic 6 determined by the estimation of signal estimator 4 .
- T is adaptive 2.5 ms block energy threshold
- T zcr is fixed zero crossing rate threshold, which, for example, can be chosen as 0.7.
- the purpose of using an additional zero crossing rate detector is to minimize the potential misclassification between noise and weak active signal at the beginning of an active signal, such as the beginning of a conversation.
- the output of the threshold detector 5 is smoothed 7 . Smoothing can be accomplished by providing a hang-over period for indicating active signal detection for a period of time after the signal has dropped below the active signal threshold. This will have the advantage of avoiding drops or holes in voice transmission and can help to avoid chopping of the end of speech. Other methods of smoothing can also be implemented within the scope of the invention.
- the output of threshold detector 5 after smoothing, is used as the output decision 8 of the method.
- the smoothing mechanism is influenced by the traffic load configuration. Typically, the output signal of the detector can indicate false noise detection in the presence of a short-lived weak active signal.
- the dynamic adaptability of the present invention allows for change of smoothing based upon traffic and signal detection.
- the output decision 8 is then supplied to the compression logic of the packet system in combination with the signal for the application of compression and/or noise elimination 11 as desired by the packet system.
- the portions of the signal classified as noise can be eliminated and the active signals passed or compressed as desired.
- the signal may need to be delayed 10 to adjust for the timing of the decision from the application of the method of the present invention.
- the various parameters need to be adjusted to correspond to the signal, the equipment used in the packet network, and the desired tradeoff between compression and active signal transmission degradation.
- Any of the parameters e.g., block size, sampling rate, threshold update period, hang-over period, minimum and maximum energy thresholds
- the algorithms can be changed to get different effects within the scope of the invention.
- the algorithms can be implemented, and the system and the packet network can be monitored.
- the parameters can then be adapted to achieve the desired bandwidth conservation.
- the compression can depend on traffic load to adjust the parameters of the system actively.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
- 1. Field of the Invention
- The invention relates to methods for conservation of bandwidth in a packet network. More specifically, the invention relates to methods for reducing the bandwidth consumption in voice-over packet networks by improved detection of active signals, background noise, and silence.
- 2. Description of the Background Art
- A system for bandwidth savings, known as time assignment speech interpolation (TASI), was introduced to increase the capacity of submarine telephone cables used in analog telephony. TASI was subsequently replaced with a similar digital system. Such schemes are commonly known as digital speech interpolation (DSI) systems. As multimode and variable-rate speech coding techniques have improved, several promising silence compression standards have been developed and issued to address the bandwidth saving problem. The algorithm standardized by the GSM for use in the Pan-European digital Cellular Mobile Telephone Service is an example of a voice activity detection (VAD) technique designed for the mobile environment. Another VAD algorithm in wireless applications is provided with the ITA/EIA/IS-127 Enhanced Variable Rate Codec standard. There are two silence compression standards from ITU: G.723.1 Annex A, and G.729 Annex B.
- Although these standards for bandwidth savings are very effective, their complexity is very high. The complexity of these methods derives from the fact that they rely upon processing the spectral features of a signal, which requires an analysis of the frequency and/or spectrum of the signal to identify the characteristics of speech, voice, or other distinct signals. These methods require adaptive algorithms to reduce noise, band pass filters to isolate speech, and the like to identify accurately characteristics of the signal to detect voice from other sounds, signals, or noise.
- Complex standards require complex algorithms and therefore require significant processing capabilities. The method of the present invention significantly reduces complexity and therefore can be implemented in high channel density wired telephony applications. The present invention is simple in terms of processing and memory requirements and results in excellent performance.
- In voice-over packet applications, speech signal is transmitted using data packets. The general telephone network will limit the bandwidth of the speech signal to 300 to 3,400 Hz range. In most speech codecs, the signal is sampled at 8 Khz resulting in the maximum signal bandwidth of 4 Khz. Each sample is represented with 16 bits, resulting in a 128 kbps bit rate. To save on bandwidth, PCM and ADPCM codecs are widely used in telephony applications and are important in high channel density implementation of voice-over packet applications. For the purpose of bandwidth savings with PCM and ADPCM codecs, voice activity detection is used to distinguish silence from active signal. The silence packets are not transmitted during any nonspeech interval, effectively increasing the number of channels. In voice-over packet applications, the input speech level can be varied from −50 dBm0 to 0 dBm0, facsimile signal level varies from −48dBm0 to 0 dBm0, the noise properties may change considerably during a conversation.
- To detect signal activity accurately under different signal input and noise conditions, the energy threshold is adapted to the input signal and noise levels. Because of its adaptive function, the corresponding signal activity detection algorithm herein provides bandwidth savings with low complexity and low delay and performs well for a wide range of signal energy input levels and background noise environments as well as signal energy level changes. Because the bandwidth savings may change based on packet network traffic load, the algorithm is dynamically configurable to adjust the bandwidth savings percentages.
- In development of voice-over packet network applications, a reliable bandwidth saving method is crucial to achieve a desirable balance between acceptable perceived sound quality and reduction in bandwidth requirements. Due to a variety of working conditions a number of challenges are imposed upon such a method. The bandwidth savings needs to be accomplished with both low delay and low complexity. The method must perform well for a wide range of input signal levels, must work in a variety of background noise environments, and must be robust in the presence of active signal and/or background noise level changes. Since the bandwidth requirements may change based on network factors such as load or traffic conditions or because of changing performance needs, the present invention is dynamically configurable to perform well under different requirements. It is common for the noise environment to alter in real-time, and the present invention dynamically adjusts through monitoring such changes to accomplish bandwidth savings and to perform well under a wide variety of conditions.
- The present invention accomplishes efficient savings in bandwidth through a system for active signal (e.g., voice, facsimile, dialtone) and background noise detection and discrimination which utilizes block energy threshold adaptation, adaptive marginal signal/noise discrimination, state control logic, and active signal smoothing. The system distinguishes active signal (e.g., voice, speech, etc.) from background noise to allow for the compression or elimination of periods of silence or background noise. The system includes a state machine for logic control in establishing a dynamic adaptive threshold, below which the signal is identified as silence or background noise, and above which the signal is identified as active signal. The threshold is established by factors, including an active signal estimation technique from discrimination of noise below a first threshold and active signal above a second threshold. Signal between the thresholds cannot be discriminated and is therefore not used in the estimation to avoid loss of voice through misidentification as noise or silence. The system is efficient in detection of active signals and elimination of noise, while maintaining a safety margin to avoid degradation of voice quality by misidentification of low voice signals as background or silence.
- The state machine, FIG. 2, includes the flow logic, FIG. 3, for updating the adaptive block energy threshold used for threshold detection, FIG. 1. There are three states in the state machine: learning state, converged state, and constant envelope state. Learning state is the initial and default state, where the system does not have any reliable estimates of noise or active signal energy levels. The state control logic6 is in converged state when the current energy level threshold is acceptable and the noise and signal level estimations are reliable. When the input signal has an approximate constant envelope, the state machine is in the constant envelope state to distinguish facsimile from background noise in order to identify facsimile as active signal, not noise,
- The system utilizes signal energy detection to establish and adjust the adaptive lower and upper thresholds. The signal is divided into blocks of a desired length, and signal features relating to the signal energy level are extracted for analysis to determine signal feature characteristics used to establish noise and active signal predictive thresholds. These established thresholds are used to discriminate the signal.
- A signal from a source is first processed to determine the energy E(n) of the signal. The energy level is processed into energy vectors corresponding to discrete time intervals, for analysis. Each block is first processed by comparison with an initial set of thresholds within a marginal signal and noise discriminator, to discriminate initially between noise and signal. If below a first noise threshold, the block is classified as noise. If above a second voice threshold, the block is classified as active signal. Once discriminated, blocks below the noise threshold are used in noise level estimation, and blocks above the active signal threshold are used in active signal level estimation. Blocks between the thresholds are not used in level estimation. In this manner the present invention creates a clear separation between signal and noise.
- These processed signal blocks are then used to create active estimates of the noise level and of the active signal level. The estimation is a continuous processing activity updated as further signal blocks are discriminated and made available to the estimator. In the exemplary embodiment, estimation is performed using a combination RMS/geometric averaging of block energies under the control of the marginal signal and noise discriminator. However, either RMS or geometric averaging alone could be used, as could other power estimation techniques, sample based or block based averaging. The method of both sampling and averaging can be varied through a change of factors such as time constants, frame size for block energy threshold detection, changing noise and/or signal thresholds, elimination of a discrimination gap between noise and signal, estimate noise/voice division, etc., still within the scope of the invention as herein taught.
- The estimates of noise level and active signal level are later used in establishing the adaptive thresholds used to process the current signal block in the threshold detector to determine if the signal is noise or voice used in establishing an output decision for use in compression for bandwidth savings.
- The determined energy level E(n) of the signal is also supplied to a threshold detector to make the detection between noise and active signals. The current values of the adaptive thresholds within the detector, as established from the active estimates of noise signal and active signal level based upon the control of the state control logic, are used to classify an input block into “active signal” or “noise” comparing the corresponding block energy E(n) with the adaptive threshold. The threshold adaption is performed based upon a current one of several available algorithms selected by a state control logic based upon the dynamics of the signal estimation processing. Different threshold functions are applied to the detection based upon the reliability of these estimates and the consistency of the signal envelope.
- Weak active signals, which may present intermittent low signal levels, can be misclassified as noise. In order to reduce misclassification, the output of the threshold detector is smoothed. By smoothing, short term active signal drops are not classified as noise and subsequently improperly compressed. The smoothed output of the threshold detector is used as the output decision of the system method. The smoothing mechanism is influenced by the traffic load configuration. In the exemplary embodiment, a hang-over period smoothing method is implemented. Alternative delay methods or smoothing algorithms can be implemented. However, the computational processing power needed to perform signal smoothing processing must be considered in implementing the present invention, which relies upon simplification for effective implementation.
- The output decision is then used by the voice-over packet network communication system to implement the desired processing of the current packet for bandwidth savings by appropriate compression based upon the simplified active signal/noise discrimination of the present invention.
- In energy-based signal activity detection, one of the difficulties is that a simple energy measure cannot distinguish low-level speech sounds (weak active signal) from background noise if the signal-to-noise ratio is not high enough. In the implementation of the preferred embodiment of the present invention as described below, the following assumptions have been made. However, these values can be adjusted to process signals according to desired design parameters while remaining within the inventive concept taught herein:
- during natural conversation, within a long enough period of time, there will exist at least one silence frame (i.e., a signal frame that does not contain speech sounds) of a minimum duration;
- during natural conversation, weak speech sounds should normally last only for short periods of time;
- the short-term statistics (up to 1.5 seconds) of a noise are stationary or pseudo-stationary;
- the block energy threshold should be a function of noise level, active signal level, and signal-to-noise ratio.
- FIG. 1 is an overall block diagram for the signal processing and threshold detection system of the present invention.
- FIG. 2 is a block diagram illustrating the interaction of the states of the state control logic of the present invention.
- FIG. 3 is a logic flow chart illustrating the threshold update process of the state control logic of the present invention.
- FIG. 4 is a graph illustrating the coefficient K(Emax/Emin) for the learning state of the state control logic of the present invention.
- FIG. 5 is a graph illustrating the coefficient K(Evoice/Enoise) for the learning state of the state control logic of the present invention.
- FIG. 1 is a block diagram illustrating an exemplary embodiment of the overall logic flow of the present invention. The signal from a source in a packet network passes through splitter9 and is inputted into block 1 where the signal energy is calculated.
- The signal energy is calculated using a block energy calculation technique where the input signal is partitioned into nonoverlapped 2.5 ms blocks. The 2.5 ms exemplary block size results in 20 samples/block, when an 8 kHz sampling rate is used. The block energy is calculated as a sum of sample squares or root-mean-square algorithm. The calculation can be performed according to a standard signal energy algorithm such as:
- for example, where: N=20 if 2.5 ms blocks are used and N=40 if 5 ms blocks are used.
- Table I illustrates an exemplary typical result from the calculation of block energy. In the algorithm as implemented in an exemplary embodiment, the block length N=40 (samples of 5 ms), the threshold update period L=256 blocks (1.28 sec) and the update subperiod S=32 blocks (160 ms), the dimension of minimum/maximum energy vectors is D=8 (eight subperiods within a period or L/S). In the following example, shortened for the sake of illustration, N=5, L=12, and S=4, and therefore D=3.
TABLE I Block # Samples Energy Value 1 −1 3 3 1 3 29 2 1 −2 −3 −2 0 18 3 2 −2 3 0 −2 21 4 2 0 −1 1 1 7 5 2 4 0 3 −4 45 6 4 −3 −3 3 2 47 7 −4 −5 3 −4 −3 75 8 1 −3 −1 −5 4 52 9 0 −1 0 −2 −1 6 10 −3 0 2 0 1 14 11 −3 −2 2 1 −1 19 12 0 2 −5 1 −5 55 - The calculated block energies are used to extract features from the input signal at block2 of FIG. 1. Using the calculated block energies, the following features are extracted every 1.28 seconds:
- 1. Minimum energy vector.
- 2. Maximum energy vector.
- 3. Minimum energy.
- 4. Maximum energy.
- The minimum and maximum energy vectors are obtained by partitioning a 1.28-second period into eight parts. For each part the minimum and maximum block energies are determined. The minimum and maximum energies are determined from the minimum and maximum energy vectors, respectively. In an exemplary embodiment, 5 ms block energy features are extracted for each threshold update period (1.28 seconds). Other block size and update periods can be used as appropriate for the signal, the desired compression, active signal quality and bandwidth savings. The threshold is partitioned into eight non-overlapped subperiod intervals J of 160 ms (length N=32 5 ms blocks). Minimum and maximum energy vectors Evct
— min and Evct— max are extracted as follows: - Evct_min(j)=min{E(n)}
- and
- Evct_max(j)=max{E(n)}
- where: E(n) is 5 ms block energy, and
- j=0,1,2 . . . , 7and nε[jN, (j+1)N−1]
- The minimum energy and maximum energy are the minimum or maximum 5 ms block energy during the whole threshold update period, i.e., Emin=min{Evct_min} and Emax=max{Evct_max}. The 2.5 ms block threshold block energy E(l) is extracted for the
threshold detector 5 while the 2.5 ms block-based zero crossing rate is considered as an optional feature which can be extracted for consideration in threshold determination by the state control logic 6. Because zero crossing rate is strongly affected by dc offset, a highpass filter should be used if the input signal has dc components. Block-based zero crossing rate can be extracted as follows: - where L=20 is the block length
- Table II illustrates an exemplary feature extraction from the exemplary block energies illustrated in Table I.
TABLE II Min Max Block # Block Energy Emin Vector Emax Vector Energy Energy 1 29 2 18 3 21 4 7 7 29 5 45 6 47 7 75 8 52 45 75 9 6 10 14 11 19 12 55 6 55 6 75 - The purpose of the marginal signal and noise discriminator, block3, is to keep a distance or gap between noise level and active signal level, so that overlapped parts of active signal and noise block energies can be eliminated before the subsequent noise and active signal energy estimations. The noise energy level estimate and the active signal energy level estimate are used by state control logic 6 during threshold establishment in the “converged state.” Establishing a region between a maximum noise level and a minimum active signal level is accomplished by maintaining two energy margins: one for noise, and the other for active signal. When block energy is below the noise margin, it is considered noise and used in noise level estimation. Similarly, when block energy is above the active signal margin, it is considered active signal and used in active signal level estimation. Otherwise, the block energy is not used in level estimation. The output of estimator 4 is used by state control logic 6 to select the current state based upon the signal envelope consistency and reliability. Therefore, the estimation of noise and active signal energy are independent of the output results of the bandwidth savings algorithm, and divergence due to misclassification can be avoided.
- The signal and noise level estimation4 is performed using the geometric averaging of block energies under the control of the marginal signal and noise discriminator. The outputs are active signal level and noise level. These outputs represent an ongoing adaptive estimate of the average noise and active signal levels of the processed signal and can be determined according to the exemplary method below:
- T 1 =E min+{fraction (1/32)}(E max −E min)
- T 2=4E min
- T noise=min{2min{T 1 ,T 2},−21dBm0
- T voice=min{max{αmax{T 1 ,T 2},−65dBm0},−17dBm0}
-
- Both the noise and active signal (e.g., voice) thresholds are based on minimum and maximum block energy during one threshold updating period. Active signal and noise energy estimation is calculated by a geometric averaging as follows:
- E x(n)=(1αx)E x(n−1)+αx E(n)
-
- where E(n) is 5 ms block energy, k and l are the number of voice and noise blocks respectively, from the marginal signal and noise discriminator3.
- The purpose of control logic6 is to perform the threshold adaptation. The threshold used for
detection 5 is adaptive in the present invention, based upon a number of factors derived from the block energy calculation, including the discrimination 3 and estimation 4. The adaptation of the block energy threshold is necessary for the effective discrimination based upon the algorithm performance. The state control logic 6 performs the adaption of the threshold through processing algorithums based upon the state of the logic. - State control logic6 is designed as a state machine with the following states:
- 1. Constant envelope. The method is in this state when the input signal has approximately constant envelope as determined by the input from the marginal signal/noise discriminator3. For example, facsimile signals, dial tone, and stationary noise signals would have a constant envelope.
-
-
- the coefficient K(Emax/Emin)is illustrated in FIG. 4.
- The system of the present invention will always start in the learning state until converged or constant envelope state is identified. The system state control logic6 will revert to the learning state when either constant envelope or converged state cannot be identified.
-
-
- the threshold is always bounded. The bounds depend on a traffic load.
- State control logic6 determines the thresholds used by
threshold detector 5. The active signal level and noise level outputs of estimator 4 are one factor used by control logic 6 to establish detection thresholds for thethreshold detector 5. Other factors can include zero crossing discrimination. The current value of noise and active signal thresholds in adaptive threshold detector,block 5, are used to classify a current input block into “active signal” or “noise” using the corresponding block energy for the current input block calculated in block energy calculation 1. The threshold values inputted to thethreshold detector 5 are controlled by the state control logic 6 which determines the threshold function to be applied in thedetector 5 based upon the state of control logic 6 determined by the estimation of signal estimator 4. -
- where T is adaptive 2.5 ms block energy threshold
- An input frame is partitioned into non-overlapped 2.5 ms block (20 samples/block). A decision is made for each block based on the block energy. In an embodiment with an optional zero crossing rate available, an additional threshold detection step is utilized when the energy threshold detection detects the current block as noise, as follows:
- where Tzcr is fixed zero crossing rate threshold, which, for example, can be chosen as 0.7. The purpose of using an additional zero crossing rate detector is to minimize the potential misclassification between noise and weak active signal at the beginning of an active signal, such as the beginning of a conversation.
- In order to reduce the potential for misclassification of weak active signal as noise, the output of the
threshold detector 5 is smoothed 7. Smoothing can be accomplished by providing a hang-over period for indicating active signal detection for a period of time after the signal has dropped below the active signal threshold. This will have the advantage of avoiding drops or holes in voice transmission and can help to avoid chopping of the end of speech. Other methods of smoothing can also be implemented within the scope of the invention. The output ofthreshold detector 5, after smoothing, is used as theoutput decision 8 of the method. The smoothing mechanism is influenced by the traffic load configuration. Typically, the output signal of the detector can indicate false noise detection in the presence of a short-lived weak active signal. By smoothing the signal, short noise detections can be significantly reduced. Under high traffic loads, it may be desirable to reduce the degree of smoothing to allow increased bandwidth savings with only slight potential degradation in voice quality. Under low traffic loads, it may be desirable to increase the degree of smoothing to achieve potentially greater voice quality with acceptable lower reductions in bandwidth savings. The dynamic adaptability of the present invention allows for change of smoothing based upon traffic and signal detection. - The
output decision 8 is then supplied to the compression logic of the packet system in combination with the signal for the application of compression and/or noise elimination 11 as desired by the packet system. The portions of the signal classified as noise can be eliminated and the active signals passed or compressed as desired. The signal may need to be delayed 10 to adjust for the timing of the decision from the application of the method of the present invention. - In implementing the system of the present invention, the various parameters need to be adjusted to correspond to the signal, the equipment used in the packet network, and the desired tradeoff between compression and active signal transmission degradation. Any of the parameters (e.g., block size, sampling rate, threshold update period, hang-over period, minimum and maximum energy thresholds) as well the algorithms can be changed to get different effects within the scope of the invention. The algorithms can be implemented, and the system and the packet network can be monitored. The parameters can then be adapted to achieve the desired bandwidth conservation. The compression can depend on traffic load to adjust the parameters of the system actively.
- A further specific exemplary implementation of the present invention is described in the paper entitled Signal Dependent Bandwidth Saving Method in Voice-Over Packet Networks of Dunling Li, Zoran Mladenovic, and Bogdan Kosanovic, attached hereto and incorporated by reference herein.
- Because many varying and different embodiments may be made within the scope of the inventive concept herein taught, and because many modifications may be made in the embodiments herein detailed in accordance with the descriptive requirements of the law, it is to be understood that the details herein are to be interpreted as illustrative and as limiting.
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/249,108 US6381570B2 (en) | 1999-02-12 | 1999-02-12 | Adaptive two-threshold method for discriminating noise from speech in a communication signal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/249,108 US6381570B2 (en) | 1999-02-12 | 1999-02-12 | Adaptive two-threshold method for discriminating noise from speech in a communication signal |
Publications (2)
Publication Number | Publication Date |
---|---|
US20020010580A1 true US20020010580A1 (en) | 2002-01-24 |
US6381570B2 US6381570B2 (en) | 2002-04-30 |
Family
ID=22942089
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/249,108 Expired - Lifetime US6381570B2 (en) | 1999-02-12 | 1999-02-12 | Adaptive two-threshold method for discriminating noise from speech in a communication signal |
Country Status (1)
Country | Link |
---|---|
US (1) | US6381570B2 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020169602A1 (en) * | 2001-05-09 | 2002-11-14 | Octiv, Inc. | Echo suppression and speech detection techniques for telephony applications |
US20060025992A1 (en) * | 2004-07-27 | 2006-02-02 | Yoon-Hark Oh | Apparatus and method of eliminating noise from a recording device |
US20070129941A1 (en) * | 2005-12-01 | 2007-06-07 | Hitachi, Ltd. | Preprocessing system and method for reducing FRR in speaking recognition |
US20090278830A1 (en) * | 2005-10-14 | 2009-11-12 | Panasonic Corporation | Display control device |
US20110184734A1 (en) * | 2009-10-15 | 2011-07-28 | Huawei Technologies Co., Ltd. | Method and apparatus for voice activity detection, and encoder |
US20120197642A1 (en) * | 2009-10-15 | 2012-08-02 | Huawei Technologies Co., Ltd. | Signal processing method, device, and system |
US20120209604A1 (en) * | 2009-10-19 | 2012-08-16 | Martin Sehlstedt | Method And Background Estimator For Voice Activity Detection |
US8296133B2 (en) | 2009-10-15 | 2012-10-23 | Huawei Technologies Co., Ltd. | Voice activity decision base on zero crossing rate and spectral sub-band energy |
US20160260443A1 (en) * | 2010-12-24 | 2016-09-08 | Huawei Technologies Co., Ltd. | Method and apparatus for detecting a voice activity in an input audio signal |
CN106211229A (en) * | 2015-04-29 | 2016-12-07 | 中国电信股份有限公司 | Intelligence accelerated method, Apparatus and system |
CN110689901A (en) * | 2019-09-09 | 2020-01-14 | 苏州臻迪智能科技有限公司 | Voice noise reduction method and device, electronic equipment and readable storage medium |
CN111739542A (en) * | 2020-05-13 | 2020-10-02 | 深圳市微纳感知计算技术有限公司 | Method, device and equipment for detecting characteristic sound |
CN112967735A (en) * | 2021-02-23 | 2021-06-15 | 北京达佳互联信息技术有限公司 | Training method of voice quality detection model and voice quality detection method |
Families Citing this family (68)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7161931B1 (en) * | 1999-09-20 | 2007-01-09 | Broadcom Corporation | Voice and data exchange over a packet based network |
WO2001050459A1 (en) * | 1999-12-31 | 2001-07-12 | Octiv, Inc. | Techniques for improving audio clarity and intelligibility at reduced bit rates over a digital network |
US6757301B1 (en) * | 2000-03-14 | 2004-06-29 | Cisco Technology, Inc. | Detection of ending of fax/modem communication between a telephone line and a network for switching router to compressed mode |
US20020075965A1 (en) * | 2000-12-20 | 2002-06-20 | Octiv, Inc. | Digital signal processing techniques for improving audio clarity and intelligibility |
US20030023429A1 (en) * | 2000-12-20 | 2003-01-30 | Octiv, Inc. | Digital signal processing techniques for improving audio clarity and intelligibility |
US7437286B2 (en) * | 2000-12-27 | 2008-10-14 | Intel Corporation | Voice barge-in in telephony speech recognition |
US7277853B1 (en) * | 2001-03-02 | 2007-10-02 | Mindspeed Technologies, Inc. | System and method for a endpoint detection of speech for improved speech recognition in noisy environments |
US7031916B2 (en) * | 2001-06-01 | 2006-04-18 | Texas Instruments Incorporated | Method for converging a G.729 Annex B compliant voice activity detection circuit |
US7386447B2 (en) * | 2001-11-02 | 2008-06-10 | Texas Instruments Incorporated | Speech coder and method |
US7146314B2 (en) * | 2001-12-20 | 2006-12-05 | Renesas Technology Corporation | Dynamic adjustment of noise separation in data handling, particularly voice activation |
GB2389217A (en) * | 2002-05-27 | 2003-12-03 | Canon Kk | Speech recognition system |
US7433462B2 (en) * | 2002-10-31 | 2008-10-07 | Plantronics, Inc | Techniques for improving telephone audio quality |
DE10251113A1 (en) * | 2002-11-02 | 2004-05-19 | Philips Intellectual Property & Standards Gmbh | Voice recognition method, involves changing over to noise-insensitive mode and/or outputting warning signal if reception quality value falls below threshold or noise value exceeds threshold |
US7383178B2 (en) | 2002-12-11 | 2008-06-03 | Softmax, Inc. | System and method for speech processing using independent component analysis under stability constraints |
US7099821B2 (en) * | 2003-09-12 | 2006-08-29 | Softmax, Inc. | Separation of target acoustic signals in a multi-transducer arrangement |
US7478040B2 (en) * | 2003-10-24 | 2009-01-13 | Broadcom Corporation | Method for adaptive filtering |
US7443821B2 (en) * | 2004-01-08 | 2008-10-28 | Interdigital Technology Corporation | Method for clear channel assessment optimization in a wireless local area network |
US20050285935A1 (en) * | 2004-06-29 | 2005-12-29 | Octiv, Inc. | Personal conferencing node |
US20050286443A1 (en) * | 2004-06-29 | 2005-12-29 | Octiv, Inc. | Conferencing system |
US20060241937A1 (en) * | 2005-04-21 | 2006-10-26 | Ma Changxue C | Method and apparatus for automatically discriminating information bearing audio segments and background noise audio segments |
US7464029B2 (en) * | 2005-07-22 | 2008-12-09 | Qualcomm Incorporated | Robust separation of speech signals in a noisy environment |
KR100927897B1 (en) * | 2005-09-02 | 2009-11-23 | 닛본 덴끼 가부시끼가이샤 | Noise suppression method and apparatus, and computer program |
US7636404B2 (en) * | 2005-11-21 | 2009-12-22 | Intel Corporation | Packet detection in the presence of platform noise in a wireless network |
US8345890B2 (en) | 2006-01-05 | 2013-01-01 | Audience, Inc. | System and method for utilizing inter-microphone level differences for speech enhancement |
US8194880B2 (en) | 2006-01-30 | 2012-06-05 | Audience, Inc. | System and method for utilizing omni-directional microphones for speech enhancement |
US8204252B1 (en) | 2006-10-10 | 2012-06-19 | Audience, Inc. | System and method for providing close microphone adaptive array processing |
US9185487B2 (en) | 2006-01-30 | 2015-11-10 | Audience, Inc. | System and method for providing noise suppression utilizing null processing noise subtraction |
US8744844B2 (en) | 2007-07-06 | 2014-06-03 | Audience, Inc. | System and method for adaptive intelligent noise suppression |
US8898056B2 (en) * | 2006-03-01 | 2014-11-25 | Qualcomm Incorporated | System and method for generating a separated signal by reordering frequency components |
US8934641B2 (en) * | 2006-05-25 | 2015-01-13 | Audience, Inc. | Systems and methods for reconstructing decomposed audio signals |
US8849231B1 (en) | 2007-08-08 | 2014-09-30 | Audience, Inc. | System and method for adaptive power control |
US8204253B1 (en) | 2008-06-30 | 2012-06-19 | Audience, Inc. | Self calibration of audio device |
US8150065B2 (en) * | 2006-05-25 | 2012-04-03 | Audience, Inc. | System and method for processing an audio signal |
US8949120B1 (en) * | 2006-05-25 | 2015-02-03 | Audience, Inc. | Adaptive noise cancelation |
US20080082320A1 (en) * | 2006-09-29 | 2008-04-03 | Nokia Corporation | Apparatus, method and computer program product for advanced voice conversion |
US20080109217A1 (en) * | 2006-11-08 | 2008-05-08 | Nokia Corporation | Method, Apparatus and Computer Program Product for Controlling Voicing in Processed Speech |
US8259926B1 (en) | 2007-02-23 | 2012-09-04 | Audience, Inc. | System and method for 2-channel and 3-channel acoustic echo cancellation |
US20080208538A1 (en) * | 2007-02-26 | 2008-08-28 | Qualcomm Incorporated | Systems, methods, and apparatus for signal separation |
US8160273B2 (en) * | 2007-02-26 | 2012-04-17 | Erik Visser | Systems, methods, and apparatus for signal separation using data driven techniques |
GB2450886B (en) * | 2007-07-10 | 2009-12-16 | Motorola Inc | Voice activity detector and a method of operation |
US8189766B1 (en) | 2007-07-26 | 2012-05-29 | Audience, Inc. | System and method for blind subband acoustic echo cancellation postfiltering |
US8175291B2 (en) * | 2007-12-19 | 2012-05-08 | Qualcomm Incorporated | Systems, methods, and apparatus for multi-microphone based speech enhancement |
US8180064B1 (en) | 2007-12-21 | 2012-05-15 | Audience, Inc. | System and method for providing voice equalization |
US8143620B1 (en) | 2007-12-21 | 2012-03-27 | Audience, Inc. | System and method for adaptive classification of audio sources |
US8194882B2 (en) | 2008-02-29 | 2012-06-05 | Audience, Inc. | System and method for providing single microphone noise suppression fallback |
US8355511B2 (en) | 2008-03-18 | 2013-01-15 | Audience, Inc. | System and method for envelope-based acoustic echo cancellation |
US8321214B2 (en) * | 2008-06-02 | 2012-11-27 | Qualcomm Incorporated | Systems, methods, and apparatus for multichannel signal amplitude balancing |
US8774423B1 (en) | 2008-06-30 | 2014-07-08 | Audience, Inc. | System and method for controlling adaptivity of signal modification using a phantom coefficient |
US8521530B1 (en) | 2008-06-30 | 2013-08-27 | Audience, Inc. | System and method for enhancing a monaural audio signal |
KR101148771B1 (en) * | 2009-01-08 | 2012-05-25 | 주식회사 코아로직 | Device and method for stabilizing voice source and communication apparatus comprising the same device |
CN101859568B (en) * | 2009-04-10 | 2012-05-30 | 比亚迪股份有限公司 | Method and device for eliminating voice background noise |
US9008329B1 (en) | 2010-01-26 | 2015-04-14 | Audience, Inc. | Noise reduction using multi-feature cluster tracker |
US8718290B2 (en) | 2010-01-26 | 2014-05-06 | Audience, Inc. | Adaptive noise reduction using level cues |
US8473287B2 (en) | 2010-04-19 | 2013-06-25 | Audience, Inc. | Method for jointly optimizing noise reduction and voice quality in a mono or multi-microphone system |
US8538035B2 (en) | 2010-04-29 | 2013-09-17 | Audience, Inc. | Multi-microphone robust noise suppression |
US8606571B1 (en) * | 2010-04-19 | 2013-12-10 | Audience, Inc. | Spatial selectivity noise reduction tradeoff for multi-microphone systems |
US8781137B1 (en) | 2010-04-27 | 2014-07-15 | Audience, Inc. | Wind noise detection and suppression |
US8447596B2 (en) | 2010-07-12 | 2013-05-21 | Audience, Inc. | Monaural noise suppression based on computational auditory scene analysis |
CN102376303B (en) * | 2010-08-13 | 2014-03-12 | 国基电子(上海)有限公司 | Sound recording device and method for processing and recording sound by utilizing same |
US8362936B2 (en) * | 2011-01-21 | 2013-01-29 | Maxim Integrated Products, Inc. | Circuit and method for optimizing dynamic range in a digital to analog signal path |
US8781821B2 (en) * | 2012-04-30 | 2014-07-15 | Zanavox | Voiced interval command interpretation |
US9640194B1 (en) | 2012-10-04 | 2017-05-02 | Knowles Electronics, Llc | Noise suppression for speech processing based on machine-learning mask estimation |
US20180317019A1 (en) | 2013-05-23 | 2018-11-01 | Knowles Electronics, Llc | Acoustic activity detecting microphone |
US9536540B2 (en) | 2013-07-19 | 2017-01-03 | Knowles Electronics, Llc | Speech signal separation and synthesis based on auditory scene analysis and speech modeling |
US9799330B2 (en) | 2014-08-28 | 2017-10-24 | Knowles Electronics, Llc | Multi-sourced noise suppression |
DE112016000287T5 (en) | 2015-01-07 | 2017-10-05 | Knowles Electronics, Llc | Use of digital microphones for low power keyword detection and noise reduction |
ITUB20153503A1 (en) * | 2015-09-09 | 2017-03-09 | St Microelectronics Srl | PROCEDURE AND DEVICE OF DYNAMIC CONTROL, EQUIPMENT AND COMPUTER PRODUCT |
US10928502B2 (en) * | 2018-05-30 | 2021-02-23 | Richwave Technology Corp. | Methods and apparatus for detecting presence of an object in an environment |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4135214A (en) | 1969-07-02 | 1979-01-16 | Dacom, Inc. | Method and apparatus for compressing facsimile transmission data |
US4052568A (en) * | 1976-04-23 | 1977-10-04 | Communications Satellite Corporation | Digital voice switch |
US4131849A (en) | 1976-10-21 | 1978-12-26 | Motorola, Inc. | Two-way mobile radio voice/data shared communications system |
US4277645A (en) * | 1980-01-25 | 1981-07-07 | Bell Telephone Laboratories, Incorporated | Multiple variable threshold speech detector |
ATE15563T1 (en) * | 1981-09-24 | 1985-09-15 | Gretag Ag | METHOD AND DEVICE FOR REDUNDANCY-REDUCING DIGITAL SPEECH PROCESSING. |
US4696040A (en) * | 1983-10-13 | 1987-09-22 | Texas Instruments Incorporated | Speech analysis/synthesis system with energy normalization and silence suppression |
US4829578A (en) * | 1986-10-02 | 1989-05-09 | Dragon Systems, Inc. | Speech detection and recognition apparatus for use with background noise of varying levels |
ATE221690T1 (en) | 1991-05-29 | 2002-08-15 | Pacific Microsonics Inc | IMPROVEMENTS IN SYSTEMS TO ACHIEVE GREATER AMPLITUDE RESOLUTION |
US5617508A (en) * | 1992-10-05 | 1997-04-01 | Panasonic Technologies Inc. | Speech detection device for the detection of speech end points based on variance of frequency band limited energy |
US5504834A (en) | 1993-05-28 | 1996-04-02 | Motrola, Inc. | Pitch epoch synchronous linear predictive coding vocoder and method |
US5359593A (en) | 1993-08-26 | 1994-10-25 | International Business Machines Corporation | Dynamic bandwidth estimation and adaptation for packet communications networks |
JP3604393B2 (en) * | 1994-07-18 | 2004-12-22 | 松下電器産業株式会社 | Voice detection device |
US5541911A (en) | 1994-10-12 | 1996-07-30 | 3Com Corporation | Remote smart filtering communication management system |
US5623492A (en) | 1995-03-24 | 1997-04-22 | U S West Technologies, Inc. | Methods and systems for managing bandwidth resources in a fast packet switching network |
US5815492A (en) | 1996-06-20 | 1998-09-29 | International Business Machines Corporation | Dynamic bandwidth estimation and adaptation in high speed packet switching networks |
US5991718A (en) * | 1998-02-27 | 1999-11-23 | At&T Corp. | System and method for noise threshold adaptation for voice activity detection in nonstationary noise environments |
AU5472199A (en) * | 1999-08-10 | 2001-03-05 | Telogy Networks, Inc. | Background energy estimation |
-
1999
- 1999-02-12 US US09/249,108 patent/US6381570B2/en not_active Expired - Lifetime
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020169602A1 (en) * | 2001-05-09 | 2002-11-14 | Octiv, Inc. | Echo suppression and speech detection techniques for telephony applications |
US7236929B2 (en) * | 2001-05-09 | 2007-06-26 | Plantronics, Inc. | Echo suppression and speech detection techniques for telephony applications |
US20060025992A1 (en) * | 2004-07-27 | 2006-02-02 | Yoon-Hark Oh | Apparatus and method of eliminating noise from a recording device |
US20090278830A1 (en) * | 2005-10-14 | 2009-11-12 | Panasonic Corporation | Display control device |
US20070129941A1 (en) * | 2005-12-01 | 2007-06-07 | Hitachi, Ltd. | Preprocessing system and method for reducing FRR in speaking recognition |
US8554547B2 (en) | 2009-10-15 | 2013-10-08 | Huawei Technologies Co., Ltd. | Voice activity decision base on zero crossing rate and spectral sub-band energy |
US7996215B1 (en) | 2009-10-15 | 2011-08-09 | Huawei Technologies Co., Ltd. | Method and apparatus for voice activity detection, and encoder |
US20120197642A1 (en) * | 2009-10-15 | 2012-08-02 | Huawei Technologies Co., Ltd. | Signal processing method, device, and system |
US8296133B2 (en) | 2009-10-15 | 2012-10-23 | Huawei Technologies Co., Ltd. | Voice activity decision base on zero crossing rate and spectral sub-band energy |
US20110184734A1 (en) * | 2009-10-15 | 2011-07-28 | Huawei Technologies Co., Ltd. | Method and apparatus for voice activity detection, and encoder |
US20120209604A1 (en) * | 2009-10-19 | 2012-08-16 | Martin Sehlstedt | Method And Background Estimator For Voice Activity Detection |
US9202476B2 (en) * | 2009-10-19 | 2015-12-01 | Telefonaktiebolaget L M Ericsson (Publ) | Method and background estimator for voice activity detection |
US20160078884A1 (en) * | 2009-10-19 | 2016-03-17 | Telefonaktiebolaget L M Ericsson (Publ) | Method and background estimator for voice activity detection |
US9418681B2 (en) * | 2009-10-19 | 2016-08-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and background estimator for voice activity detection |
US20160260443A1 (en) * | 2010-12-24 | 2016-09-08 | Huawei Technologies Co., Ltd. | Method and apparatus for detecting a voice activity in an input audio signal |
US9761246B2 (en) * | 2010-12-24 | 2017-09-12 | Huawei Technologies Co., Ltd. | Method and apparatus for detecting a voice activity in an input audio signal |
US10134417B2 (en) | 2010-12-24 | 2018-11-20 | Huawei Technologies Co., Ltd. | Method and apparatus for detecting a voice activity in an input audio signal |
US10796712B2 (en) | 2010-12-24 | 2020-10-06 | Huawei Technologies Co., Ltd. | Method and apparatus for detecting a voice activity in an input audio signal |
US11430461B2 (en) | 2010-12-24 | 2022-08-30 | Huawei Technologies Co., Ltd. | Method and apparatus for detecting a voice activity in an input audio signal |
CN106211229A (en) * | 2015-04-29 | 2016-12-07 | 中国电信股份有限公司 | Intelligence accelerated method, Apparatus and system |
CN110689901A (en) * | 2019-09-09 | 2020-01-14 | 苏州臻迪智能科技有限公司 | Voice noise reduction method and device, electronic equipment and readable storage medium |
CN111739542A (en) * | 2020-05-13 | 2020-10-02 | 深圳市微纳感知计算技术有限公司 | Method, device and equipment for detecting characteristic sound |
CN112967735A (en) * | 2021-02-23 | 2021-06-15 | 北京达佳互联信息技术有限公司 | Training method of voice quality detection model and voice quality detection method |
Also Published As
Publication number | Publication date |
---|---|
US6381570B2 (en) | 2002-04-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6381570B2 (en) | Adaptive two-threshold method for discriminating noise from speech in a communication signal | |
CA1231473A (en) | Voice activity detection process and means for implementing said process | |
US11430461B2 (en) | Method and apparatus for detecting a voice activity in an input audio signal | |
US7031916B2 (en) | Method for converging a G.729 Annex B compliant voice activity detection circuit | |
US9646621B2 (en) | Voice detector and a method for suppressing sub-bands in a voice detector | |
Sohn et al. | A voice activity detector employing soft decision based noise spectrum adaptation | |
RU2251750C2 (en) | Method for detection of complicated signal activity for improved classification of speech/noise in audio-signal | |
EP2346027B1 (en) | Method and apparatus for voice activity detection | |
US8818811B2 (en) | Method and apparatus for performing voice activity detection | |
EP0785419B1 (en) | Voice activity detection | |
US5970441A (en) | Detection of periodicity information from an audio signal | |
JP3878482B2 (en) | Voice detection apparatus and voice detection method | |
US20010014857A1 (en) | A voice activity detector for packet voice network | |
KR20000023823A (en) | Speech detection system employing multiple determinants | |
US4535445A (en) | Conferencing system adaptive signal conditioner | |
US7072828B2 (en) | Apparatus and method for improved voice activity detection | |
EP1751740B1 (en) | System and method for babble noise detection | |
EP1312075A1 (en) | Method for noise robust classification in speech coding | |
US6915257B2 (en) | Method and apparatus for speech coding with voiced/unvoiced determination | |
JP3224368B2 (en) | Wireless receiver | |
US6718297B1 (en) | Apparatus and method for discriminating between voice and data by using a frequency estimate representing both a central frequency and an energy of an input signal | |
JP3231699B2 (en) | Voice detector, voice detection method, and high-efficiency terminal device | |
JPH0758720A (en) | Device and method for detecting speech activity |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: TELOGY NETWORKS, INC., MARYLAND Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LI, DUNLING;MLADENOVIC, ZORAN;KOSANOVIC, BOGDAN;REEL/FRAME:009832/0802 Effective date: 19990210 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
REFU | Refund |
Free format text: REFUND - SURCHARGE, PETITION TO ACCEPT PYMT AFTER EXP, UNINTENTIONAL (ORIGINAL EVENT CODE: R2551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FPAY | Fee payment |
Year of fee payment: 12 |