US20160322067A1

US20160322067A1 - Methods and Voice Activity Detectors for a Speech Encoders

Info

Publication number: US20160322067A1
Application number: US15/182,135
Authority: US
Inventors: Martin Sehlstedt
Original assignee: Telefonaktiebolaget LM Ericsson AB
Current assignee: Telefonaktiebolaget LM Ericsson AB
Priority date: 2009-10-19
Filing date: 2016-06-14
Publication date: 2016-11-03
Also published as: CN102804261A; EP2491548A4; IN2012DN03323A; US9401160B2; AU2010308598A1; WO2011049515A1; EP2491548A1; JP2013508773A; US20120215536A1; CN102804261B; CA2778343A1

Abstract

Voice activity detectors and related methods are provided. Methods include receiving a frame of the input signal; determining a first SNR of the received frame; comparing the determined first SNR with an adaptive threshold; and detecting whether the received frame comprises voice based on the comparison. The adaptive threshold is at least based on total noise energy of a noise level, an estimate of a second SNR and on energy variation between different frames.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 13/502,535, filed on Apr. 18, 2012, which is a 35 U.S.C. §371 national stage application of PCT International Application No. PCT/SE2010/051117, filed on Oct. 18, 2010, which claims priority to U.S. Provisional Application No. 61/252,966, filed on Oct. 19, 2009, the entire contents of which are incorporated by reference herein as if set forth in their entirety. The above-referenced PCT International Application was published in the English language as International Publication No. WO 2011/049515 on Apr. 28, 2011

FIELD

The embodiments of the present invention relates to a method and a voice activity detector, and in particular to threshold adaptation for the voice activity detector.

BACKGROUND

In speech coding systems used for conversational speech it is common to use discontinuous transmission (DTX) to increase the efficiency of the encoding. The reason is that conversational speech contains large amounts of pauses embedded in the speech, e.g.
while one person is talking the other one is listening. So with DTX the speech encoder is only active about 50 percent of the time on average and the rest can be encoded using comfort noise. Comfort noise is an artificial noise generated in the decoder side and only resembles the characteristics of the noise on the encoder side and therefore requires less bandwidth. Some example codecs that have this feature are the AMR NB (Adaptive Multi-Rate Narrowband) and EVRC (Enhanced Variable Rate CODEC). Note AMR NB uses DTX and EVRC uses variable rate (VBR), where a Rate Determination Algorithm (RDA) decides which data rate to use for each frame, based on a VAD (voice activity detection) decision.
For high quality DTX operation, i.e. without degraded speech quality, it is important to detect the periods of speech in the input signal this is done by the Voice Activity Detector (VAD), which is used in both for DTX and RDA. It should be noted that speech is also referred to as voice. FIG. 1 shows an overview block diagram of a generalized VAD 180, which takes the input signal 100, divided into data frames, 5-30 ms depending on the implementation, as input and produces VAD decisions as output 160. I.e. a VAD decision 160 is a decision for each frame whether the frame contains speech or noise). The generic VAD 180 comprises a background estimator 130 which provides sub-band energy estimates and a feature extractor 120 providing the feature sub-band energy. For each frame, the generic VAD 180 calculates features and to identify active frames the feature(s) for the current frame are compared with an estimate of how the feature “looks” for the background signal.
A primary decision, “vad_prim” 150, is made by a primary voice activity detector 140 and is basically just a comparison of the features for the current frame and the background features estimated from previous input frames, where a difference larger than a threshold causes an active primary decision. A hangover addition block 170 is used to extend the primary decision based on past primary decisions to form the final decision, “vad_flag” 160. The reason for using hangover is mainly to reduce/remove the risk of mid speech and backend clipping of speech bursts. However, the hangover can also be used to avoid clipping in music passages. An operation controller 110 may adjust the threshold(s) for the primary detector and the length of the hangover according to the characteristics of the input signal.
There are a number of different features that can be used for VAD detection. The most basic feature is to look just at the frame energy and compare this with a threshold to decide if the frame is speech or not. This scheme works reasonably well for conditions where the SNR is high but not for low SNR, (signal-to-noise ratio) cases. In low SNR cases other metrics comparing the characteristics of the speech and noise signals must be used instead. For real-time implementations an additional requirement on VAD functionality is computational complexity and this is reflected in the frequent representation of subband SNR VADs in standard codecs, e.g. AMR NB, AMR WB (Adaptive Multi-Rate Wideband), EVRC, and G.718 (ITU-T recommendation embedded scalable speech and audio codec). These example codecs also use threshold adaptation in various forms. In general background and speech level estimates, which also are used for SNR estimation, can be based on decision feedback or an independent secondary VAD for the update. In either case VAD=0 is to be interpreted that the input signal is estimated as noise and VAD=1 that the input signal is estimated as speech. Another option for level estimates is to use minimum and maximum input energy to track the background and speech respectively.
For the variability of the input noise it is possible to calculate the variance of prior frames over a sliding time window. Another solution is to monitor the amount of negative input SNR. This is however based on the assumption that negative SNR only arises due to variations in the input noise. Sliding time window of prior frames implies that one creates a buffer with variables of interest (frame energy or sub-band energies) for a specified number of prior frames. As new frames arrive the buffer is updated by removing the oldest values from the buffer and inserting the newest.
Non-stationary noise can be difficult for all VADs, especially under low SNR conditions, which results in a higher VAD activity compared to the actual speech and reduced capacity from a system perspective. I.e. frames not comprising speech are identified to comprise speech. Of the non-stationary noise, the most difficult noise for the VADs to handle is babble noise and the reason is that its characteristics are relatively close to the speech signal that the VAD is designed to detect. Babble noise is usually characterized both by the SNR relative to the speech level of the foreground speaker and the number of background talkers, where a common definition as used in subjective evaluations is that babble should have 40 or more background speakers. The basic motivation being that for babble it should not be possible to follow any of the included speakers in the babble noise implying that non of the babble speakers shall become intelligible. It should also be noted that with an increasing number of talkers in the babble noise, the babble noise becomes more stationary. With only one (or a few) speaker(s) in the background they are usually called interfering talker(s). A further problematic issue is that babble noise may have spectral variation characteristics very similar to some music pieces that the VAD algorithm shall not suppress.
In the previously mentioned VAD solutions AMR NB/WB, EVRC and G.718 there are varying degrees of problem with babble noise in some cases already at reasonable SNRs (20 dB). The result is that the assumed capacity gain from using DTX can not be realized. In real mobile phone systems it has also been noted that it may not be enough to require reasonable DTX/VBR operation in 15-20 dB SNR. If possible one would desire reasonable DTX/VBR operation down to 5 dB even 0 dB depending on the noise type. For low frequency background noise an SNR gain of 10-15 dB can be achieved for the VAD functionality just by highpass filtering the signal before VAD analysis. Due to the similarity of babble to speech the gain from highpass filtering the input signal is very low.
For VADs based on subband SNR principle when the input signal is divided in a plurality of sub-bands, and the SNR is determined for each band, it has been shown that the introduction of a non-linearity in the subband SNR calculation, called significance thresholds, can improve VAD performance for conditions with non-stationary noise such as babble noise and office background noise.
It has also been noted that the G.718 shows problems with tracking the background noise for some types of input noise, including babble type noise. This causes problems with the VAD as accurate background estimates are essential for any type of VAD comparing current input with an estimated background.
From a quality point of view it is better to use a failsafe VAD, meaning that when in doubt it is better for the VAD to signal speech input than noise input and thereby allowing for a large amount of extra activity. This may, from a system capacity point view, be acceptable as long as only a few of the users are in situations with non-stationary background noise. However, with an increasing number of users in non-stationary environments the usage of failsafe VAD may cause significant loss of system capacity. It is therefore becoming important to work on pushing the boundary between failsafe and normal VAD operation so that a larger class of non-stationary environments are handled using normal VAD operation.
Though the usage of significance thresholds improving VAD performance it has been noted that it may also cause occasional speech clippings, mainly front end clippings of low SNR unvoiced sounds.
As was shown in above it is already common to use some form of threshold adaptation. From prior art there are examples where
VAD _thr =f(N _tot),
VAD _thr =f(N _tot ,E _sp), or
VAD _thr =f(SNR,N _v)
Where: VAD_thris the VAD threshold, N_totis the estimated noise energy, E_spis the estimated speech energy, SNR is the estimated signal to noise ratio, and N_vis the estimated noise variations based on negative SNR.

SUMMARY

The object of embodiments of the present invention is to provide a mechanism that provides a VAD with improved performance.
This is achieved according to one embodiment by letting a VAD threshold VAD_thrbe a function of a total noise energy N_tot, an SNR estimate and N_varwherein N_varindicates the energy variation between different frames.
According to one aspect of embodiments of the present invention a method in a voice activity detector for determining whether frames of an input signal comprise voice is provided. In the method, a frame of the input signal is received and a first SNR of the received frame is determined. The determined first SNR is then compared with an adaptive threshold. The adaptive threshold is at least based on total noise energy of a noise level, an estimate of a second SNR and an energy variation between different frames. Based on said comparison it is detected whether the received frame comprises voice.
According to another aspect of embodiments of the present invention a voice activity detector is provided. The voice activity detector may be a primary voice activity detector being a part of a voice activity detector for determining whether frames of an input signal comprise voice. The voice activity detector comprises an input section configured to receive a frame of the input signal. The voice activity detector further comprises a processor configured to determine a first SNR of the received frame, and to compare the determined first SNR with an adaptive threshold. The adaptive threshold is at least based on total noise energy of a noise level, an estimate of a second SNR and on energy variation between different frames. Moreover, the processor is configured to detect whether the received frame comprises voice based on said comparison.
According to a further embodiment, a further parameter referred to as E_dyn _{_} _LPis introduced and VAD_thris hence determined at least based on the total noise energy N_tot, the second SNR estimate, N_varand E_dyn _{_} _LP. E_dyn _{_} _LPis a smooth input dynamics measure indicative of energy dynamics of the received frame. In this embodiment, the adaptive threshold VAD_thr=f(N_tot,SNR, N_var,E_dyn _{_} _LP)
An advantage by using N_varor N_varand E_dyn _{_} _LPwhen selecting VAD_thr, is that it is possible to avoid increasing the VAD_thralthough the background noise is non-stationary. Thus, a more reliable VAD threshold adaptation function can be achieved. With new combinations of features it is possible to better characterize the input noise and to adjust the threshold accordingly.
With the improved VAD threshold adaptation according to embodiments of the present invention, it is possible to achieve considerable improvement in handling of non-stationary background noise, and babble noise in particular, while maintaining the quality for speech input and for music type input in cases where music segments are similar to spectral variations found in babble noise.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a generic Voice Activity Detector (VAD) with background estimation according to prior art.

FIG. 2 illustrates schematically a voice activity detector according to embodiments of the present invention.

FIG. 3 is a flowchart of a method according to embodiments of the present invention.

DETAILED DESCRIPTION

The embodiments of the present invention will be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. The embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In the drawings, like reference signs refer to like elements.
Moreover, those skilled in the art will appreciate that the means and functions explained herein below may be implemented using software functioning in conjunction with a programmed microprocessor or general purpose computer, and/or using an application specific integrated circuit (ASIC). It will also be appreciated that while the current embodiments are primarily described in the form of methods and devices, the embodiments may also be embodied in a computer program product as well as a system comprising a computer processor and a memory coupled to the processor, wherein the memory is encoded with one or more programs that may perform the functions disclosed herein.
For a subband SNR based VAD even moderate variations of input energy can cause false positive decisions for the VAD, i.e. the VAD indicates speech when the input is only noise. Subband SNR based VAD implies that the SNR is determined for each subband and a combined SNR is determined based on those SNRs. The combined SNR, may be a sum of all SNRs on different subbands. This kind of sensitivity in a VAD is good for speech quality as the probability of missing a speech segment is small. However, since these types of energy variations are typical in non-stationary noise, e.g. babble noise, they will cause excessive VAD activity. Thus in the embodiments of the present invention an improved adaptive threshold for voice activity detection is introduced.
In a first embodiment a first additional feature N_varis introduced which indicates the noise variation which is an improved estimator of variability of frame energy for noise input. This feature is used as a variable when the improved adaptive threshold is determined. A first
SNR, which may be a combined SNR created by different subband SNRs, is compared with the improved adaptive threshold to determine whether a received frame comprises speech or background noise. Hence in the first embodiment, the threshold adaptation for a VAD is made as a function of the features: noise energy N_tot, a second SNR estimate SNR (corresponding to lp_snr in the pseudo code below), and the first additional feature N_var. The noise energy N_totis an estimate of the noise level based on the total energy of the subband energies in the background estimate when VAD=0 and the second SNR estimate is a long term SNR estimate. Long term SNR estimate implies that the SNR is measured over a longer time than a short term SNR estimate.
In a second embodiment, a second additional feature E_dyn _{_} _LPis introduced. E_dyn _{_} _LPis a smooth input dynamics measure. Accordingly, the threshold adaptation for subbands SNR VAD is made as a function of the features, noise energy N_tot, a second SNR estimate SNR, and the new feature noise variation N_var. Further, if the second SNR estimate is lower than the smooth input dynamics measure, E_dyn _{_} _LP, the second SNR is adjusted upwards before it is used for determining the adaptive threshold.
By determining the adaptive threshold for making the VAD decision based on these variables, it is possible to improve the threshold adaptation with better control of when to use a highly sensitivity VAD and when the sensitivity has to be reduced. The first additional noise variation feature is mainly use to adjust the sensitivity depending on the non-stationary of the input background signal, while the second additional smooth input dynamics feature is used to adjust the second SNR estimate used for the threshold adaptation.
From a system perspective the ability to reduce the sensitivity for non-stationary noise will result in a reduction in excessive activity for non-stationary noise (e.g. babble noise) while maintaining the high quality of encoded speech for clean and stationary noise in high SNR.
In the following the features used to calculate the adaptive threshold according to the embodiments are explained:
According to the second embodiment, there are two additional features used for determining the improved adaptive threshold. The first additional feature is a noise variation estimator N_var.
N_varis a noise variation estimate created by comparing the input energy which is the sum of all subband energies of a current frame and the energy of a previous frame the background. Hence the noise variation estimate is based on VAD decisions for the previous frame. When VAD=0 it is assumed that the input consists of background noise only so to estimate the variability the new metric is formed as a non-linear function of the frame to frame energy difference.
Two input energy trackers, E_tot _{_} ₁, E_tot _{_} _h, one from below and one from above are used to create the second additional feature E_dyn _{_} _LPwhich indicates smooth input energy dynamics.
E_tot _{_} _lis the energy tracker from below. For each frame the value is incremented by a small constant value. If this new value is larger than the current frame energy the frame energy is used as the new value.
E_tot _{_} _his the energy tracker from above. For each frame the value is decremented by a small constant value if this new value is smaller than the current frame energy the frame energy is used as the new value.
E_dyn _{_} _LPindicating smooth input dynamics serves as a long term estimate of the input signal dynamics, i.e. an estimate of the difference between speech and noise energy. It is based only on the input energy of each frame. It uses the energy tracker from above, the high/max energy tracker, referred to as E_tot _{_} _hand the one from below, the low/min energy tracker referred to as E_tot _{_} _l. E_dyn _{_} _LPis then formed as a smoothed value of the difference between the high and low energy trackers.
For each frame the difference between the energy trackers is used as input to a low pass filter.
E _dyn _{_} _LP=(1−α)E _dyn _{_} _LP+α(E _tot _{_} _h −E _tot _{_} _l)
First the absolute value of the frame energy difference is calculated based on current and last frame. If VAD=0 the current variation estimate is then first decreased using as small constant value.
If the current energy difference is larger than the current variation estimate the new value replaces the current variation estimate with the condition that the current variation estimate may not increase beyond a fixed constant for each frame.
Turning now to FIG. 2, showing a voice activity detector 200 wherein the embodiments of the present invention may be implemented. In the embodiments the voice activity detector 200 is exemplified by a primary voice activity detector. The voice activity detector 200 comprises an input section 202 for receiving input signals and an output section 205 for outputting the voice activity detection decision. Furthermore, a processor 203 is comprised in the VAD and a memory 204 may also be comprised in the voice activity detector 200. The memory 204 may store software code portions and history information regarding previous noise and speech levels. The processor 203 may include one or more processing units.
When the VAD is exemplified by a primary VAD, input signals 201 to the input section 202 of the primary voice activity detector are, sub-band energy estimates of the current input frame, sub-band energy estimates from the background estimator shown in FIG. 1, long term noise level, long term speech level for long term SNR calculation and long term noise level variation from the feature extractor 120 of FIG. 1. The long term speech and noise levels are estimated using the VAD flag. When VAD==0 the long term noise estimate is updated using smoothing of the total noise, N_tot, value. Similarly a long term speech level is updated when VAD==1 using smoothing of E_tot(total energy of the input frame) based on the total subband energy of the current input frame.
Hence the voice activity detector 200 comprises a processor 203 configured to compare a first SNR of the received frames and an adaptive threshold to make the VAD decision. The processor 203 is according to one embodiment configured to determine the first SNR (snr_sum) and the first SNR is formed by the input subband energy levels divided by background energy levels. Thus the first SNR used to determine VAD activity is a combined SNR created by different subband SNRs, e.g. by adding the different subband SNRs.
The adaptive threshold is a function of the features: noise energy N_tot, an estimate of a second SNR (SNR) and the first additional feature N_varin a first embodiment. In a second embodiment E_dyn _{_} _lpis also taken into account when determining the adaptive threshold. The second SNR is in the exemplified embodiments a long term SNR (lp_snr) measured over a plurality of frames.
Further, the processor 203 is configured to detect whether the received frame comprises voice based on the comparison between the first SNR and the adaptive threshold. This decision is referred to as a primary decision, vad_prim 206 and is sent to a hangover addition via the output section 205. The VAD can then use the vad_prim 206 when making the final VAD decision.
According to a further embodiment, the processor 203 is configured to adjust the estimate of the second SNR of the received frame upwards if the current estimate of the second SNR is lower than a smooth input dynamics measure, wherein the smooth input dynamics measure is indicative of energy dynamics of the received frame.
A detailed description of embodiments will follow. In this description the G.718 codec (further explained in ITU-T, “Frame error robust narrowband and wideband embedded variable bit-rate coding of speech and audio from 8-32 kbit/s”, ITU-T G.718, June 2008) is used as the basis for this description.

TABLE 1

Notation in this description	Description of parameter

snr_sum	SNR per frame
snr[i]	SNR per critical band i
0.2 * enr0[i] + 0.4 * pt1++ + 0.4 *	Average energy per critical band i
pt2++
lp_speech	Long term speech level
lp_noise	Long term noise level
lp_snr	Long term SNR
hangover_short	Hangover counter
frame	Frame counter for initiation
vad	SAD decision flag for current frame
totalNoise	Noise level estimate for current
	frame (in dB) N_tot.
Etot	Total energy of Input frame (in dB)
	E_t
thr1	VAD Threshold (in dB)

According to one aspect of the present invention a method in a voice activity detector 200 for determining whether frames of an input signal comprise voice is provided as illustrated in the flowchart of FIG. 3. The method comprises in a first step 301 receiving a frame of the input signal and determining 302 a first SNR of the received frame. The first SNR may be a combined SNR of the different subbands, e.g. a sum of the SNRs of the different subbands. The determined first SNR is compared 303 with an adaptive threshold, wherein the adaptive threshold is at least based on total noise energy N_tot, an estimate of a second SNR SNR (lp_snr), and the first additional feature N_varin a first embodiment. In the second embodiment E_dyn _{_} _LPis also taken into account when determining the adaptive threshold. The second SNR is in the exemplified embodiments a long term SNR calculated over a plurality of frames. Further, it is detected 304 whether the received frame comprises voice based on said comparison.
According to embodiments of the invention the determined first SNR of the received frame is a combined SNR of different subbands of the received frame. The combined first SNR, also referred to as snr_sum according to the table above, may be calculated as:


	snr_sum = 0;
	for (b=0;b<20;b++) {
	snr[b] = ( 0.2 * enr0[b] + 0.4 * pt1++ + 0.4 * pt2++) / bckr[b];
	if (snr[i] < 1.0) {
	snr[i] = 1.0;
	}
	snr_sum = snr_sum + snr[i];
	}
	snr_sum = 10 * log10(snr_sum);

Before the threshold can be applied to the snr sum exemplified above, the threshold must be calculated based on the current input conditions and long term SNR. It should be noted that in this example, the threshold adaptation is only dependent on long term SNR (lp_snr) according to prior art.


	lp_snr = lp_speech −lp_noise;
	if (lp_snr < 35) {
	thr1 = 0.41287 * lp_snr + 13.259625;
	hangover_short = 2;
	if (lp_snr >= 15)
	hangover_short = 1;
	}
	else {
	thr1 = 1.0333 * lp_snr − 18;
	}

The long term speech and noise levels are calculated as follows:


	if (frame < 5) {
	lp_noise = totalNoise;
	tmp = lp_noise+10;
	if (lp_speech < tmp)
	lp_speech =tmp;
	}
	else {
	if (vad == 0)
	lp_noise = 0.99 * lp_noise + 0.01 * totalNoise;
	else
	lp_speech = 0.99 * lp_speech + 0.01 * Etot;
	}
	Initiation of long term speech energy and frame counter
	lp_speech = 45.0;
	frame=0;

The embodiments of the present invention use an improved logic for the VAD threshold adaptation which is based on both features used in prior art and additional features introduced with the embodiments of the invention. In the following an example implementation is given as a modification of the pseudo code for the above described basis.
It should be noted that there are a number of constants for the thresholds and system parameters used in this description which are only examples. However, further tuning with a variety of input signals is also within the scope of the embodiments of the present invention.
As mentioned above, the second embodiment introduces the new features: the first additional feature noise variation N_varand the second additional feature E_dyn _{_} _LPwhich is indicative of smooth input energy dynamics. In the pseudo code below, N_varis denoted Etot_v_h and E_dyn _{_} _LPis denoted sign_dyn_lp. The signal dynamics sign_dyn_lp is estimated by tracking the input energy from below Etot_l and above Etot_h. The difference is then used as input to a low passfilter to get the smoothed signal dynamics measure sign_dyn_lp. In order to further clarify the embodiments, the pseudo code written with bold characters relates to the new features of the embodiments while the other pseudo code relates to prior art.


	Etot_1 += 0.05;
	if (Etot < Etot_1)
	Etot_1 = Etot;
	Etot_h −= 0.05;
	if (Etot > Etot_h)
	Etot_h = Etot;
	sign_dyn_lp = 0.1 * (Etot_h − Etot_1) + 0.9 sign_dyn_lp;

The noise variance estimate is made from the input total energy (in log domain) using Etot_v which measures the absolute energy variation between frames, i.e. the absolute value of the instantaneous energy variation between frames. Note that the feature Etot_v_h is limited to only increase a maximum of a small constant value 0.2 for each frame. Further the variable Etot_last is just the energy level of the previous frame. It is also possible to use the last frame where vad_flag==0 to avoid large energy drops at the end of speech bursts according to an embodiment of the present invention.


	Etot_v = fabs(Etot_last − Etot);
	If (vad_flag == 0) {
	Etot_v_h = Etot_v_h − 0.01;
	if (Etot_v > Etot_v_h)
	Etot_v_h = (Etot_v − Etot_v_h) > 0.2 ? Etot_v_h + 0.2 :
	Etot_v;
	}
	Etot_last = Etot;

Etot_v_h also denoted N_varis a feature providing a conservative estimation of the level variations between frames, which is used to characterize the input signal. Hence, Etot_v_h describes an estimate of envelope tracking of energy variations frame to frame for noise frames with limitations on how quick the estimate may increase.
According to an embodiment, the average SNR per frame is enhanced with the use of significance thresholds which can be implemented in the following way:


	snr_sum = 0
	for (i=0;i<20;i++) {
	snr[i] = ( 0.2 * enr0[i] + 0.4 * pt1++ + 0.4 * pt2++) / bckr[i];
	if (snr[i] < 0.1) {
	snr[i] = 0.1;
	}
	if (snr[i] >= 2.5)
	snr_sum = snr_sum + snr[i];
	else {
	snr[i] = 0.1;
	snr_sum= snr_sum + 0.1;
	}
	}
	snr_sum = 10 * log10(snr_sum);

In this implementation also the estimates of long term speech and noise levels have been improved for more accurate levels. Also the initiation of speech level has been improved.


	Initiation:
	lp_speech = 20.0;
	Estimation of long term speech and noise level
	if (frame < 5) {
	lp_noise = totalNoise;
	tmp = lp_noise+10;
	if (lp_speech < tmp)
	lp_speech =tmp;
	}
	else {
	lp_noise = 0.99 * lp_noise + 0.01 * totalNoise;
	if (vad == 1) {
	if (Etot >= lp_speech)
	lp_speech = 0.7 * lp_speech + 0.3 * Etot;
	else
	lp_speech = 0.99 * lp_speech + 0.01 * Etot;
	}
	else if (Etot_h < lp_speech)
	lp_speech = 0.7 * lp_speech + 0.3 * Etot_h;

Two major modifications are introduced by embodiments of the present invention. A first modification is that the long term noise level is always updated. This is motivated as the background noise estimate can be updated downwards even if VAD=1. A second modification is that the long term speech level estimate now allows for quicker tracking in case of increasing levels and the quicker tracking is also allowed for downwards adjustment but only if the lp_speech estimate is higher than the Etot_h which is a VAD decision independent speech level estimate.
With this new logic for long term level estimates according to the embodiments, the basic assumption with only noise input is that the SNR is low. However with the faster tracking input speech will quickly get a more correct long term level estimates and there by a better SNR estimate.
The improved logic for VAD threshold adaptation is based on both existing and new features. The existing feature SNR (lp_snr) has been complemented with the new features for input noise variance (Etot_v_h) and input noise level (lp_noise) as shown in the following example implementation, note that both the long term speech and noise level estimates (lp_speech,lp_noise) also have been improved as described above.


lp_snr = lp_speech −lp_noise;
if (lp_snr < sign_dyn_lp)
lp_snr = lp_snr + 1;
if (lp_snr > sign_dyn_lp)
lp_snr = sign_dyn_lp;
*thr1 = 0.10 lp*_snr + 10.0 + 0.55 Etot_v_h + −0.15 * (lp_noise −
20.0);

The first block of the pseudo code above shows how the smoothed input energy dynamics measure sign_dyn_lp is used. If the current SNR estimate is lower than the smoothed input energy dynamics measure sign_dyn_lp the used SNR is increased by a constant value. However, the modified SNR value can not be larger than the smoothed input energy dynamics measure sign_dyn_lp.
The second block of the pseudo code above shows the improved VAD threshold adaptation based on the new features Etot_v_h and lp_snr which is dependent on sign_dyn_lp that are used for the threshold adaptation.
The shown results are based on evaluation of mixtures of clean speech (level −26 dBov) with background noise of different types and SNRs. For clean speech input the activity it is possible to use a fixed threshold of the frame energy to get an activity value of the speech only without any hangover and in this case it was 51%.
Table 2 shows initial evaluation results, in descending order of improvement


			Activity
			using the
Noise type		Activity for	combined	Activity
(with number of	SNR	reference	inventions	reduction
talkers for babble)	(dB)	(%)	(%)	(%)

Babble 128	5	84	52	32
Babble 64	5	90	61	31
Babble 32	20	91	61	30
Babble 64	15	75	54	21
Car	5	66	50	16
Babble 64	20	57	52	5
Car	15	50	50	0
Babble 128	15	47	49	−2

As can be seen from the results the combined modifications shows considerable gains in lowered activity for many of the mixtures with babble noise and for the 5 dB car noise.
There is also one example, babble noise with 128 talkers and an 15 dB SNR, where the evaluation shows an activity increase, it should be noted that 2% is not that large an increase and for both the reference and the combined modification the activity is below the clean speech 51%. So in this case the increase in activity for the combined modification may actually improve subjective quality of the mixed content in comparison with the reference.
There are also cases where there is only a small or no improvement, however these are for reasonable SNR (15 and 20) and for these operating points even a much simpler energy based VAD would give reasonable performance.
Of the evaluated combinations in the table the reference only gives reasonable activity for Car and Babble 128 at 15 dB SNR. For babble 64 the reference is on the boundary for reasonable operation with an activity of 57% for a 51% clean input.
This can be compared with the embodiments that are capable of handling six of the eight evaluated combinations. The ones where the activity has reached 61% activity are babble 64 at 5 dB SNR and Babble 32 at 20 dB SNR, here it should be pointed out that the improvement over the reference are in the order of 30% units.
The combined inventions also show improvements for Car noise at low SNR, this is illustrated by the improvement for Car noise mixture at 5 dB SNR where the reference generates 66% activity while the activity for combined inventions is 50%.
Modifications and other embodiments of the disclosed invention will come to mind to one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the embodiments of the invention are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of this disclosure. Although specific terms may be employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims

1. (canceled)

2. A computer-implemented method, in a voice activity detector, for determining whether frames of an input signal comprise voice comprising:

receiving a frame of the input signal;

determining a first signal-to-noise-ratio (SNR) of the received frame by:

obtaining a plurality of subband SNR values of the received frame by dividing energy levels of each of a plurality of subbands of the received frame by its respective subband background energy;

applying subband specific significance thresholds to each of the plurality of subband SNR values of the received frame through selectively adjusting the plurality of subband SNR values using a non-linear function; and

obtaining the first SNR by summing together all non-linearly adjusted SNR values of each of the plurality of subbands;

comparing the determined first SNR with an adaptive threshold,

wherein the adaptive threshold is at least based on an estimate of a second SNR and an estimate of energy variation between different frames of the input signal,

wherein the second SNR is a long-term SNR, and

wherein the estimate of energy variation between different frames has limits on how quickly the estimate increases such that the estimate may not increase beyond a fixed constant for each frame; and

detecting whether the received frame comprises voice based on the comparison.

3. The method of claim 2, wherein the energy variation between different frames is the energy variation between the received frame and a last received frame which did not comprise voice.

4. The method of claim 2, wherein the second SNR is measured over a plurality of frames of the input signal.

5. The method of claim 2 wherein comparing the determined first SNR with the adaptive threshold comprises adjusting the estimate of the second SNR upwards responsive to a determination that the estimate of the second SNR is lower than a smooth input dynamics measure, wherein the smooth input dynamics measure is indicative of energy dynamics of the received frame.

6. The method of claim 5, wherein the estimate of the second SNR is adjusted upwards to a value which is less than or equal to the smooth input dynamics measure.

7. The method of claim 6, wherein the smooth input dynamics measure for the received frame comprises a high/max energy tracker, a low/min energy tracker, and a portion corresponding to a smooth input dynamics measure for prior frames.

8. The method of claim 7, wherein, prior to calculating the smooth input dynamics measure for the received frame, the low/min energy tracker is set to either the total energy of the received frame or an incremental upward adjustment of the low/min energy tracker, whichever is smaller, and

wherein, prior to calculating the smooth input dynamics measure for the received frame, the high/max energy tracker is set to either the total energy of the received frame or a decremental downward adjustment of the high/max energy tracker, whichever is greater.

9. The method of claim 7, wherein the smooth input dynamics measure is a function of a difference between the high/Max energy tracker based on a highest frame energy value over a plurality of frames and the low/mm n energy tracker based on a lowest frame energy value over the plurality of frames.

10. A voice activity detector for determining whether frames of an input signal comprise voice, the voice activity detector comprising:

an input circuit configured to receive a frame of the input signal; and

a processor configured to:

determine a first signal-to-noise-ratio (SNR) of the received frame by:

compare the determined first SNR with an adaptive threshold,

wherein the second SNR is a long-term SNR, and

detect whether the received frame comprises voice based on the comparison.

11. The voice activity detector of claim 10, wherein the energy variation between different frames is the energy variation between the received frame and a last received frame which did not comprise voice.

12. The voice activity detector of claim 10, wherein the second SNR is measured over a plurality of frames of the input signal.

13. The voice activity detector of claim 10 wherein comparing the determined first SNR with the adaptive threshold comprises adjusting the estimate of the second SNR upwards responsive to a determination that the estimate of the second SNR is lower than a smooth input dynamics measure, wherein the smooth input dynamics measure is indicative of energy dynamics of the received frame.

14. The voice activity detector of claim 13, wherein the estimate of the second SNR is adjusted upwards to a value which is less than or equal to the smooth input dynamics measure.

15. The voice activity detector of claim 13, wherein the smooth input dynamics measure for the received frame comprises a high/max energy tracker, a low/min energy tracker, and a portion corresponding to a smooth input dynamics measure for prior frames.

16. The voice activity detector of claim 15, wherein, prior to calculating the smooth input dynamics measure for the received frame, the low/mm energy tracker is set to either the total energy of the received frame or an incremental upward adjustment of the low/min energy tracker, whichever is smaller, and

wherein, prior to calculating the smooth input dynamics measure for the received frame, the high/max energy tracker is set to either the total energy of the received frame or a decremental downward adjustment of the high/max energy tracker, whichever is greater.)

17. The voice activity detector of claim 15, wherein the smooth input dynamics measure is a function of a difference between the high/max energy tracker based on a highest frame energy value over a plurality of frames and the low/min energy tracker based on a lowest frame energy value over the plurality of frames.