AU634795B2 - Digital speech coder having improved sub-sample resolution long-term predictor - Google Patents

Abstract

A digital speech coder includes a long-term filter (124) having an improved sub-sample resolution long-term predictor which allows for subsample resolution for the lag parameter L. A frame of N samples of input speech vector s(n) is applied to an adder (510). The output of the adder (510) produces the output vector b(n) for the long term filter (124). The output vector b(n) is fed back to a delayed vector generator block (530) of the long-term predictor. The nominal long-term predictor lag parameter L is also input to the delayed vector generator block (530). The long-term predictor lag parameter L can take on non-integer values, which may be multiples of one half, one third, one fourth or any other rational fraction. The delayed vector generator (530) includes a memory which holds past samples of b(n). In addition, interpolated samples of b(n) are also calculated by the delayed vector generator (530) and stored in its memory, at least one interpolated sample being calculated and stored between each past sample of b(n). The delayed vector generator (530) provides output vector q(n) to the long-term multiplier block (520), which scales the long-term predictor response by the long-term predictor coefficient beta . The scaled output beta q(n) is then applied to the adder (510) to complete the feedback loop of the recursive filter (124).

Description

OPI DATE 08/04/91 APPLN I D 59525 pCT AOJP DATE 16/05/91 PCT NUMBER PCT/US90/03625 INTERNATIONAL A'PLICAIIUN PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (51) International Patent Classification 5 (11) International Publication Number: WO 91/03790 G06F 15/31, 15/347, 7/00 Al G06F 7/38, GIOL 3/02 (43) International Publication Date: 21 March 1991 (21.03.91) (21) International Application Number: PCT/US90/03625 (81) Designated States: AT (European patent), AU, BE (European patent), CA, CH (European patent), DE (Euro- (22) International Filing Date: 25 June 1990 (25.06.90) pean patent)*, DK (European patent), ES (European patent), FR (European patent), GB (European patent), IT (European patent), JP, LU (European patent), NL (Eu- Priority data: ropean patent), SE (European patent).

402,206 1 September 1989 (01.09.89) US Published (71) Applicant: MOTOROLA, INC. [US/US]; 1303 East Al- With international search report.

gonquin Road, Schaumburg, IL 60196 Before the expiration of the time limit for amending the claims and to be republished in the event of the receipt of (72) Inventors: GERSON, Ira, Alan 1120 Nottingham Lane, amendments.

Hoffman Estates, IL 60195 JASIUK, Mark, A.; 6611 N. Hiawatha Avenue, Chicago, IL 60646 (US).

(74) Agents: PARMELEE, Steven, G. et al.; Motorola, Inc., Intellectual Property Dept., 1303 East Algonquin Road, Schaumburg, IL 60196 (US).

(54)Title: DIGITAL SPEECH CODER HAVING IMPROVED SUB-SAMPLE RESOLUTION LONG-TERM PREDIC-

TOR

510 124 s(n) L bn) qn)b(n) S(n)

DELAYED

x

VECTOR

GENERATOR

WITH MEMORY 520 530 (57) Abstract A digital speech coder includes a long-term filter (124) having an improved sub-sample resolution long-term predictor which allows for subsample resolution for the lag parameter L. A frame of N samples of input speech vector s(n) is applied to an adder (510). The output of the adder (510) produces the output vector b(n) for the long term filter (124). The output vector b(n) is fed back to a delayed vector generator block (530) of the long-term predictor. The nominal long-term predictor lag parameter L is also input to the delayed vector generator block (530). The long-term predictor lag parameter L can take on non-integer values, which may be multiples of one half, one third, one fourth or any other rational fraction. The delayed vector generator (530) includes a memory which holds past samples of In addition, interpolated samples of b(n) are also calculated by the delayed vector generator (530) and stored in its memory, at least one interpolated sample being calculated and stored between each past sample of The delayed vector generator (530) provides output vector q(n) to the long-term multiplier block (520), which scales the long-term predictor response by the long-term predictor coefficient p. The scaled output Pq(n) is then applied to the adder (510) to complete the feedback loop of the recursive filter (124).

See back of page WO 91/03790 PCT/US90/03625 DIGITAL SPEECH CODER HAVING IMPROVED SUB-SAMPLE RESOLUTION LONG-TERM PREDICTOR The present invention generally relates to digital speech coding at low bit rates, and more particularly, is directed to an improved method for determining long-term predictor output responses for code-excited linear prediction speech coders.

Code-excited linear prediction (CELP) is a speech coding technique which has the potential of producing high quality synthesized speech at low bit rates, 4.8 to 9.6 kilobits-persecond (kbps). This class of speech coding, also known as vectorexcited linear prediction or stochastic coding, will most likely be used in numerous speech communications and speech synthesis applications. CELP may prove to be particularly applicable to digital speech encryption and digital radiotelephone communication systems wherein speech quality, data rate, size, and cost are significant issues.

The term "code-excited" or "vector-excited" is derived from the fact that the excitation sequence for the speech coder is vector quantized, a single codeword is used to represent a sequence, or vector, of excitation samples. In this way, data rates of less than one bit per sample are possible for coding the excitation sequence. The stored excitation code vectors generally consist of independent random white Gaussian sequences. One code vector from the codebook is chosen to represent each block of N excitation samples. Each stored code vector is represented by a codeword, 7 C U A 9 x WO 91/03790 PCT/US90/03625 the address of the code vector memory location. It is this codeword that is subsequently sent over a communications channel to the speech synthesizer to reconstruct the speech frame at the receiver. See M.R. Schroeder and B.S. Atal, "Code-Excited Linear Prediction (CELP): High-Quality Speech at Very Low Bit Rates", Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vol. 3, pp.

937-40, March 1985, for a more detailed explanation of CELP.

In a CELP speech coder, the excitation code vector from the 1 0 codebook is applied to two time-varying linear filters which model the characteristics of the input speech signal. The first filter includes a long-term predictor in its feedback loop, which has a long delay, 2 to 15 milliseconds, used to introduce the pitch periodicity of voiced speech. The second filter includes a shortterm predictor in its feedback loop, which has a short delay, i.e., less than 2 msec, used to introduce a spectral envelope or format structure. For each frame of speech, the speech coder applies each individual code vector to the filters to generate a reconstructed speech signal, and compares the original input speech signal to the reconstructed signal to create an error signal. The error signal is then weighted by passing it through a weighting filter having a response based on human auditory perception. The optimum excitation signal is determined by selecting the code vector which produces the weighted error signal having the minimum energy for the current frame. The codeword for the optimum code vector is then transmitted over a communications channel.

In a CELP speech synthesizer, the codeword received from the channel is used to address the codebook of excitation vectors.

The single code vector is then multiplied by a gain factor, and filtered by the long-term and short-term filters to obtain a reconstructed speech vector. The gain factor and the predictor parameters are also obtained from the channael. It has been found that a better quality synthesized signal can be generated if WO 91/03790 PCT/US90/03625 the actual parameter used by the synthesizer are used in the analysis stage, thus minimizing the quantization errors. Hence, the use of these synthesis parameters in the CELP speech analysis stage to produce higher quality speech is referred to as analysis-by-synthesis speech coding.

The short-term predictor attempts to predict the current output sample s(n) by a linear combination of the immediately preceding output samples according to the equation: s(n) ais(n-1) a2s(n-2) aps(n-p) +e(n) where p is the order of the short-term predictor, and e(n) is the prediction residual, that part of s(n) that cannot be represented by the weighted sum of p previous samples. The predictor order p typically ranges from 8 to 12, assuming an 8 kiloHertz (kHz) sampling rate. The weights al, ag, ap, in this equation are called the predictor coefficients. The short-term predictor coefficients are determined f--a the speech signal using conventional linear predictive coaing (LPC) techniques.

The output response of the short-term filter may be expressed in Z-transform notation as: 1 A(z) p 1-1 aiz-i i=l Refer to the article entitled "Predictive Coding of Speech at Low Bit Rates", IEEE Trans. Commun., Vol. COM-30, pp. 600-14, April 1982, by B.S. Atal, for further discussion of the short-term filter parameters.

The long-term filter, on the other hand, must predict the next output sample from preceding samples that extend over a much longer time period. If only a single past sample is used in WO 91/03790 PCT/ US90/03625 the predictor, then the predictor is a single-tap predictor.

Typically, one to three taps are used. The output response for a long-term filter incorporating a single-tap, long-term predictor is given in z-transform notation as:.

1 B(z) 1 13z-L Note that this output response is a function of only the delay or lag L of the filter and the filter coefficient B. For voiced speech, the lag L would typically be the pitch period of the speech, or a multiple of it. At a sampling rate of 8 kHz, a suitable range for the lag L would be between 16 and 143, which corresponds to a pitch range between 56 and 500 Hz.

The long-term predictor lag L and long-term predictor 1 5 coefficient B can be determined from either an open-loop or a closed loop configuration. Using the open-loop configuration, the lag L and coefficient B are computed from the input signal (or its residual) directly. In the closed loop configuration, the lag-L, and the coefficient B are computed at the frame rate from coded data representing the past output of the long-term filter and the input speech signal. In using the coded data, the long-term predictor lag determination is based on the actual long-term filter state that will exist at the synthesizer. Hence, the closed-loop configuration gives better performance than the open-loop method, since the pitch filter itself is would be contributing to the optimization of the error signal. Moreover, a single-tap predictor works very well in, the closed-loop configuration.

Using the closed-loop configuration, the long-term filter output response b(n) is determined from only past output samples from the long-term filter, and from the current input speech samples s(n) according to the equation: b(n) s(n) B b(n-L) This technique is straightforward for pitch lags L which are greater than the frame length N, when L N, since the term WO 91/03790 PCT/US90/03625 b(n-L) will always represent a past sample for all sample numbers n, 0 n N-1. Furthermore, in the case of L N, the excitation gain factor and the long-term predictor coefficient B can be simultaneously optimized for given values of lag L and codeword i. It has been found that this joint optimization technique yields a noticeable improvement in speech quality.

If, however, long-term predictor lags L of less than the frame length N must be accommodated, the closed-loop approach fails. This problem can readily occur in the case of high-pitched female speech. For example, a female voice corresponding to a pitch frequency of 250 Hz may require a long-term predictor lag L equal to 4 milliseconds (msec). A pitch of 250 Hz at an 8 kHz sampling rate corresponds to a long-term predictor lag L of 32 samples. It is not desirable, however, to employ frame length N 1 5 of less than 4 msec, since the CELP excitation vector can be coded more efficiently when longer frame lengths are used.

Accordingly, utilizing a frame length time of 7.5 msec at a sampling rate of 8 kHz, the frame length N would be equal to samples. This means only 32 past samples would be available to predict the next 60 samples of the frame. hence, if the long-term predictor lag L is less than the frame length N, only L past samples of the required N samples are defined.

Several alternative approaches have been taken in the prior art to address the problem of pitch lags L being less than frame length N. In attempting to jointly optimize the long-term predictor lag L and coefficient B, the first approach would be to attempt to solve the equations directly, assuming no excitation signal to present. This approach is explained in the article entitled "Regular-Pulse Excitation A Novel Approach to Effective and Efficient Multipulse Coding of Speech" by Kroon, et al., IEEE Transactions on Acoustics, Speech, and Signal Processing, Vol.

ASSP 34, No. 5, October 1986, pp. 1054-1063. However, in following this approach, a nonlinear equation in the single parameter B must be solved. The solution of the quadratic or WO 91/03790 PCT/US90/03625 cubic in 13 aust be solved. The solution of the quadratic or cubic in 13 is computationally impractical. Moreover, jointly optimizing the coefficient 13 with the gain factor 7 is still not possible with this approach.

A second solution, that of limiting the long-term predictor delay L to be greater than the frame length N, is proposed by Singhal and Atal in the article "Improving Performance of Multi- Pulse LPC Coders at Low Bit Rates", Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 1, March 19-21, 1984, pp. 1.3.1-1.3.4. This artificial constraint on the pitch lag L often does not accurately represent the pitch information. Accordingly, using this approach, the voice quality is degraded for high-pitched speech.

A third solution is to reduce the size of the frame length N.

With a shorter frame length, the long-term predictor lag L can always be determined from past samples. This approach, however, suffers from a severe bit rate penalty. With a shorter frame length, a greater number of long-term predictor parameters and excitation vectors must be coded, and accordingly, the bit rate of the channel must be greater to accommdate the extra coding.

A second problem exists for high pitch speakers. The sampling rate used in the coder places an upper limit on the performance of a single-tap pitch predictor. For example, if the pitch frequency is actually 485 Hz, the closest lag value would be 16 which corresponds to 500 Hz. This results in an error of 15 Hz for the fundamental pitch frequency which degrades voice quality. This error is multiplied for the harmonics of the pitch frequency causing further degradation.

A need, therefore, exists to provide an improved method for determining the long-term predictor lag L. The optimum solution must address both the problems of computational complexity and voice quality for the coding of high-pitched speech.

Accordingly, an object of the present invention is to provide an improved digital speech coding technique that may produce high quality speech at low bit rates.

According to an aspect of the invention, the resolution of the parameter L may be increased by allowing L to take on values which are not integers. This may be achieved by the use of interpolating filters to provide interpolated samples of the long-term predictor state. In a closed loop implementation, future samples of the long-term predictor state are not available to the interpolating filters. This problem may be circumvented by pitch-synchronously extending the long-term predictor state into the future for use by the interpolation filter. When the actual excitation samples for the next frame become available, the long-term predictor state may be updated to reflect the actual excitation samples (replacing those based on the pitch-synchronously extended samples). For example, the interpolation can be used to interpolate one sample between each existing sample thus doubling the resolution of L to half a sample. A higher interpolation factor could also be chosen, such as three or four, which would increase the resolution of L to a third or a fourth of a sample.

According to one aspect of the present invention there is provided a method of reconstructing speech from sets of speech parameters transmitted in successive frames on a communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said method comprising, for each frame, the steps of: receiving from the communications channel in each frame a set of speech parameters including codeword I and delay parameter L; generating an excitation vector having a plurality of samples in response to the codeword I; 39 7 filtering the excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to generate the filter output samples for non-integer values of delay parameter L; processing said filter output vector to produce the reconstructed speech vector; converting the reconstructed speech vector to an analog voice signal; and transducing the analog voice signal.

According to a further aspect of the present invention there is provided apparatus for reconstructing speech from sets of speech parameters transmitted in successive frames on a communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said apparatus comprising: 9

MJP

means for receiving from the communications channel in each frame a set of speech parameters including codeword I and delay parameter L; means for generating an excitation vector having a plurality of samples in response to the codeword I; means for filtering the excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to generate the filter output samples for non-integer values of delay parameter L; 7a means for processing said filter output vector to produce the reconstructed speech vector; means for converting the reconstructed speech vector to an analog voice signal; and means for transducing the analog voice signal.

According to a still further aspect of the present invention there is provided a method of encoding speech into sets of speech parameters for transmission in successive frames on a communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said method comprising, for each frame, the steps of: transducing speech to produce an analog voice signal; K.V M:jp sampling the analog voice signal a plurality of times to provide a plurality of samples forming a present speech vector; generating a delay parameter L based on the present speech vector; searching excitation vectors to determine the codeword I of the excitation vector that best matches the present speech vector by: generating excitation vectors in response to corresponding codewords; filtering each excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to generate the filter output samples for non-integer values of delay parameter L; processing the filter output vector to produce a reconstructed speech vector; comparing the reconstructed speech vector to 7b the present speech vector to determine the difference therebetween; and selecting the codeword I of the excitation vector for which the reconstructed speech vector differs the least from the present speech vector; and transmitting the selected codeword I and delay parameter L together with pre-selected speech parameters for the present speech vector on the communications channel.

According to a still further aspect of the present invention there is provided apparatus for encoding speech into sets of speech parameters for transmission in successive frames on a communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said apparatus comprising: means for transducing speech to produce an analog voice signal; means for sampling the analog voice signal a plurality of times to provide a plurality of samples forming a present speech vector; means for generating a delay parameter L based on the present speech vector; means for searchiTig excitation vectors to determine the codeword of the excitation vector that best matches the present speech vector by: generating excitation vectors in response to corresponding codewords; filtering each excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to SA generate the filter output samples for non-integer K K 3 7c T OP h, AA 1 values of delay parameter L; processing the filter output vector to produce a reconstructed speech vector; comparing the reconstructed speech vector to the present speech vector to determine the difference therebetween; and selecting the codeword I of the excitation vector for which the reconstructed speech vector differs the least from the present speech vector; and means for transmitting the selected codeword I and delay parameter L together with pre-selected speech parameters for the present speech vector on the communications channel.

A preferred embodiment of the present invention will now be described with reference to the accompanying 7d WO 91/03790 PCT/US90/03625 riP fm Des' tiLnt h The features of the present invention wich are believed to be novel are set forth with par iuly in the appended claims.

The invention, tog ih further objects and advantages thereof, st be understood by reference to the following s ni-taken- in-monj:untionz-with--th-e=aGc ayhgdrawings, in the several figures of which like-referenced numerals identify like elements, and in which: Figure 1 is a general block diagram of a code-excited linear predictive speech coder, illustrating the location of a long-term filter for use with the present invention; Figure 2A is a detailed block diagram of an embodiment of the long-term filter of Figure 1, illustrating the long-term predictor response where filter lag L is an integer; Figure 2B is a simplified diagram of a shift register which can be used to illustrate the operation of the long-term predictor in Figure 2A; Figure 2C is a detailed block diagram of another embodiment of the long-term filter of Figure 1, illustrating the long-term predictor response where filter lag L is an integer; Figure 3 is a detailed flowchart diagram illustrating the operations performed by the long-term filter of Figure 2A; Figure 4 is a general block diagram of a speech synthesizer for use in accordance with the present invention; Figure 5 is a detailed block diagram of the long-term filter of Figure 1, illustrating the sub-sample resolution long-term predictor response in accordance with the present invention; Figures 6A and 6B are detailed flowchart diagrams illustrating the operations performed by the long-term filter of Figure 5; and WO 91/03790 PCT/US90/03625 Figure 7 is a detailed block diagram of a pitch post filter for intercoupling the short term filter and D/A converter of the speech synthesizer in Figure 4.

a .1 r- t- Hm l-u t i 1, E9 ,M1..

Referring now to Figure 1, there is shown a general block diagram of code excited linear predictive speech coder 100 utilizing the long-term filter in accordance with the present invention. An acoustic input signal to be analyzed is applied to speech coder 100 at microphone 102. The input signal, typically a speech signal, is then applied to filter 104. Filter 104 generally will exhibit bandpass filter characteristics. However, if the speech bandwidth is already adequate, filter 104 may comprise a direct wire connection.

The analog speech signal from filter 104 is then converted into a sequence of N pulse samples, and the amplitude of each pulse sample is then represented by a digital code in analog-todigital converter 108, as known in the art. The sampling rate is determined by sample clock SC, which represents an kHz rate in the preferred embodiment. The sample clock SC is generated along with the frame clock FC via clock 112.

The digital output of A/D 108, which may be represented as input speech vector is then applied to coefficient analyzer 110. This input speech vector s(n) is repetitively obtained in separate frames, blocks of time, the length of which is determined by the frame clock FC. In the preferred embodiment, input speech vector 0 n N-l, represents a 7.5 msec frame containing N=60 samples, wherein each sample is represented by 12 to 16 bits of da digital code. In this embodiment, for each block of speech, a set of linear predictive coding (LPC) parameters are produced by coefficient analyzer 110 in an open-loop configuration. The short-term predictor parameters ai, longterm predictor coefficient B, nominal long-term predictor lag WO 91/03790 10- PCT. US90/03625 parameter L, weighting filter parameters WFP, and excitation gain factor Y (along with the best excitation codeword I as described later) area applied to multiplexer 150 and sent over the channel for use by the speech synthesizer. Refer to the article entitled "Predictive Coding of Speech at Low Bit Rates," EE Trans. Commun., Vol. COM-30, pp. 600-14, April 1982, by B.S.

Atal, for representative methods of generating these parameters for this embodiment. The input speech vector s(n) is also applied to subtractor 130 the function of which will subsequently be described.

Codebook ROM 120 contains a set of M excitation vectors wherein 1 e i M, each comprised of N samnples, wherein 0 n N-1. Codebook ROM 120 generates these pseudorandom excitation vectors in response to a particular one of a set of 1 5 excitation codewords i. Each of the M excitation vectors are comprised of a series of random white Gaussian samples, although other types of excitation vectors may be used with the present invention. If the excitation signal were coded at a rate of 0.2 bits per sample for each of the 60 samples, then there would be 4096 codewords i corresponding to the possible excitation vectors.

For each individual excitation vector ui(n), a reconstructed speech vector s'i(n) is generated for comparison to the input speech vector Gain block 122 scales the excitation vector ui(n) by the excitation gain factor 7 which is constant for the frame. The excitation gain factor 7 may be pre-computed by coefficient analyzer 110 and used to analyze all excitation vectors as shown in Figure 1, or may be optimized jointly with the search for the best excitation codeword I and generated by codebook search controller 140.

The scaled excitation signal 7 ui(n) is then filtered by longter filter 124 and short-term filter 126 to generate the reconstructed speech vector Filter 124 utilizes the longterm predictor parameters B and L to introduce voice periodicity, and filter 126 utilizes the short-term predictor parameters ai to WO 91/03790 11 PCT/US90/03625 introduce the spectral envelope, as described above. Long-term filter 124 will be described in detail in the following figures. Note that blocks 124 and 126 are actually recursive filters which contain the long-term predictor and short-term predictor in their respective feedback paths.

The reconstructed speech vector s'i(n) for the i-th excitation code vector is compared to the same block of the input speech vector s(n) by subtracting these two signals in subtracter 130. The difference vector ei(n) represents the difference between the original and the reconstructed blocks of speech. The difference vector is perceptually weighted by weighting filter 132, utilizing the weighting filter parameters WTP generated by coefficient analyzer 110. Refer to the preceding reference for a representative weighting filter transfer function. Perceptual 1 5 weighting accentuates those frequencies where the error is perceptually more important to the human ear, and attenuates other frequencies.

Energy calculator 134 computes the energy of the weighted difference vector and applies this error signal E i to codebook search controller 140. The search controller compares the i-th error signal for the present excitation vector ui(n) against previous error signals to determine the excitation vector producing the minimum error. The code of the i-th excitation vector having a minimum error is then output over the channel as the best excitation code I. In the alternative, search controller 140 may determine a particular codeword which provides an error signal having some predetermined criteria, such as meeting a predefined error threshold.

Figure 1 illustrates one embodiment of the invention for a code-excited linear predictive speech coder. In this embodiment, the long-term filter parameters L and B are determined in an open-loop configuration by coefficient analyzer 110. Alternatively, the long-term filter parameters can be determined in a closedloop configuration as described in the aforementioned Singhal -12- WO 91/03790 PCT/US90/03625 and Atal reference. Generally, performance of the speech coder is improved using long-term filter parameters determined in the closed-loop configuration. The novel structure of the long-term predictor according to the present invention greatly facilitates the use of the closed-loop determination of these parameters for lags L less than the frame length N.

Figure 2A illustrates an embodiment of long-term filter 124 of Figure 1, where L is constrained to be an integer. Although Figure 1 shows the scaled excitation vector 7 ui(n) from gain block 1 0 122 as being input to long-term filter 124, a representative input speech vector s(n) has been used in Figure 2A for purposes of explanation, hence, a frame of N samples of input speech vector s(n) is applied to adder 210. The output of adder 210 produces the output vector b(n) for the long-term filter 124. The output vector b(n) is fed back to delay block 230 of the long-term predictor. The nominal long-term predictor lag parameter L is also input to delay block 230. The long-term predictor delay block provides output vector q(n) to long-term predictor multiplier block 220, which scales the long-term predictor response by the long-term predictor coefficient 1. The scaled output 1q(n) is then applied to adder 210 to complete the feedback loop if the recursive filter.

The output response Hn(z) of long-term filter 124 is defined in Z-transform notation as: 1 Hn(z) 1-8z wherein n represents a sample number of a frame containing N samples, 0 n N-l, wherein B represents a filter coefficient, wherein L represents the nominal lag or delay of the long-term predictor, and wherein L(n+L)/LJ represents the closest integer less than or equal to The long-term predictor delay L(n+L)/LJ L varies as a function of the sample number n. Thus, 13 WO 91/03790 PC/US90/03625 according to the present invention, the actual long-term predictor delay becomes kL, wherein L is the basic or nominal long-term predictor lag, and wherein k is an integer chosen from the set (1, 2, 3, 4, as a function of the sample number n. Accordingly, the long-term filter output response b(n) is a function of the nominal long-term predictor lag parameter L and the filter state FS which exists at the beginning of the frame. This statement holds true for all values of L even for the problematic case of when the pitch lag L is less than the frame length N.

The function of the long-term predictor delay block 230 is to store the current input samples in order to predict future samples. Figure 2B represents a simplified diagram of a shift register, which may be helpful in understanding the operation of long-term predictor delay block 230 of Figure 2A. For sample 1 5 number t such that n=t, the current output sample b(n) is applied to the input of the shift register, which is shown on the right on Figure 2B. For the next sample n=t+l, the previous sample b(n) is shifted left into the shift register. This sample now becomes the first past sample For the next sample n=t+2, another sample of b(n) is shifted into the register, and the original sample is again shifted left to become the second past sample b(n-2).

After L samples have been shifted in, the original sample has been shifted left L number of times such that it may be represented as b(n-L).

As mentioned above, the lag L would typically be the pitch period of voiced speech or a multiple of it. If the lag L is as least as long as the frame length N, a sufficient number of past samples have been shifted in and stored to predict the next frame of speech. Even in the extreme case of where L=N, and where n=N-1, b(n-L) will be which is indeed a past sample. Hence, the sample b(n-L) would be output from the shift register as the output sample q(n).

If however, the long-term predictor lag parameter L is shorter than the frame length N, then an insufficient number of WO 91/03790 14 -PCT/US90/03625 samples would have been shifted into the shift register by the beginning of the next frame. Using the above example a 250 Hz pitch period, the pitch lag L would be equal to 32. Thus, where L=32 and N=60, and where n=N-1=59, b(n-L) would normally be b(27), which represents a future sample with respect to the beginning of the frame of 60 samples. In other words, not enough past samples have been stored to provide a complete long-term predictor response. The complete long-term predictor response is needed at the beginning of the frame such that closed-loop analysis of the predictor parameters can be performed.

According to the invention in that case, the same stored samples 0 s n L, are repeated such that the output response of the long-term predictor is always a function of samples which have been input into the long-term predictor delay block prior to the 1 5 start of the current frame. In terms of Figure 2B, the shift register has thus been extended to store another kL samples, which represent modifying the structure of the long-term predictor delay block 230. Hence, as the shift register fills with new samples k must be chosen such that b(n-kL) represents a sample which existed in the shift register prior to he start of the frame. Using the previous example of L=32 and N=60, output sample q(32) would be a repeat of sample which is b(0- L)=b(32-2L) or b(-32).

Hence, the output response q(n) of the long-term predictor delay block 230 would correspond to: q(n) b(n-kL) wherein 0 I n N-l, and wherein k is chosen as the samllest integer such that (n-kL) is negative. More specifically, if a frame of N samples of s(n) is input into long-term predictor filter 124, each sample number n is j e n N+j-1 where j is the index for the first sample of a frame of N samples. Hence, the variable k would vary such that (n-kL) is always less than j. This ensures that the long-term predictor utilizes only samples WO 91/03790 15 PCT/US90/03625 available prior to the beginning of the frame to predict the output response.

The operation of long-term filter 124 of Figure 2A will now be described in accordance with the flowchart of Figure 3.

Starting at step 350, the sample number n is initialized to zero at step 351. The nominal long-term predictor lag parameter L and the long-term predictor coefficient 2 are input from coefficient analyzer 110 in step 352. In step 353, the sample number n is tested to see if an entire frame has been output. If n N, 1 0 operation ends at step 361. If all samples have not yet been computed, a signal sample s(n) is input in step 354. In step 355, the output response of long-term predictor delay block 230 is calculated according to the equation: q(n) b(n -L (n+L/LL) 1 5 wherein L(n+L)/Li represents the closest integer less than or equal to For example, if n=56 and L=32, then L(n+L)/L]L) becomes L(56+32/32JL, which is L(2.75)j L or 2L. In step 356, the output response b(n) of the long-ter filter is computed according to the equation: b(n) B q(n) s(n) This represents the function of multiplier 220 and adder 210. In step 357, the sample in the shift register is shifted left one position, for all register locations between b(n-2) and b(n-LMAx), where LMAX represents the maximum long-term predictor lag that can be assigned. In the preferred embodiment, LMAX would be equal to 143. In step 358, the output sample b(n) is input into the first location b(n-1) of the shift register. Step 359 outputs the filtered sample The sample number n is then incremented in step 360, and then tested in step 353. When all N samples have been computed, the process ends at step 361.

Figure 2C is an alternative embodiment of a long-term filter incorporating the present invention. Filter 124' is the -16 WO 91/03790 16- PCT/US90/03625 feedforward inverse version of the recursive filter configuration of Figure 2A. Input vector s(n) is applied to both subtractor 240 and long-term predictor delay block 260. Delayed vector q(n) is output to multiplier 250, which scales the vector by the long-term predictor coefficient 8. The output response Hn(z) of digital filter 124' is given in z-transform notation as: Hn(z) =1 -Bz-

L

wherein n represents the sample number of a frame containing N samples, 0 n N-l, wherein B represents the long-term filter coefficient, wherein L represents the nominal lag or delay of the long-term predictor, and wherein L(n+L)/Lj represents the closest integer less than or equal to The output signal b(n) of filter 124' may also be defined in terms of the input signal s(n) as: b(n) s(n) -B s(n [(n+L)/LJL) for 0 n N-1. As can be appreciated by those skilled in the art, the structure of the long-term predictor has again been modified so as to repeatedly output the same stored samples of the longterm predictor in the case of when the long-term predictor lag L is less than the frame length N.

Referring next to Figure 5, there is illustrated the preferred embodiment of the long-term filter 124 of Figure 1 which allows for subsample resolution for the lag parameter L. A frame of N samples of input speech vector s(n) is applied to adder 510, The output of adder 510 produces the output vector b(n) for the long term filter 124. The output vector b(n) is fed back to delayed vector generator block 530 of the long-term predictor. The nominal longterm predictor lag parameter L is also input to delayed vector generator block 530. The long-term predictor lag parameter L can take on non-integer values. The preferred embodiment allows L to take on values which are a multiple of one half. Alternate implementations of the sub-sample resolution long-term WO 91/03790 17- PCT/US90/03625 predictor of the present invention could allow values which are multiples of one third or one fourth or any other rational fraction.

In the preferred embodiment, the delayed vector generator 530 includes a memory which holds past samples of In addition, interpolated samples of b(n) are also calculated by delayed vector generator 530 and stored in its memory. In the preferred embodiment, the state of the long-term predictor which is contained in delayed vector generator 530 has two samples for every stored sample of One sample is for b(n) and the other sample represents an interpolated sample between two consecutive b(n) samples. In this way, samples of b(n) can be obtained from delayed vector generator 530 which correspond to integer delays or multiples of half sample delays. The interpolation is done using interpolating finite impulse response 1 5 filters as described in the book by R. Crochiere and L. Rabiner entitled Multirate Digital Signal Processing, published by Prentice Hall in 1983. The operation of vector delay generator 530 is described in further detail hereinbelow in conjunction with the flowcharts in Figure 6A and 6B.

Delayed vector generator 530 provides output vector q(n) to long-term multiplier block 520, which scales the long-term predictor response by the long-term predictor coefficient B. The scaled output Bq(n) is then applied to adder 510 to complete the feedback loop of the recursive filter 124 in Figure Referring to Figures 6A and 6B, there are illustrated detailed flowchart diagrams detailing the operations performed by the long-term filter of Figure 5. According to the preferred embodiment of the present invenion, the resolution of the longterm predictor memory is extended by mapping an N point sequence onto a 2N point vector ex(i). The negative indexed samples of ex(i) contain the extended resolution past values of long-term filter output or the extended resolution long term history. The mapping process doubles the temporal resolution of the long-term predictor memory, each time it is applied. Here for -1 Q WO 91/03790 18 PCT/US90/03625 simplicity single stage mapping is described, although additional stages may be implemented in other embodiments of the present invention.

Entering at START step 602 in Figure 6A, the flowchart proceeds to step 604, where L, B and s(n) are inputted. At step 608, vector q(n) is constructed according to the equation: q(n) ex(2n 2L L (n+L)/LJ) for 0 <nN-1 wherein L(n+L)/LJ represents the closest integer less than or equal to and wherein L is the long term predictor lag. For voiced speech, long term predictor lag L may be the pitch period or a multiple of the pitch period. L may be an integer or a real number whose fractional part is 0.5 in the preferred embodiment.

When the fractional part of L is 0.5, L has an effective resolution 1 5 of half a sample.

In step 610, vector b(n) of the long-term filter is computed according to the equation: b(n) B q(n) s(n) for 0 <nN-1 In step 612, vector b(n) of the long-term filter is outputted. In step 614, the extended resolution state ex(n) is updated to generate and store the interpolated values of b(n) in the memory of delayed vector generator 530. Step 614 is illustrated in more detail in Figure 6B. Next, at step 616 the process has been completed and stops.

Entering at START step 622 in Figure 6B, the flowchart proceeds to step 624, where the samples in ex(i) to be calculated in this subframe are zeroed out, ex(i) 0 for i 2N-1, where M is chosen to be odd for an interpolating filter of order 2M+1. For example, if the order of the filter is 39, M is 19.

Although M has been chosen to be odd for simplicity, M may also be even. At step 626, every other sample of ex(i) for i 0, 2, 2(N- 1) is initialized with samples of b(n) according to the equation: 19 WO 91/03790 PCT/US90/03625 ex(2i) b(i) fori 0, 1, N-1.

Thus ex(i) for i 0, 2, 2(N-1) now holds the output vector b(n) for the current frame mapped onto its even indices, while the odd indices of ex(i) for i 1, 3, 2(N-1)+1 are initialized with zeros.

At step 628, the interpolated samples of ex(i) initialized to zero are reconstructed through FIR interpolation, using a symmetric, zero-phase shift filter, assuming that the order of such FIR filter is 2M+1 as explained hereinabove. The FIR filter coefficients are where j M-l, M and where a(j) Only even samples pointed to be the FIR filter taps are used in sample reconstruction, since odd samples have been set to zero. As a result, M+1 samples instead of 2M+1 samples are actually weighted and summed for each reconstructed sample.

1 5 The FIR interpolation is performed according to the equation: (M+1) 2 ex(i) 2 1 a 2 jl.[ex(i-2j+l)+ex(i+2j-1)], for Note that the first sample to be reconstructed is not ex(1) as one might expect. This is because interpolated samples at indices were reconstructed at the previous frame using an estimate of the excitation in the current frame, since the actual excitation samples were then undefined. At the current frame those samples are known we have b(n) and thus the samples of ex(i), for are now reconstructed again, with the filter taps pointing to the actual and not estimated values of b(n).

The largest value ofi in the above equation, is 2(N-1)-M.

This means that odd samples of ex(i), for i=2N-M,2Nstill are to be reconstructed. However, for those values of index i, the upper taps of the interpolating filter point to the future samples of the excitation which are as yet undefined.

To calculate the values of ex(i) for those indices, the future state of 20 WO 91/03790 PCT/US90/03625 ex(i) for i=2N,2N+2,...,2N+M-1 is extended by evaluating at step 630: ex(i) X ex(i-2L), for i=2N,2N+2,...,2N+M-1 The mirimum value of 2L to be used in this scheme is 2M+1.

This constraint may be lifted if we define: ex(i) X ex( F(i-2L)), for i=2N,2N+2,...,2N+M-1; where F(i-2L) for i-2L equal to odd numbers is given by: i-2L, for i-2L 2(N-1)-M SF(i-2L) i-2L-2L i-2(N)+M-2 for i-2L 2(N-1)-M and where F(i-2L) for i-2L equal to even numbers is given by: Si-2L, for i-2L 2(N-1) F(i-2L) i-2L-2L for i-2L 2(N-1) The parameter X, the history extension scaling factor, may be set equal to 13, which is the pitch predictor coefficient, or set to unity.

1 5 At step 632, with the excitation history thus extended, the last zeroed samples of the current extended resolution frame are calculated using: (M+1) 2 ex(i) 2 a2j.l[ex(i-2j+l)+ex(i+2j-l)], for 2(N-1)+1 These samples will be recalculated at the next subframe, once the actual excitation samples for ex(i), i=2N,2N+2,...,2N+M-1 become available.

Thus for n=0,N-1 has been mapped onto vector ex(i), The missing zeroed samples have been reconstructed using an FIR interpolating filter. Note that the FIR interpolation is applied only to the missing samples. This ensures that no distortion is unnecessarily introduced into the known samples, which are stored at even indices of ex(i). An WO 91/03790 21- PC/US90/03625 additional benefit of processing only the missing samples, is that computation associated with the interpolation is halved.

At step 634, finally the long term predictor history is updated by shifting down the contents of the extended resolution excitation vector ex(i) by 2N points: ex(i) ex(i+2N), for i=-2Max_L,-1 where Max_L is the maximum long term predictor delay used.

Next, at step 636 the process has been completed and stops.

1 0 Referring now to Figure 4, a speech synthesizer block diagram is illustrated using the long-term filter of the present invention. Synthesizer 400 obtains the short-term predictor parameters ai, long-term predictor parameters B and L, excitation gain factor 7 and the codeword I received from the 1 5 channel, via de-multiplexer 450. The codeword I is applied to codebook ROM 420 to address the codebook of excitation vectors.

The single excitation vector uI(n) is then multiplied by the gain factor Y in block 422, filtered by long-term predictor filter 424 and short-term predictor filter 426 to obtain reconstructed speech vector This vector, which represents a frame of reconstructed speech, is then applied to analog-to-digital (A/D) convertor 408 to produce a reconstructed analog signal, which is then low pass filtered to reduce aliasing by filter 404, and applied to an output transducer such as speaker 402. Hence,the CELP synthesizer utilizes the same codebook, gain block, long-term filter, and short-term filter as the CELP analyzer of Figure 1.

Figure 7 is a detailed block diagram of a pitch post filter for intercoupling the short term filter 426 and D/A converter 408 of the speech synthesizer in Figure 4. A pitch post filter enhances the speech quality by removing noise introduced by the filters 424 and 426. A frame of N samples of reconstructed speech vector s'I(n) is applied to adder 710. The output of adder 710 produces the output vector s"I(n) for the pitch post filter. The output vector s"I(n) is fed back to delayed sample generator block 730 of the -22 WO 91/03790 22 PCT/US90/03625 pitch post filter. The nominal long-term predictor lag parameter L is also input to delayed sample generator block 730. L may take on non-integer values for the present invention. If L is a noninteger, an interpolating FIR filter is used to generate the fractional sample delay needed. Delayed sample generator 730 provides output vector q(n) to multiplier block 720, which scales the pitch post filter response by coefficient R which is a function of the long-term predictor coefficient B. The scaled output Rq(n) is then applied to adder 710 to complete the feedback loop of the pitch post filter in Figure 7.

In utilizing the long-term predictor response according to the present invention, the excitation gain factor 7 and the longterm predictor coefficient B can be simultaneously optimized for all values of L in a closed-loop configuration. This joint optimization technique was heretofore impractical for values of L N, since the joint optimization equations would become nonlinear in the single parameter B. The present invention modifies the structure of the long-term predictor to allow a linear joint optimization equation. In addition, the present invention allows the long-term predictor lag to have better resolution than one sample thereby enhancing its performance.

Moreover, the codebook search procedure has been further simplified, since the zero state response of the long-term filter becomes zero for lags less than the frame length. This additional feature permits those skilled in the art to remove the effect of the long-term filter from the codebook search procedure. Hence, a CELP speech coder has been shown which can provide higher quality speech for all pitch rates while retaining the advantages of practical implementation and low bit rate.

While specific embodiments of the present invention have been shown and described herein, further modifications and improvements may be made without departing from the invention in its broader aspects. For example, any type of speech coding RELP, multipulse, RPE, LPC, etc.) may be used with the -23- WO 91/03790 23 PCT/US90/03625 sub-sample resolution long-term predictor filtering technique described herein. Moreover, additional equivalent configurations of the sub-sample resolution long-term predictor structure may be made which perform the same computations as those illustrated above.

Claims (12)

1. A method of reconstructing speech from sets of speech parameters transmitted in successive frames on a communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said method comprising, for each frame, the steps of: receiving from the communications channel in each frame a set of speech parameters including codeword I and delay parameter L; generating an excitation vector having a plurality of samples in response to the codeword I; filtering the excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to generate the filter output samples for non-integer values of delay parameter L; processing said filter output vector to produce the reconstructed speech vector; converting the reconstructed speech vector to an analog voice signal; and transducing the analog voice signal.

2. The method according to claim 1, wherein said step of filtering produces interpolated filter state samples by combining at least two consecutive samples of the stored filter state samples according to predetermined finite impulse response filtering to generate a corresponding filter output sample.

3. The method according to claim 1, further including the step of low-pass filtering the analog voice signal, said transducing step transducing the filtered analog Svoice signal. 25

4. Apparatus for reconstructing speech from sets of speech parameters transmitted in successive frames on a communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said apparatus comprising: means for receiving from the communications channel in each frame a set of speech parameters including codeword I and delay parameter L; means for generating an excitation vector having a plurality of samples in response to the codeword I; means for filtering the excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to generate the filter output samples for non-integer values of delay parameter L; means for processing said filter output vector to produce the reconstructed speech vector; means for converting the reconstructed speech vector to an analog voice signal; and means for transducing the analog voice signal.

The apparatus according to claim 4, wherein said means for filtering produces interpolated filter state samples by combining at least two consecutive samples of the stored filter state samples according to predetermined finite impulse response filtering to generate a corresponding filter output sample.

6. The apparatus according to claim 4, further including means for low-pass filtering the analog voice signal, said transducing means transducing the filtered analog voice signal.

7. A method of encoding speech into sets of speech Sparameters for transmission in successive frames on a 26 communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said method comprising, for each frame, the steps of: transducing speech to produce an analog voice signal; KS Iv sampling the analog voice signal a plurality of times to provide a plurality of samples forming a present speech vector; generating a delay parameter L based on the present speech vector; searching excitation vectors to determine the codeword I of the excitation vector that best matches the present speech vector by: generating excitation vectors in response to corresponding codewords; filtering each excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to generate the filter output samples for non-integer values of delay parameter L; processing the filter output vector to produce a reconstructed speech vector; comparing the reconstructed speech vector to the present speech vector to determine the difference therebetween; and selecting the codeword I of the excitation vector for which the reconstructed speech vector differs the least from the present speech vector; and transmitting the selected codeword I and delay parameter L together with pre-selected speech parameters for the present speech vector on the communications channel. 27

8. The method according to claim 7, wherein said step of filtering produces interpolated filter state samples by combining at least two consecutive samples of the stored filter state samples according to predetermined finite impulse response filtering to generate a corresponding filter output sample.

9. Apparatus for encoding speech into sets of speech parameters for transmission in successive frames on a communications channel, each set of speech parameters including at least a codeword I and a delay parameter L, where L may have a value in a predetermined range including integer and non-integer values related to the speech pitch period, said apparatus comprising: means for transducing speech to produce an analog voice signal; means for sampling the analog voice signal a plurality of times to provide a plurality of samples forming a present speech vector; means for generating a delay parameter L based on the present speech vector; means for searching excitation vectors to determine the codeword I of the excitation vector that best matches the present speech vector by: generating excitation vectors in response to corresponding codewords; filtering each excitation vector based on at least the delay parameter L and stored filter state samples to generate a filter output vector having a plurality of filter output samples, wherein samples of the excitation vector are used to update the stored filter state samples, and wherein interpolated filter state samples are used to generate the filter output samples for non-integer values of delay parameter L; processing the filter output vector to produce a reconstructed speech vector; comparing the reconstructed speech vector to the present speech vector to determine the difference therebetween; and 28 selecting the codeword I of the excitation vector for which the reconstructed speech vector differs the least from the present speech vector; and means for transmitting the selected codeword I and delay parameter L together with pre-selected speech parameters for the present speech vector on the communications channel.

The apparatus according to claim 9, wherein said means for searching produces interpolated filter state samples by combining at least two consecutive samples of the stored filter state samples according to predetermined finite impulse response filtering to generate a corresponding filter output sample.

11. A method according to claim 1 or 7 substantially as herein described with reference to the accompanying drawings.

12. Apparatus according to claim 4 or 9 substantially as herein described with reference to the accompanying drawings. DATED: 10 December, 1992. PHILLIPS ORMONDE FITZPATRICK Attorneys for: MOTOROLA INC. o 4102u MJP