WO1987001498A1

WO1987001498A1 - A parallel processing pitch detector

Info

Publication number: WO1987001498A1
Application number: PCT/US1986/001552
Authority: WO
Inventors: Joseph Picone; Dimitrios Panos Prezas
Original assignee: American Telephone & Telegraph Company
Priority date: 1985-08-28
Filing date: 1986-07-25
Publication date: 1987-03-12
Also published as: CA1301339C; KR880700386A; EP0235181A1; KR950000842B1; JPS63500683A; EP0235181B1; US4879748A; DE3684907D1; JPH0820878B2

Abstract

An improved pitch detector system for use with speech analysis and synthesis methods having a plurality of identical detectors (107, 108, 109, 110) each responsive to a different portion of a speech signal for estimating a pitch value and a voter circuit (111) responsive to the estimated pitch values for determining a final pitch value. The pitch detectors are identical in design which allows for an efficient software implementation since only one set of program instructions is necessary to implement all of the encoders. The voter subsystem may be implemented by a digital signal processor executing program instructions that calculate a pitch value from the estimated pitch values determined by the pitch detectors and a second set of program instructions for constraining the final pitch value outputted by the voter subsystem so that the calculated pitch value is in agreement with calculated pitch values for previous frames. In addition, the pitch and voters may be implemented by a third set of program instructions executing on the same digital signal processor as the sets of instructions for the voter subsystem.

Description

A PARALLEL PROCESSING PITCH DETECTOR

Technical Field

This invention relates generally to digital coding of human speech signals for compact storage and subsequent synthesis and, more particularly, to pitch detection and the simultaneous determination of the voiced and unvoiced characterization of discrete frames of speech. Background of the Invention In order to reduce the bandwidth necessary to transmit human speech, it is known to digitize the human speech and then to encode the speech so as to minimize the number of digital bits per second required to store the coded digitized speech for acceptable quality of speech reproduction after the information has been transmitted and decoded for speech reproduction. Analog speech samples are customarily partitioned into frames or segments of discrete lengths on the order of 20 milliseconds in duration. Sampling is typically performed at a rate of 8 kilohertz (kHz) and each sample is encoded into a multibit digital number. Successive coded samples are further processed in a linear predictive coder (LPC) that determines appropriate filter parameters which model the human vocal tract. Each filter parameter can be used to estimate present values of each signal sampled efficiently on the basis of the weighted sum of a preselected number of prior sample values. The filter parameters model the formant structure of the vocal tract transfer function. The speech signal is regarded analytically as being composed of an excitation signal and a formant transfer function. The excitation component arises in the larynx or voice box and the formant component results from the operation of the remainder of the vocal tract on the excitation component. The excitation component is further classified as voiced or unvoiced, depending upon whether or not there is a fundamental frequency imparted to the air stream by the vocal cords. If there is a fundamental frequency imparted to the air stream by the vocal cords, then the excitation component is classed as voiced. If the excitation is unvoiced, then the excitation component is simply white noise. To encode the speech for low bit rate transmission, it is necessary to determine the LPC parameters, also referred to as coefficients, for segments of speech and transfer these coefficients to the decoding circuit which is reproducing the speech. In addition, it is necessary to determine the excitation component. First, it must be determined whether this component is to be classed as voiced or unvoiced; and if the classification is voiced, then it is necessary to determine the fundamental frequency imparted to the air stream by the vocal cords. A number of methods exist for determining the LPC coefficients. The problem of determining the fundamental frequency, or as it is commonly referred to, pitch detection, is more difficult. One prior art method of pitch detection is based primarily on an important property of speech which is the long term regularity of the speech waveform. Ideally, voiced speech can be viewed as a periodic signal consisting of a fundamental frequency component and its harmonics. Therefore, the output of a low-pass filter that cuts off at a frequency less than the second harmonic should be appear as a sine wave with frequency equal to the pitch. That frequency then is determined utilizing amplitude detection circuitry. This method suffers from the fact that actual speech deviates from this model during the transition regions of speech disturbing the regularity. In addition, the pitch period itself may vary depending upon whether the speaker is a male or a^* female.

The problems of pitch detection can be enhanced under some conditions by removing the formant structure of the speech which is also referred to as spectrum flattening. The spectrum flattening can be done utilizing Fourier transform or linear predictive analysis. The use of an LPC filter to flatten the spectrum is also referred to as inverse filtering to subtract the formant structure from the speech signal. Such a system is disclosed in U. S. Patent 3,740,476. The resultant residual wave that results from the LPC filtering approximates the excitation function of the vocal tract, and pulse amplitude techniques can be utilized to extract the pitch from this information.

This technique fails, however, when the harmonics of the excitation fall under the formants of the speech signal in the frequency domain. When this occurs, the excitation information normally found in the residual wave is removed by the LPC inverse filtering. The result is that the residual signal then looks noisy and the pitch pulses are not easily detected.

Another prior art method of pitch detection is disclosed in the article entitled, "Parallel Processing Techniques for Estimating Pitch Periods of Speech in the Time Domain", B. Gold and L. Rabiner, The Journal of the ' Acoustical Society of America, Vo1. 36, No. 2 (part 2) , 1969. The latter article discloses the use of parallel pitch detectors where each of the pitch detectors is responsive to the analog voice signal to determine individually a pitch estimate. After these estimations of the pitch have been performed, a matrix is constructed of the pitch estimates; and an algorithm is utilized to determine a "correct" pitch. This method experiences problems in detecting the pitch during transitional regions of speech since the method performs all pitch estimations on the original speech signal. In addition, the algorithm utilized to make the determination of the "correct" pitch is concerned, to a large extent, with differentiating between the pitch fundamental and the second and third harmonics. Summary of the Invention

An illustrative pitch detector system and method utilizing a plurality of detectors each responsive to a different portion of the speech signal for estimating a pitch value, another plurality of detectors each responsive to a different portion of a residual signal calculated from the speech signal, and a voter responsive to the estimated pitch values for determining a final pitch value. The detectors are identical in design which allows an efficient software implementation since only one type of encoder is necessary to implement all of the encoders.

The structural embodiment comprises a sample and quantizer circuit that is responsive to human speech to digitize and quantize the speech. A digital signal processor is responsive to a first set of program instructions for storing a predetermined number of the digitized samples as a speech frame, responsive to a second set of program instructions• and the digitized speech samples to generate residual samples of the digitized speech samples that remain after the formant effect of the vocal tract has been substantially removed, responsive to a third set of program instructions and individual predetermined portions of the speech samples for estimating pitch values, responsive to a fourth set of program instructions and the residual samples for estimating pitch values, and responsive to a fifth set of program instructions for determining a final pitch value of said speech frames from the estimated pitch values. Advantageously, the fifth set of program instructions comprises a first subset of program instructions for calculating a pitch value from the estimated pitch values of the second set of program instruction sets and a second subset of program instructions for constraining the final pitch value so that the calculated pitch value is in agreement with the calculated pitch values from previous frames.

In addition, an unvoiced speech frame is indicated by the calculated pitch value being equal to a predefined value which, advantageously, may be zero; and voiced frames are indicated by the calculated pitch value not being equal to the predefined value. The second subset of program instructions further consists of a first group of instructions responsive to a first sequence consisting of voiced, unvoiced, and voiced frames for generating a new calculated pitch value indicating a voiced frame. A second group of instructions responsive to a second sequence consisting of unvoiced, voiced, and unvoiced frames for generating a new calculated value indicating an unvoiced frame. A third group of instructions responsive to a third sequence consisting of voiced, voiced, and voiced frames for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said third sequence.

Further, the first group of instructions of the second subset is responsive to the first sequence of frames for setting the calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of the first sequence, and the second group of instructions is responsive to the second sequence of frames for setting the new calculated pitch value to said predefined value.

Also, the second subset of instructions further comprises a fourth group of instructions that are responsive to a fourth sequence consisting of voiced, voiced, and unvoiced frames to calculate a new pitch value equal to the average of the calculated pitch values for the voiced and voiced frames upon the difference between the two voiced frames being less than another predefined value. If the difference between the pitch values for the two voiced frames is greater than the other predefined value, then the new calculated pitch value is set equal to the pitch value of the earlier voiced frame.

In addition, the first subset of program instructions comprises a first group of instructions responsive to all but a subset of the estimated pitch values equaling the predefined value for setting the calculated pitch value equal to the arithmetic average of the subset of values upon the estimated pitch values of the subset of values differing by less than another predefined value from each other. Further, the first group of instructions is responsive to all of the estimated pitch values being equal to the predefined value except for a subset of pitch values for setting the calculated pitch value equal to the predefined value upon the difference between each of the pitch values of the subset being greater than the other predefined value.

Also, the first subset of instructions comprises a second group of instructions responsive to all of the estimated pitch values except one equaling the predefined value for setting the calculated pitch value equal to the estimated pitch value not equal to the predefined value.

Also, the fourth set of program instructions used to estimate pitch values has a first subset of instructions for locating the sample of maximum amplitude within the predetermined portion of the residual samples within the frame. A second subset of instructions locates subsequent maximum samples, also termed candidate samples, in the frame of lesser amplitude than that of the maximum amplitude sample spaced by not less than a minimum distance based on the highest expected fundamental speech frequency from the maximum amplitude sample and each of the other samples within the frame. A third subset of instructions measures one by one the distance between adjacent located candidate samples using as a reference the maximum amplitude sample. A fourth subset of instructions tests for periodicity by comparing successive distance measurements for substantial equality and rejecting candidate samples that are not periodically related to the maximum amplitude sample. A fifth subset of instruction determines the estimated pitch value by calculating the quotient of the distance between extreme valid candidate samples within this speech frame. Finally, a sixth subset of instruction designates whether the frame is voiced or unvoiced. If the frame is unvoiced, the estimated pitch value is set equal to the predefined value, which advantageously may be zero, to indicate an unvoiced frame.

The illustrative method functions in a system having a quantizer and a digitizer for converting anaiog speech into frames of digital samples and a digital signal processor that is executing a plurality of program instructions for determining the pitch of a particular frame of digital speech. The signal processor determines the pitch by executing the steps of producing residual samples of t ^~ digitized speech that remain after the formant effect of the vocal tract has been substantially removed, estimating a first pitch value of the present sp ch frame from positive ones of the digitized speech samples, estimating a second pitch value from negative ones of the digitized speech samples, estimating a third value from positive ones of the residual samples, estimating a fourth pitch value from negative ones of the residual samples, and determining a final pitch value for a previous speech frame on the basis of the estimated pitch values determined by the estimating steps for a plurality of previous speech frames. Advantageously, the step of determining the final pitch value is performed by the digital signal processor responding to subsets of programmed instructions to performing the steps of calculating the final pitch value from the first, second, third, and fourth pitch values previously estimated and constraining the final pitch value so that the final pitch value is in agreement with the final pitch values from previous frames as previously determined by the digital signal processor.

Brief Description of the Drawing

FIG. 1 illustrates, in block diagram form, a pitch detector in accordance with this invention;

FIG. 2 illustrates, in block diagram form, pitch detector 108 of FIG. 1;

FIG. 3 illustrates, in graphic form the candidate samples of a speech frame;

FIG. 4 illustrates, in block diagram form, pitch voter 111 of FIG. 1; and FIG. 5 illustrates a digital signal processor implementation of FIG. 1. Detailed Description

FIG. 1 shows an illustrative pitch detector which is the focus of this invention. The pitch detector is responsive to analog speech signals received via conductor 113 to indicate on output bus 114 whether the speech excitation is voiced or unvoiced and, if voiced, to indicate the pitch. The latter determinations are performed by pitch voter 111 in response to the outputs of pitch detectors 107 through 110. In order to reduce aliasing, the input speech on conductor 113 is filtered by filter 100 which, advantageously, may be an eighth-order Butterworth analog low-pass filter whose -3 dB frequency is 3.3 kHz. The filtered speech is then digitized and quantized by sampler 112 and linear quantizer 101. The latter transmits the digitized speech, x(n) , to clippers 103 and 104 and to LPC coder and inverse filter 102. The output of coder and filter 102 is the residual signal from the inverse filtering that is transmitted to clippers 105 and 106 via path 116. Coder and filter 102 first performs the computations required to determine the filter coefficients that are used by the LPC inverse filter and then uses these filter coefficients to perform the inverse filtering of the digitized voice signal in order to calculate the residual signal, e(n) . This is done in the following manner. The digitized speech x(n) is divided into, advantageously, 20 millisecond frames during which it is assumed that the all pole LPC filter is time-invariant. The frame of digitized speech is used to compute a set of reflection coefficients which, advantageously, may be 10, using the lattice computation method. The resulting tenth order inverse lattice filter generates the forwarded prediction error or residual as well as providing the reflection coefficients. The clippers 103 through 106 transform the incoming x and e digitized signals on paths 115 and 116, respectively, into positive-going and negative-going wave forms. The purpose for forming these signals is that whereas the composite waveform might not clearly indicate periodicity the clipped signal might. Hence, the periodicity is easier to detect. Clippers 103 and 105 transform the x and e signals, respectively, into positive-going signals and clippers 104 and 106 transform the x and e signals, respectively, into negative-going signals. Pitch detectors 107 through 110 are each responsive to their own individual input signals to make a determination of the periodicity of the incoming signal. The output of the pitch detectors occurs two frames after receipt of those signals. Note, that each frame consists of, illustratively, 160 sample points. Pitch voter 111 is responsive to the output of the four pitch detectors to make a determination of the final pitch. The output of pitch voter 111 is transmitted via path 114.

FIG. 2 illustrates in block diagram form, pitch detector 108. The other pitch detectors are similar in design. The maxima locator 201 is responsive to the digitized signals of each frame for finding the pulses on which the periodicity check is performed. The output of maxima locator 201 is two sets of numbers: those representing the maximum amplitudes, M., which are the candidate samples, and those representing the location within the frame of these amplitudes, D. Distance detector 202 is responsive to these two sets of numbers to determine a subset of candidate pulses that are periodic. This subset represents distance detector 202' s determination of what the periodicity is for this frame. The output of distance detector 202 is transferred to pitch tracker 203. The purpose of pitch tracker 203 is to constrain the pitch detector's determination of the pitch between successive frames of digitized signals. In order to perform this function, pitch tracker 203 uses the pitch as determined for the two previous frames.

Consider now in greater detail, the operations performed by maxima locator 201. Maxima locator 201 first identifies within the samples from the frame, the global maxima amplitude, M_{Q f and its} location, D₀, in the frame. The other points selected for the periodicity check must satisfy all of the following conditions. First, the pulses must be a local maxima, which means that the next pulse picked must be the maximum amplitude in the frame excluding all pulses that have already been picked or eliminated. This condition is applied since it is assumed that pitch pulses usually have higher amplitudes than other samples in a frame. Second, the amplitude of the pulse selected must be greater than or equal to a certain percentage of the global maximum. Mi > gM_Q, where g is a threshold amplitude percentage that, advantageously, may be 25%. Third, the pulse must be advantageously separated by at least 18 samples from all the pulses that have already been located. This condition is based on the assumption that the highest pitch encountered in human speech is approximately 440 Hz which at a sample rate of 8 kHz results in 18 samples.

Distance detector 202 operates in a recursive-type procedure that begins by considering the distance from the frame global maximum, M-, to the closest adjacent candidate pulse. This distance is called a candidate distance, d . and is given by

^dc = I ^Do - ^Di I where D^ __s the in-frame location of the closest adjacent candidate pulse. If such a subset of pulses in the frame are not separated by this distance, plus or minus a breathing space, B, then this candidate distance is discarded, and the process begins again with the next closest adjacent candidate pulse using a new candidate distance. Advantageously, B may have a value of 4 to 7. This new candidate distance is the distance to the next adjacent pulse to the global maximum pulse.

Once pitch detector 202 has determined a subset of candidate pulses separated by a distance, ^d _c +_^ B _{f an} interpolation amplitude test is applied. The interpolation amplitude test performs linear interpolation between M_{Q an}d each of the next adjacent candidate pulses, and requires that the amplitude of the candidate pulse immediately adjacent to M_Q is at least q percent of these interpolated values. Advantageously, the interpolation amplitude threshold, q percent, is 75%. Consider the example illustrated by the candidate pulses shown in FIG. 3. For d_c to be a valid candidate distance, the following must be true: Mg - M₂ ^Ml > [«2 ⁺ lD₀ - D₂| l°l - ^D2l^]'

Mn - M, ₃ > q [M₄ D_Λ - - D. π

and

M_Λ - Mc

^M3 > q [M₅ + |_DQ . _ps| |D₃ - D₅|],

where

^dc = l^Do - ^Dι! > ¹⁸-

As noted previously,

M_j > gM_Q, . for i = 1,2,3,4,5. Pitch tracker 203 is responsive to the output of distance detector 202 to evaluate the pitch distance estimate which relates to the frequency of the pitch since the pitch distance represents the period of the pitch. Pitch tracker 203' s function is to constrain the pitch distance estimates to be consistent from frame to frame by modifying, if necessary, any initial pitch distance estimates received from the pitch detector by performing four tests: voice segment start-up test, maximum breathing and pitch doubling test, limiting test, and abrupt change test. The first of these tests, the voice segment start-up test is performed to assure the pitch distance consistency at the start of a voiced region. Since this test is only concerned with the start of the voiced region, it assumes that the present frame has non-zero pitch period. The assumption is that the preceding frame and the present frame are the first and second voice frames in a voiced region. If the pitch distance estimate is designated by T(i) where i designates the present pitch distance estimate from distance detector 202, the pitch detector 203 outputs T*(i-2) since there is a delay of two frames through each detector. The test is only performed if T(i-3) and T(i-2) are zero or if T(i-3) and T(i-4) are zero while T(i-2) is non-zero, implying that frames i-2 and i-l are the first and second voiced frames, respectively, in a voiced region.

The voice segment start-up test performs two consistency tests: one for the first voiced frame, T(i-2), and the other for the second voiced frame, T(i- 1) . These two tests are performed during successive frames. The purpose of the voice segment test is to reduce the probability of defining the start-up of a voiced region when such a region is not actually begun. This is important since the only other consistency tests for the voice regions are performed in the maximum breathing and pitch doubling tests and there only one consistency condition is required. The first consistency test is performed to assure that the distance of the right candidate sample in T(i-2) and the most left candidate sample in T(i-l) and T(i-2) are close to within a pitch threshold B + 2.

If the first consistency test is met, then the second consistency test is performed during the next frame to ensure exactly the same result that the first consistency test ensured but now the frame sequence has been shifted by one to the right in the sequence of frames. If the second consistency test is not met, then T(i-l) is set to zero, implying that frame i-l can not be the second voiced frame (if T(i-2) was not set to zero). However, if both of the consistency tests are passed, then frames i-2 and i-l define a start-up of a voiced region. If T(i-l) is set to zero, while T(i-2) was determined to be non-zero and T(i-3) is zero, which indicates that frame i-2 is voiced between two unvoiced frames, the abrupt change test takes care of this situation and this particular test is described later. The maximum breathing and pitch doubling test assures pitch consistency over two adjacent voiced frames in a voiced region. Hence, this test is performed only if T(i-3), T(i-2), and T(i-l) are non- zero. The maximum breathing and pitch doubling tests also checks and corrects any pitch doubling errors made by the distance detector 202. The pitch doubling portion of the check checks if T(i-2) and T(i-l) are consistent or if T(i-2) is consistent with twice T(i-l), implying a pitch doubling error. This test first checks to see if the maximum breathing portion of the test is met, that is done by

I T(i-2) - T(i-l) I < A, where A may advantageously have the value 10. If the above equation is met, then T(i-l) is a good estimate of the pitch distance and need not be modified. However, if the maximum breathing portion of the test fails., then the test must be performed to determine if the pitch doubling portion of the test is met. The first part of the test checks to see if T(i-2) and twice T(i-l) meet the following condition, given that T(i-3) is non-zero,

I T(i-2) - 2T(i-l) I <_ Hjlϋ. If the above condition is met, then T(i-l) is set equal to T(i-2). If the above condition is not met, then T(i-l) is set equal to zero. The second part of this portion of the test is performed if T(i-3) is equal to zero. If the following are met

I T(i-2) - 2T(i-l) I _< B and I T(i-l) - T(i) I > A then

T(i-l) = T(i-2) . If the above conditions are not met, T(i-l) is set equal to zero. The limiting test which is performed on T(i-l) assures that the.pitch that has been calculated is within the range of human speech which is 50 Hz to 400 Hz. If the calculated pitch does not fall within this range, then T(i-l) is set equal to zero indicating that frame i-l cannot be voiced with the calculated pitch.

The abrupt change test is performed after the three previous tests have been performed and is intended to determine that the other tests may have allowed a frame to be designated as voiced in the middle of an unvoiced region or unvoiced in the middle of a voiced region. Since humans usually cannot produce such sequences of speech frames, the abrupt change test assures that any voiced or unvoiced segments are at least two frames long by eliminating any sequence that is voiced-unvoiced-voiced or unvoiced-voiced-unvoiced. The abrupt change test consists of two separate procedures each designed to detect the two previously mentioned sequences. Once pitch tracker 203 has performed the previously described four tests, it outputs T (i-2) to the pitch voter 111 of FIG. 1. Pitch tracker 203 retains the other pitch distances for calculation on the next received pitch distance from distance detector 202.

FIG. 4 illustrates in greater detail pitch voter 111 of FIG. 1. Pitch value estimator 401 is responsive to the outputs of pitch detectors 107 through 110 to make an initial estimate of what the pitch is for two frames earlier, P(i-2) , and pitch value tracker 402 is responsive to the output of pitch value estimator 401 to constrain the final pitch value for the third previous frame, P(i-3), to be consistent from frame to frame. Consider now, in greater detail, the functions performed by pitch value estimator 401. In general, if all of the four pitch distance estimates values received by pitch value estimator 401 are non-zero, indicating a voiced frame, then the lowest and highest estimates are discarded, and P(i-2) is set equal to the arithmetic average of the two remaining estimates. Similarly, if three of the pitch distance estimate values are non¬ zero, the highest and lowest estimates are discarded, and pitch value estimator 401 sets P(i-2) equal to the remaining non-zero estimate. If only two of the estimates are non-zero, pitch value estimator 401 sets P(i-2) equal to the arithmetic average of the two pitch distance estimated values only if the two values are close to within the pitch threshold A. If the two values are not close to within the pitch threshold A, then pitch value estimator 401 sets P(i-2) equal to zero. This determination indicates that frame i-2 is unvoiced, although some individual detectors determined, incorrectly, some periodicity. If only one of the four pitch distance estimate values is non-zero, pitch value estimator 401 sets P(i-2) equal to the non-zero value. In this case, it is left to pitch value tracker 402 to check the validity of this pitch distance estimate value so as to make it consistent with the previous pitch estimate. If all of the pitch distance estimate values are equal to zero, then, pitch value estimator 401 sets P(i-2) equal to zero.

Pitch value tracker 402 is now considered in greater detail. Pitch value tracker 402 is responsive to the output of pitch value estimator^' 401 to produce a pitch value estimate for the third previous frame, P (i-3), and makes this estimate based on P(i-2) and i_t

P(i-4). The pitch value P (i-3) is chosen so as to be consistent from frame to frame.

The first thing checked is a sequence of frames having the form: voiced-unvoiced-voiced, unvoiced-voiced-unvoiced, or voiced-voiced-unvoiced. If the first sequence occurs as is indicated by P(i-4) and P(i-2) being non-zero and P(i-3) is zero, then the final * pitch value, P (i-3) , is set equal to the arithmetic average of P(i-4) and P(i-2) by pitch value tracker 402.

If the second sequence occurs, then the final pitch value, P (i-3), is set equal to zero. With respect to the -third sequence, the latter pitch tracker is responsive to P(i-4) and P(i-3) being non-zero and P(_-

* 2) being zero to set P (i-3) to the arithmetic average of P(i-3) and P(i-4), as long as P(i-3) and P(i-4) are close to within the pitch threshold A. Pitch tracker 402 is responsive to

I P(i-4) - P(i-3) I < A,

to perform the following operation

P*₍i-3₎ = P⁽i-4⁾ ÷ P(i-3⁾ _t if pitch value tracker 402 determines that P(i-3) and P(i-4) do not meet the above condition (that is, they are not close to within, the pitch threshold A), then, pitch value tracker 402 sets P (i-3) equal to the value of P(i-4) .

In addition to the previously described operations, pitch value tracker 402 also performs operations designed to smooth the pitch value estimates for certain types of voiced-voiced-voiced frame sequences. Three types of frame sequences occur where these smoothing operations are performed. The first sequence is when the following is true

I P(i-4) - P(i-2) I < A,

and

I P(i-4) - P(i-3) I > A.

When the above conditions are true, pitch value tracker 402 performs a smoothing operation by setting P (i-3) _ P(i-4) + P(i-2)

2

The second set of conditions occurs when

I P(i-4) - P(i-2) I > A,

and

I P(i-4) - P(i-3) I <_ A.

When this second set of conditions is true, pitch value tracker 402 sets

p*₍i-3₎ = P⁽i-4⁾ ÷ P⁽i-3⁾ _t The third and final set of conditions is defined as

I P(i-4) - P(i-2) I > A,

and

I P(i-4) - P(i-3) I > A.

For this final set of conditions occur, pitch value tracker 402 sets

P*(i-3) = P(i-4) .

FIG. 5 illustrates an implementation of the blocks of FIG. 1 utilizing a digital signal processor that may advantageously be a Texas Instruments' TMS320- 20 digital signal processor. The latter processor along with PROM memory 502 and RAM memory 503 implements blocks 102 through 111 of FIG. 1. The program stored in PROM 502 for implementing the aforementioned elements of FIG. 1 is similar to a C source code program. The program is intended for excution on a computer system with suitable digital-to-analog and analog-to-digital converter peripherals or a similar system. The pitch detectors 107 through 110 of FIG. 1 are implemented by common code that utilizes separate data storage areas for each pitch detector in RAM 503. The details given of FIG. 1 in FIGS. 2 and 4 are implemented by sets of program instructions stored within PROM 502. Each set of program instructions can be further subdivided into subsets and groups of programmed instructions.

It is to be understood that the above- described embodiment is merely illustrative of the principles of the invention and that other arrangements may be devised by those skilled in the art without departing from the spirit and scope of the invention.

Claims

Cla ims

1. A pitch detector system for human speech comprising: means for storing a predetermined number of evenly spaced samples of instantaneous amplitude of said speech as a speech frame; means for generating residual samples from said speech samples; a plurality of identical means each responsive to an individual predetermined portion of said residual samples of said frame for estimating a pitch value of said frame; and another plurality of identical means each responsive to an individual predetermined portion of said speech samples of said frame for estimating a pitch value of said frame; means responsive to the individually estimated pitch value from each of said estimating means for determining a final pitch value of said speech frame.

2. The system of claim 1 wherein said determining means comprises: means for calculating a final pitch value from said ones of said estimated pitch values; and means for constraining said final pitch value so that the calculated pitch value is in agreement with calculated pitch values from previous frames.

3. The system of claim 2 wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and voiced frames are indicated by said calculated pitch value being equal to a value other than said predefined value, and said constraining means comprises: means responsive to a first sequence of voiced frame and unvoiced frame and voiced frame for generating a new calculated pitch value indicating a voiced frame; means responsive to a second sequence of unvoiced frame and voiced frame and unvoiced frame for generating a new calculated value indicating a unvoiced frame; and means responsive to a third sequence of voiced frame and voiced frame and voiced frame for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said third sequence.

4. The system of claim 3 wherein said generating means responsive to said first sequence comprises means for setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence; and generating means responsive to said second sequence of unvoiced and voiced and unvoiced frames for ^• setting the new calculated pitch value to said predefined value.

5. The system of claim 4 wherein said constraining means further comprises means responsive to a fourth sequence of voiced frame and voiced frame and unvoiced frame for generating a new calculated pitch value equal to the average of the calculated pitch value for the voice frame and unvoiced frame upon the difference between the two voiced frames being less than another predefined value; and means responsive to said fourth sequence for generating a new calculated pitch value equal to the pitch value of the earlier voiced frame upon the difference between the pitch values for the two voiced frames being greater than said other predefined value.

6. The system of claim 2 wherein said calculating means comprises means responsive to all of said estimated pitch values having a value different than said predefined value for setting said calculated pitch value equal to the arithmetic average of a subset of median of said estimated pitch values.

7. The system of claim 2 wherein said _ calculating means further comprises means responsive to all but a subset of said estimated pitch values equaling said predefined value from said plurality of estimating means for setting said calculated pitch value equal to the arithmetic average of said subset upon the estimated pitch values of said subset of said pitch values differing by less than another predefined value from each other; and means responsive to all of said estimated pitch values being equal to said predefined value except for a subset of said estimated pitch values for setting said calculated pitch value equal to said predefined value upon the difference between each of said estimated pitch values of said subset being greater than said other predefined value.

8. The system of claim 2 wherein said calculating means comprises means responsive to all of said estimated pitch values except for one estimated pitch value equaling said predefined value for setting said calculated pitch value equal to said estimated pitch value not equal to said predefined value.

9. The system of claim 2 wherein said plurality of said estimating means each comprises means for locating the main sample of maximum amplitude within said individual predetermined portion of said residual samples; means for locating samples of said predetermined portion of said residual samples of lesser amplitude than that of the maximum amplitude sample spaced by not less than a minimum distance based on the highest expected fundamental speech frequency from said maximum amplitude sample and from each other residual samples within said frame; means for measuring one-by-one the distance between adjacent located candidate samples using as a reference the location of said maximum amplitude sample; means for testing for periodicity by comparing successive distance measurements for substantial equality and rejecting candidate samples which are not periodically related to said maximum amplitude sample; means for determining said estimated pitch value by the quotient of the distance between extreme valid samples within said frame; and means for designating said frame upon the latter exhibiting periodicity as voiced and otherwise as unvoiced by setting said estimated pitch value equal to a predefined value.

10. The system of claim 9 wherein said plurality of said estimating means comprises two of said estimating means and each of said estimating means further comprises means responsive said residual samples for clipping the latter samples to produce said individual predetermined portion of said residual samples.

11. A pitch detector for human speech comprising: means for storing a predetermined number of evenly spaced speech samples of instantaneous amplitude of said speech as a present speech frame; means for filtering said samples to produce residual samples of the speech remaining after the formant effects of the vocal tract have been substantially removed; first means responsive to said positive ones of said speech samples for estimating a first pitch value of said present speech frame; second means responsive to said negative ones of said speech samples for estimating a second pitch value of said present speech frame; third means responsive to positive ones of said residual samples for estimating a third pitch value of said present speech frame; a fourth means responsive to negative ones of said residual samples for estimating a fourth pitch value of said present speech frame; and means responsive to the estimated pitch values from each of the estimating means for determining a final pitch value of a last previous speech frame based on a plurality of previous speech frames and said present speech frame.

12. The system of claim 11 wherein said determining means comprises: means for calculating a pitch value from said ones of said estimated pitch values; and means for constraining said final pitch value so that the calculated pitch value is in agreement with calculated pitch values from previous frames.

13. The system of claim 12 wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and voiced frames are indicated by said calculated pitch value being equal to a value other than said predefined value, and said constraining means comprises: means responsive to a first sequence of voiced frame and unvoiced frame and voiced frame for generating a new calculated pitch value indicating a voiced frame; means responsive to a second sequence of unvoiced frame and voiced frame and unvoiced frame for generating a new calculated value indicating a unvoiced frame; and means responsive to a third sequence of voiced frame and voiced frame and voiced frame for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said third sequence.

14. The system of claim 13 wherein said generating means responsive to said first sequence comprises means for setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence; and generating means responsive to said second sequence of unvoiced and voiced and unvoiced frames for setting the new calculated pitch value to said predefined value.

15. The system of claim 14 wherein said constraining means further comprises means responsive to a fourth sequence of voiced frame and voiced frame and unvoiced frame for generating a new calculated pitch value equal to the average of the calculated pitch value for the voice frame and unvoiced frame upon the difference between the two voiced frames being less than another predefined value; and means responsive to said fourth sequence for generating a new calculated pitch value equal to the pitch value of the earlier voiced frame upon the difference between the pitch values for the two voiced frames being greater than said other predefined value.

16. The system of claim 12 wherein said calculating means comprises means responsive to all of said estimated pitch values having a value different than said predefined value for setting said calculated pitch value equal to the arithmetic average of a subset of median of said estimated pitch values.

17. The system of claim 12 wherein said calculating means further comprises means responsive to all but a subset of said estimated pitch values equaling said predefined val^*ue from said plurality of estimating means for setting said calculated pitch value equal to the arithmetic average of said subset upon the estimated pitch values of said subset of said pitch values differing by less than another predefined value from each other; and means responsive to all of said estimated pitch values being equal to said predefined value except for a subset of said estimated pitch values for setting said calculated pitch value equal to said predefined value upon the difference between each of said estimated pitch values of said subset being greater than said other predefined value.

18. The system of claim 12 wherein said calculating means comprises means responsive to all of said estimated pitch values except for one estimated pitch value equaling said predefined value for setting said calculated pitch value equal to said estimated pitch value not equal to said predefined value.

19. A pitch detector for determining the pitch of human speech comprising: means for low-pass filtering said human speech; means for digitally sampling said human speech into frames of digitized speech samples; processor means responsive to a first set of program instructions and said digitized speech samples for filtering said digitized samples to produce residual samples of the speech remaining after the forrr.ap.L effects of the vocal tract have been substantially removed; said processor means further responsive to a second set of instructions and said positive ones of said digitized speech samples for estimating a first pitch value of the present speech frame; said processor means responsive to a third set of program instructions and said negative ones of said digitized speech samples for estimating a second pitch value of said present speech frame; said processor means responsive to a fourth set of program instructions and to positive ones of said residual samples for estimating a third pitch value of said present speech frame; said processor means responsive to a fifth set of program instructions and to negative ones of said residual samples for estimating a fourth pitch value of said present speech frame; and said processor means responsive to a sixth set of program instructions and said estimated pitch values for determining a final pitch value of the last previous speech frame based on a plurality of previous speech frames and said present speech frame.

20. The system of claim 19 wherein said sixth set of program instruction comprises: a first subset of program instructions and said processor means responsive to said first subset of program instructions for calculating said final pitch value from said first, second, third, and fourth pitch values; and a second subset of computer instructions and said processor means responsive to said second subset of program instructions for constraining said final pitch value so that said final pitch value is in agreement with final pitch values from previous frames.

21. The system of claim 20 wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and voiced frames are indicated by said calculated pitch value being equal to a value other than said predefined value, and said second subset of program instructions comprises: a first group of instructions and said processor means responsive to said first group of instructions and a first sequence of voiced frame and unvoiced frame and voiced frame for generating a new calculated pitch value indicating a voiced frame; a second group of instructions and said processor means responsive to said second group of instructions and a second sequence of unvoiced frame and voiced frame and unvoiced frame for generating a new calculated value indicating an unvoiced frame; and a third group of instructions and said processor means responsive to said third grou of instructions and a third sequence of voiced frame and voiced frame and voiced frame for generating a new calculated pitch value having a arithmetic relationship to the calculated pitch values of the frames of said third sequence.

22. the system of claim 21 wherein said first group of instructions comprises a first subgroup of instructions and said processor means responsive to said first subgroup of instructions and to said first sequence for setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence; and said second group of instructions further comprises a second subgroup of instructions and said processor means responsive to said second subgroup of instructions and said second sequence of frames for setting the new calculated pitch value to said predefined value.

23. The system of claim 22 wherein said second subset of instructions further comprises a fourth group of instructions and said processor means responsive to said fourth group of instructions and a fourth sequence of voiced frame and voiced frame and unvoiced frame for generating a new calculated pitch value equal to the average of the calculated pitch values for the two voiced frames and the unvoiced frame upon the difference between the two voiced frames being less than another predefined value; and a fifth group of instructions and said processor means responsive to said fifth group of instructions and said fourth sequence for generating a new calculated pitch value equal to the pitch value of the earlier voiced frame upon the difference between the pitch values for the two voiced frames being greater than said other predefined value.

24. The system of claim 20 wherein said first subset of instructions further comprises a first group of instructions and said processor means responsive to said first group of instructions and all of said estimated pitch values having a value different than said predefined value for setting said calculated pitch value equal to the arithmetic average of a subset of said estimated pitch values.

25. The system of claim 24 wherein said first subset of instructions further comprises a second group of instructions and said processor means responsive to said second group of intructions and all but a subset of said estimated pitch values equaling said predefined value for setting said calculated pitch value equal to the arithmetic average of said subset upon the estimated pitch values of said subset of said pitch values differing by less than another predefined value from each other; and a third group of instructions and said processor means responsive to said third group of instructions and to all of said estimated pitch values being equal to said predefined value except for a subset of said estimated pitch values for setting said calculated pitch value equal to said predefined value upon the difference between each of said pitch values of said subset being greater than an other predefined value.

26. The system of claim 25 wherein said first subset of instructions comprises a fourth group of instructions and said processor means responsive to said fourth group of instructions and to all of said estimated pitch values except for one estimated pitch value equaling said predefined value for setting said calculated pitch value equal to said estimated pitch value not equal to said predefined value.

27. A pitch detector system for human speech comprising: means for storing a predetermined number of evenly spaced samples of instantaneous amplitude of said speech as a speech frame; a plurality of identical means each responsive to an individual predetermined portion of said samples of said speech frame for estimating a pitch value of said speech frame; means for calculating a final pitch value from said ones of said estimated pitch values; and means for constraining said final pitch value so that the calculated pitch value is in agreement with calculated pitch values from previous frames.

28. The system of claim 27 wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and voiced frames are indicated by said calculated pitch value being equal to a value other than said predefined value, and said constraining means comprises: means responsive to a first sequence of voiced frame and unvoiced frame and voiced frame for generating a new calculated pitch value indicating a voiced frame; means responsive to a second sequence of unvoiced frame and voiced frame and unvoiced frame for generating a new calculated value indicating a unvoiced frame; and means responsive to a third sequence of voiced frame and voiced frame and voiced frame for generating a new calculated pitch value having an arithmetic relationship to the calculated pitch values of the frames of said third sequence.

29. The system of claim 28 wherein said generating means responsive to said first sequence comprises means for setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence; and generating means responsive to said second sequence of unvoiced and voiced and unvoiced frames for setting the new calculated pitch value to said predefined value.

30. The system of claim 29 wherein said constraining means further comprises means responsive to a fourth sequence of voiced frame and voiced frame and unvoiced frame for generating a new calculated pitch value equal to the average of the calculated pitch value for the voice frame and unvoiced frame upon the difference between the two voiced frames being less than another predefined value; and means responsive to said fourth sequence for generating a new calculated pitch value equal to the pitch value of the earlier voiced frame upon the difference between the pitch values for the two voiced frames being greater than said other predefined value.

31. The system of claim 28 wherein said calculating means comprises means responsive to all of said estimated pitch values having a value different than said predefined value for setting said calculated pitch value equal to the arithmetic average of a subset of median of said estimated pitch value.

32. The system of claim 27 wherein said calculating means further comprises means responsive to all but a subset of said estimated pitch values equaling said predefined value from said plurality of estimating means for setting said calculated pitch value equal to the arithmetic average of said subset upon the estimated pitch values of said subset of said pitch values differing by less than another predefined value from each other; and means responsive to all of said estimated pitch values being equal to said predefined value except for a subset of said estimated pitch values for setting said calculated pitch value equal to said predefined value upon the difference between each of said estimated pitch values of said subset being greater than said other predefined value.

33. The system of claim 27 wherein said calculating means comprises means responsive to all of said estimated pitch values except for one estimated pitch value equaling said predefined value for setting said calculated pitch value equal to said estimated pitch value not equal to said predefined value.

34. The system of claim 27 wherein said plurality of said estimating means each comprise means for locating the main sample of maximum amplitude within said individual predetermined analytical portion of said samples; means for locating samples of said predetermined portion of said samples of lesser amplitude than that of the maximum amplitude sample spaced by not less than a minimum distance based on the highest expected fundamental speech frequency from said maximum amplitude sample and from each other samples within said speech frame; means for measuring one-by-one the distance between adjacent located candidate samples using as a reference the location of said maximum amplitude sample: means for testing for periodicity by comparing successive distance measurements for substantial equality and rejecting candidate samples which are not periodically related to said maximum amplitude sample; means for determining said estimated pitch value by the quotient of the distance between extreme valid samples within said speech frame; and means for designating said speech frame upon the latter exhibiting periodicity as voiced and otherwise as unvoiced by setting said estimated pitch value equal to a predefined value.

35. The system of claim 34 wherein said plurality of said estimating means comprises four of said estimating means and each of said estimating means further comprises means responsive said samples for clipping the latter samples to produce said individual predetermined portion of said samples; the first and second of said estimating means further comprises means responsive to said individual predetermined portion of said samples that comprises said speech of said speech frame being the residual wave remaining after the formant effects of the vocal tract have been substantially removed; and said third and fourth ones of said estimating means further comprise responsive to the speech of said speech frame unaltered.

36. A method for detecting the pitch of human speech with a system comprising a quantizer for converting the speech into frames of digital samples and a digital signal processor responsive to a plurality of program instructions and said frame of digital samples to determine the pitch of the speech, said method comprising the steps of: producing residual samples of the digitizes speech that remain after the formant effects of the vocal track have been substantially removed by said processor responding to a first set of program instructions; estimating a first pitch value of the present speech frame by said processor responding to a second set of program instructions and positive ones of said digitized speech samples; estimating a second pitch value of said present speech frame by said processor responding to a third set of program instructions and negative ones of said digitized speech samples; 86/ 52 estimating a third pitch value of said present speech frame by said processor responding to a fourth set of program instructions and positive ones ^"of said residual samples; estimating a fourth pitch value of said present speech frame by said processor responding to a fifth set of program instruction and to negative ones of said residual samples; and determining a final pitch value of the last previous speech frame based on a plurality of previous speech frames and said present speech frame by said processor responding to a sixth set of program instruction and said estimated pitch values.

37. The method of claim 36 wherein said sixth set of program instruction comprises a first and a second subset of program instructions and said step of determining comprises the steps of: calculating said final pitch value from said first, second, third, and fourth pitch values by said processor responding to said first subset of program instructions; and constraining said final pitch value so that said final pitch value is in agreement with final pitch values from previous frames by said processor means being responsive to said second subset of program instructions.

38. The method of claim 37 wherein an unvoiced speech frame is indicated by said calculated pitch value being equal to a predefined value and a voiced frame is indicated by said calculated pitch value being equal to a value other than said predefined value and said second subset of program instructions comprises a first and a second and a third group of program instructions and said step of constraining further comprises the steps of: generating a new calculated pitch value indicating a voiced frame in response to a first sequence of voiced frame and unvoiced frame and voiced frame by said processor responding to a first group of program instructions; generating a new calculated value indicating an unvoiced frame in response to a second sequence of unvoiced frame and voiced frame and unvoiced frame by said processor responding to said second group of program instructions; and generating a new calculated pitch value having a arithmetic relationship to the calculated pitch values of the frames of a third sequence of voiced frame and voiced frame and voiced frame by said processor responding to said third group of program instructions.

39. The method of claim 38 wherein said first group of program instructions comprises a first subgroup of program instructions and said second group of program instructions comprises a second subgroup of program instructions and said step of generating a new calculated value in response to said first sequence comprises the step of setting the new calculated pitch value equal to the arithmetic average of the calculated pitch values of the voiced frames of said first sequence by said processor responding to said first subgroup of program instructions; and said step of generating a new calculated value for said second sequence comprises the step of setting the new calculated pitch value of said second sequence equal to said predefined value by said processor responding to said second subgroup of program instructions.

40. The method of claim 39 wherein said second subset of program instructions further comprises a fourth group of program instructions and a fifth group of program instructions and a fourth sequence of voiced frame and voiced frame and unvoiced frame and said constraining step further comprises the step of generating a new calculated pitch value equal to the average of the calculated pitch values for the^' two voiced frames and the unvoiced frame upon the difference between the two voiced frames being less than another predefined value by said processor in response to said fourth group of program instructions; and generating a new calculated pitch value equal to the pitch value of the earlier voiced frame upon the difference between the two pitch values for the two voiced frames being greater than said other predefined value by said processor in response to said fifth group of instructions.