Classifications

• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
  • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
  • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
  • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T9/00—Image coding
  • G06T9/004—Predictors, e.g. intraframe, interframe coding
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T9/00—Image coding
  • G06T9/005—Statistical coding, e.g. Huffman, run length coding
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
  • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
  • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
  • G10L19/06—Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04B—TRANSMISSION
  • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
  • H04B1/66—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission for reducing bandwidth of signals; for improving efficiency of transmission

Definitions

• This invention relates to speech signal communication systems and more particularly to digital speech signal processing adapted to reduce transmission rates.
• the processing of signals for transmission over digital channels in telephone and other types of communication systems generally includes the sampling of the input signals, quantization of the samples, and generation of a set of codes representative of the quantized signal samples.
• speech signal samples are highly correlated so. that each signal sample has a component that is predictable from its past values. The predictable and unpredictable components of the speech signal can be separated and encoded at appropriate rates to provide efficient utilization of a digital channel without affecting the subjective quality of the speech signal.
• Predictive signal arrangements as disclosed in U. S. patents 3,502,986 and 3,631,520 involve generation of predictive parameter signals from the succession of speech samples and the formation of a predicted value for each speech signal sample from the generated parameters and the preceding speech signal samples.
• the difference between each sample and its predicted value is quantized, digitally encoded, and sent to a receiver along with the predictive parameters.
• the difference signal is encoded at the receiver and combined with the predictive parameters and other signal information already stored in the receiver. In this manner, only the unpredicted signal component need be quantized and transmitted at a high bit rate and a saving in channel capacity is achieved. The saving is generally reflected in the reduced bit rate needed to transmit a signal of predetermined quality.
• U. S. Patent 4 ,133 ,976 issued April 7, 1978 to B.
• S. Atal and M. R. Schroeder and assigned to the same assignee discloses a predictive speech signal coding arrangement in which a set of formar ⁇ tr-related predictive parameters corresponding to the short-term redundant structure of the speech signal and a set of pitch-related prediction parameters corresponding to the long-term redundant structure of the speech signal are generated. Since the speech signal is quasi-stationary, the prediction parameters need only be generated once every 10 milliseconds. The remaining portion of the speech signal corresponds to the unpredicted component generally termed the prediction residual.
• the transmission rate of the prediction residual is critical to the quality of the reconstructed speech signal.
• the predicted signal component parameters require a transmission rate of 3 to 4 kilobits per second.
• the invention is directed to a predictive speech signal communication arrangement in which an input signal is analyzed in successive time intervals to generate a set of prediction parameter signals for each interval. Jointly responsive to the input signal and the prediction parameter signals, a signal representative of the prediction residual is produced. A quantized signal corresponding to the prediction residual is generated and encoded for transmission over a digital channel.
• the quantized signal generation includes partitioning the prediction residual signal into a plurality of distinct portions and selectively quantizing the distinct portions of the prediction residual signal.
• FIG. 1 depicts a block diagram of a digital speech signal coding circuit illustrative of the invention
• FIG. 2 depicts a block diagram of a digital speech signal decoding circuit useful in conjunction with the circuit of FIG. 1;
• FIG. 3 depicts a detailed block diagram of the prediction parameter computer of the circuit of FIG. 1;
• FIG. 4 shows a detailed block diagram of the threshold signal generator circuit of FIG. 1;
• FIG. 5 shows a detailed block diagram of the formant predictor circuits of FIGS. 1 and 2;
• FIG. 6 shows a detailed block diagram of the voice periodicity predictors of FIGS. 1 and 2;
• FIG. 7 shows waveforms illustrating the operation of the predictive parameter circuit of FIG. 3.
• FIG. 8 shows signal waveforms illustrative of the operation of the circuit of FIG. 1.
• FIG. 1 depicts a predictive speech signal coder illustrative of the invention.
• a speech signal s(t) from speech signal source 101 is supplied to filter and sampler circuit 103.
• Signal s (t) is low-pass filtered and modified by a high frequency emphasis arrangement in circuit 103 and is then sampled at a predetermined rate.
• Circuit.103 may comprise a low-pass filter with a cutoff frequency of 4 kilohertz, a preemphasis ne «twork with a +6db per octave slope beginning at 700 hertz, and a sampler having a sampling rate of 8 kilohertz.
• the successive signal samples from circuit 103 are applied to analog-to- digital converter 105.
• a digital code s suitable for use in the encoder is produced for each signal sample
• the coded signal samples s n from converter 105 are sequentially applied to one input of predictive parameter computer 135.
• the s n samples are also supplied to fbrmant predictor 107 through a delay 106 and lead 108.
• Delay 106 may comprise a shift register or other delay elements well known in the art.
• predictor 107 is operative to predict the present value of each signal sample s from the weighted sum of a number of prior sample values in accordance with expression 1. The prediction is based on the short-term spectral envelope of the speech signal and the formant structure of the vocal tract as represented by the prediction parameter signals a 1 , a 2 ,...,a p .
• FIG. 5 shows a transversal filter well known in the art which may be used as formant predictor 107.
• the predictor of FIG. 5 is characterized in z transform notation as
• shift register 503 is a 10 stage register operated at an 8 kilohertz sampling rate.
• the sampling clock pulses CLI are provided by clock generator 140.
• Register 503 receives the successive s samples from delay 106 on line 501.
• the output of the first register stage on line 504-1 is supplied to one input of multiplier 505-1.
• the outputs of the remaining stages of shift register 503 on lines 504-2 through 504-10 are supplied to multipliers 505-2 through 505-10, respectively.
• the linear prediction coefficient signals a 1 , a 2 ,...,a 10 are applied to multipliers 505-1 through 505-10 via line 510 as indicated in FIG. 5.
• Each multiplier is operative to form the product s n-k a k .
• the products are summed two at a time in adders 507-2 through 507-10.
• the signal representative of the sum of the products in accordance with expression 1 is then available on the tranverse filter output line 512.
• the predicted signal from formant predictor 107 is applied to the negative input of subtractor network 109 wherein it is subtracted from the current coded sample s n of the speech signal from delay 106.
• Voice periodicity predictor 128 is effective to remove pitch related redundancy from the speech signal whereby the prediction residual of the speech signal is further reduced.
• the output of quantizer 111 is supplied to adder 131.
• the sum of the quantizer output signal QO n and the predicted. difference signal is formed in adder 131.
• the sum output of adder 131 is supplied to the input of periodicity predictor 128.
• predictor 128 produces a signal representative of the predicted value of the present difference signal in accordance with
• b 1 , and b 3 are prediction coefficient signals determined by minimizing the mean squared prediction error between the difference signal d n and its predicted value. Signals M and b 1 , b 2 , and b 3 are produced in computer 135 for each speech signal interval. The predicted value of the current difference signal d n is subtracted from the output of subtractor 109 in subtraction network 126. In this manner the pitch period related redundancy of the speech signal is removed from the difference signal.
• FIG. 6 shows an arrangement for predictor 128.
• shift register 603 comprises 120 stages. These stages store the successive samples received from adder 131 on line 601.
• the 120 stages of register 603 provide a time period of 15 milliseconds which period is the longest anticipated pitch interval in the speech signal.
• the output of each stage of the shift register is supplied to selector circuit 605.
• the selector circuit is. operative to selectively gate three consecutive shaft register stage outputs responsive to signal M from computer 135. The selection. is done in accordance with equations 4 and 5.
• the output of the left-most selected shift register stage is applied to multiplier 606-1.
• the output of the other selected shift register stages are applied to multipliers 606-2 and 606-3 respectively.
• predictive parameter signals b 1 , b 2 , and b 3 are applied to multipliers 606-1, 606-2, and 606-3 from computer 135 via line 611.
• the product codes from the multipliers are summed in adders 607-2 and 607-3. In this manner the predicted value code d n for the present difference signal appears on line 612.
• Prediction parameter computer 135 generates the predictive parameter signals required for the operation of the coder circuit of FIG. 1.
• Speech signals as is well known in the art, are nonstationary. The characteristics of speech, however, change relatively slowly so that it is sufficient to adapt the predictive parameter signals to the changing speech signal once every 10 milliseconds at an 8 kilohertz sampling rate.
• prediction parameter computer 135 receives the speech samples s n from A-to-D converter 105 during each 10 millisecond time frame. Responsive to the signal samples, computer 135 provides prediction parameter and other signals for the next 10 millisecond time frame to accommodate the changing signal conditions. The signal samples s n are delayed in delay 106 so that the delay in parameter signal formation is accounted for.
• FIG. 3 shows a signal processing arrangement suitable for use as computer 135 in FIG. 1.
• processor 309 is operative to generate a set of formant related linear prediction coefficient signals a 1 ,a 2 ...,a 10 , a set of pitch related prediction coefficient signals b 1 , b 2 , b 3 , a set of formant related partial co rrelation coeffici ent signals r 1 , r 2 . . . , r 10 , a ⁇ 0 signal to control the threshold of center clipper 164, a ⁇ p signal for noise shaping control, a pitch related signal M, and a step-size signal ⁇ for use in other portions of the coder of FIG. 1.
• the output signals from processor 309 are stored in output stores 331 through 337.
• Processor 309 may be one of several microprocessor or othe small size computer arrangements such as the C.S.P., Inc. Macro Arithmetic Processor System 100.
• Controller 307 of FIG. 3 is adapted to partition each 10 millisecond speech frame into a sequence of predetermined time periods, each time period being dedicated to a particular operating mode.
• the operating modes are illustrated in FIG. 7.
• Clock pulses CL2 from clock 140 of FIG. 1 are shown in waveform 703.
• a CL2 clock pulse occurs at time t 1 the beginning of the 10 millisecond time frame illustrated in FIG. 7.
• This CL2 clock pulse places controller 307 in its data input mode until time t 2 as illustrated in waveform 705.
• controller 307 is connected to processor 309 and to speech sample store 320. Responsive to control signals from controller 307, the 80 s n sample codes inserted into sample store 320 in the immediately preceding 10 millisecond time frame are transferred to data memory 316 via input-output interface 318. The data input mode is terminated at time t 2 when 80 sample codes from store 320 have been supplied to predetermined addresses in data memory 316. While the stored 80 samples are transferred into data memory 315, the speech samples of the current frame are continually inserted into store 320 under control of clock pulse CLI.
• the stored instructions for the generation of the formant predictor signals in ROM 303 are listed in FORTRAN language in Appendix 1.
• these parameter signals are generated by forming the covariance matrix P whose terms are
• T is the lower triangular matrix obtained by the triangular decomposition of
• the partial correlation coefficients r m are then generated in accordance with
• Formant linear prediction parameter signals A a 1 ,a 2 ...,a 10 , are computed from the partial correlation parameter signals r in accordance with the recursive formulation
• the partial correlation parameter signals r m and the linear prediction parameter signals a i generated in processor 309 during the formant prediction parameter mode are transferred from data memory 316 to stores 331 and 333 for use during the next 10 millisecond time frame.
• the signals A are also transferred to noise shaping filter 173 in FIG. 1.
• controller 307 is operative to count the CLI clock pulses from clock 140 to determine the termination time of the mode.
• controller 307 is placed in its pitch prediction parameter mode as illustrated in waveform 709. Between times t 3 and t 4 , controller 307 is operative to connect pitch prediction program memory 305 to central processor 312 via controller interface 310 and bus 340.
• the instruction codes permanently stored in ROM 305 are listed in FORTRAN language in Appendix 2. These instruction codes are operative to form the pitch parameter signals b 1 , b 2 , and b 3 , as well as pitch-related signal M for use in voice periodicity predictor 128 of FIG. 1.
• Processor 309 is operative during the pitch prediction mode to determine the correlations between different signals d n and d n-i over a prescribed interval as shown in Equation 12
• Processor 309 is further operative to compute pitch prediction parameters b 1 , b 2 , and b 3 on the basis of the minimization of .
• Signals M and b 1 , b 2 , and b 3 are transferred to stores 332 and 335 via input-output interface circuit 318 by time t 4 .
• the signal shown in waveform 711 is enabled.
• controller 307 is operative to connect quantizer step-size program store 306 to processor 309.
• processor 309 is adapted to receive the permanently stored instruction codes of ROM 306. These instruction codes are shown in the FORTRAN language listing of Appendix 3.
• processor 309 is operative to generate signal R in accordance with
• step-size signal ⁇ in accordance with
• v pea k is the peak val ue of th e signal d n -b 1 d n -M+ 1 -b 2 d n -M -b 3 d n -M- 1 .
• Signals ⁇ p and ⁇ o are also fo rmed in acco rdance wi th
• the ⁇ p , ⁇ and ⁇ o signals are then stored in stores 334, 336, and 337 respectively by time t 5 .
• the signals from stores 331 through 337 formed during a 10 millisecond time frame are then available at the output of parameter computer 135 for the next successive time frame in the circuit of FIG. 1.
• the signals s n from converter 105 are simultaneously supplied to parameter computer 135 and delay 106 whereby the outputs of computer 135 are effective to control the sequence of speech samples s n from which they were formed.
• the output of subtractor 126 corresponds to the speech signal with both formant and pitch period, redundancies removed.
• Subtractor 162 is jointly responsive to the redundancy free signal from subtractor 126 and the output of noise-shaping filter 173 to provide a minimum redundancy and noise-shaped signal.
• Threshold generator 160 receives an initial threshold value signal ⁇ o for the current 10 millisecond time frame from prediction parameter computer 135.
• the threshold value output signal ⁇ n which controls the center clipping thresholds of clipper circuit 164 is a function of the initial threshold value ⁇ o , the redundancy reduced prediction residual signal v n , the noise filter input to the center clipper QI n and the output samples QO n from quantizer 111.
• the threshold value is adapted during each time frame so that only a predetermined percent ⁇ of the prediction residual samples are supplied to quantizer 111. The samples from the center clipper can then be accurately quantized. Typically only 10 percent of the quantized prediction residual samples need be nonzero.
• the initial threshold value ⁇ 0 is selected so that it is exceeded by only 10 percent of the values of the signal v n in that frame.
• Threshold signal generator 160 is adapted to supply a varying ⁇ n signal to center clipper 164 so that the selected percentage, e.g., 10 percent of the prediction residual samples are nonzero.
• Threshold signal generator 160 is shown in greater detail in FIG. 4.
• the prediction residual signal v n is supplied from subtractor 126 to absolute value former 401.
• the absolute value former may comprise a sign control circuit for digital coded input signals or a full wave. rectifier circuit for analog or sampled data type signals.
• the signal .from subtractor 162 is passed through absolute value former 403 while the signal from the output of multiplier 168 is supplied to absolute value former 405.
• the output of absolute former circuit 401 is averaged in averaging circuit 407 with a five millisecond time constant characteristic to form signal '
• the output of absolute value former 403 is averaged in circuit 409 with the five millisecond time constant characteristic to form signal
• the signal from absolute former 405 is averaged in circuit 411 with a five millisecond, time constant characteristic to form signal
• the output of averaging circuit 409 is supplied to one input of divider circuit 415 while the output of averaging circuit 407 is supplied to the other input.
• Divider circuit 415 is operative to form the ratio
• the signal from averaging circuit 411 is scaled by a factor of Y 100 in multiplication circuit 420 and the output of sealer circuit 420 is multiplied by the ratio obtained from divider 413.
• the typical value of Y is 10 percent.
• the resultant at the output of multiplier 425 is multiplied by the initial threshold value ⁇ o to form the threshold signal
• the center clipped prediction residual signal from center clipper 164 is supplied to quantizer 111 which may comprise a 15 level uniform quantizer with step size v peak /7.
• quantizer 111 which may comprise a 15 level uniform quantizer with step size v peak /7.
• Waveform 801 represents speech signal s(t) after preemphasis in filter 103.
• Waveform 803, 805, and 807 are obtained from the arrangement of FIG. 1 in which center clipper circuit 164 and threshold signal generator 160 are removed and quantizer 111 is a two level quantizer. Such system is typical of prior art arrangements.
• Waveform 803 represents the input signal to the two-level quantizer and waveform 805 is the quantized signal obtained therefrom.
• Waveform 807 is the decoded speech signal resulting from waveform 805. As is readily seen, it is difficult to avoid both peak clipping and granular distortion in the two-level quantizer scheme.
• Waveform 809 is the output signal from subtractor 162 in FIG. 1 with the adaptive center clipping apparatus and a 15 level quantizer.
• the broken line in waveform 809 represents the threshold level ⁇ n from generator 160.
• Waveform 811 represents the output of quantizer 111 in FIG. 1. As is evident in waveform 811, only those portions of the signal in waveform 809 which exceed threshold level signal ⁇ n are accurately quantized. All other portions are replaced by zero value samples.
• the reconstructed speech signal derived from waveform 811 is shown in waveform 813. It is evident from waveform 813 that substantially less peak clipping and less granular distortion results from the adaptive center clipping arrangement of FIG. 1. The improved results are obtained with a reduction of step size and considerable improvement in the quality of the reconstructed speech.
• the quantizer output signal obtained from multiplier 168, QO n is temporarily stored in store 170 and the prediction residual signals therefrom are converted into digital codes in coder 112. Coding arrangements such as those described in the article "On Variable Length to Block Coding" appearing in the ITEE Transactions on Information Theory Volume IT-18, pages 765-744, November 1972 by F. Jelinik and K. S. Schneider or in the article "A 9.6/16 KB/S Speech Digitizer" by S. U. H. Qureshi and G. D. Forney, Jr. appearing in the Conference Record of the International Conference on Communications, pages 30-
• coder 112 corresponds to the prediction residual component of the speech signal from signal source 101.
• Multiplexer and modulator circuit 115 is adapted to assemble the codes from coder 112 and the parameter outputs of predictor computer 135 into a combined signal set and to supply the signal set in appropriately modulated form to communication channel 150.
• the decoder circuit shown in FIG. 2 receives the transmission from communication channel 150 and is operative to form a replica of the speech signal s (t).
• modulator and demultiplexer circuit 201 is responsive to the signals received from communication channel 150 to provide the quantized prediction residual signal q n and step size signal ⁇ to digital decoder 203.
• the digital decoder causes signal q n to be scaled by step size signal ⁇ .
• the scaled quantized prediction residual signal is applied to one input of adder circuit 205.
• the other input to the adder circuit is provided by voice periodicity predictor 217.
• predictor 217 is substantially identical to predictor 128 of FIG. 1 as shown in FIG. 6. Responsive to the sequence of signal codes from adder 205 and prediction parameter signals b 1 , b 2 , b 3 , and M from store 213, predictor 217 adds the pitch related predicted component of the speech signal to the prediction residual from decoder 203.
• the resulting excitation signal from adder 205 is then applied to one input of adder 207.
• the other input of adder 207 is obtained from formant predictor 219.
• the parcor parameter signals r m for each 10 millisecond time frame are transferred from demultiplexer 201 to coefficient converter and store 215.
• Coefficient converter 215 may comprise a signal processor such as used in computer 135 of FIG. 1 or other miniature processor arrangements well known in the art.
• Converter 215 forms the prediction- parameter signals a 1 ,a 2 ...,a 10 , from the partial correlation signals r m in accordance with the recursive formulation of equation 11.
• Signals r m are transmitted over channel 150 because, as is well known in the art, improved signal stability results.
• Formant predictor 219 is identical to predictor 107 of FIG.
• the formant predictor Responsive to the excitation signals from adder 207 and the formant prediction parameter signals a 1 ,a 2 ...,a 10 from converter 215, the formant predictor generates the predicted formant component of the speech signal. Consequently, the output of adder 207 corresponds to the sequence of signal codes s n which codes form a replica of the signal codes s n in the circuit of FIG. 1.
• the adder output is supplied to digital-to-analog converter circuit 209.
• the analog signal from converter 209 is then filtered in filter 211 so that components above 4 kilohertz are removed.
• the output of filter 211 is an analog replica signal .
• XX PX IF (I .EQ. 1 .AND. I .EQ . J)
• XX PX IF (I .EQ. 1 .AND. J .CT. 1)
• XX C(J-I) IF (I .GT. 1)
• XX P(I-1,J-1) 20
• P(I,J) xx + X(11-I)*X(11-J) - X( 91-1) *X( 91-J)
• K 1 6 IF (K .GT. 1/2) GO TO 100
• PD1 PD1 + (D(121-I) + D( 201-1) *( D ( 121-1) - D(201-I))
• CORM CORT + 0.125* ((CORP - CORL) **2) / ( 2*CORT - CORP -CORL
• R1 -PD1/PD
• B1 ( (1-R1)*(C1+C3) + (1-2*R1+R2)*C2)/(1-2*R1**2+R2)
• B(1) 0.5*(B2 + B3)
• B(3) 0.5*(B3 -B2)
• B(2) B1 - B(1) - B(3)

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Computational Linguistics (AREA)
• Health & Medical Sciences (AREA)
• Audiology, Speech & Language Pathology (AREA)
• Human Computer Interaction (AREA)
• Acoustics & Sound (AREA)
• Computer Networks & Wireless Communication (AREA)
• Spectroscopy & Molecular Physics (AREA)
• Compression, Expansion, Code Conversion, And Decoders (AREA)

Applications Claiming Priority (2)

Publications (3)

Family

ID=22481316

Family Applications (1)

Country Status (6)

Families Citing this family (16)

Citations (2)

Family Cites Families (6)

• 1980
  • 1980-04-08 US US06/138,281 patent/US4354057A/en not_active Ceased
• 1981
  • 1981-03-18 JP JP56501418A patent/JPS5912200B2/ja not_active Expired
  • 1981-03-18 WO PCT/US1981/000337 patent/WO1981002942A1/en active IP Right Grant
  • 1981-03-18 EP EP81901051A patent/EP0049271B1/de not_active Expired
  • 1981-03-24 CA CA000373707A patent/CA1144650A/en not_active Expired
  • 1981-04-06 GB GB8110706A patent/GB2073554B/en not_active Expired

Patent Citations (2)

Non-Patent Citations (4)

Also Published As

Similar Documents

Legal Events