WO2003049081A1 - Low bit rate codec - Google Patents

Low bit rate codec Download PDF

Info

Publication number
WO2003049081A1
WO2003049081A1 PCT/SE2002/002226 SE0202226W WO03049081A1 WO 2003049081 A1 WO2003049081 A1 WO 2003049081A1 SE 0202226 W SE0202226 W SE 0202226W WO 03049081 A1 WO03049081 A1 WO 03049081A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
signal
encoding
encoded
decoding
Prior art date
Application number
PCT/SE2002/002226
Other languages
French (fr)
Inventor
Sören V. ANDERSEN
Roar Hagen
Bastiaan Kleijn
Original Assignee
Global Ip Sound Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Global Ip Sound Ab filed Critical Global Ip Sound Ab
Priority to AU2002358365A priority Critical patent/AU2002358365A1/en
Priority to US10/497,530 priority patent/US7895046B2/en
Priority to EP02792126A priority patent/EP1451811B1/en
Priority to AT02792126T priority patent/ATE437431T1/en
Priority to DE60233068T priority patent/DE60233068D1/en
Publication of WO2003049081A1 publication Critical patent/WO2003049081A1/en
Priority to US13/030,929 priority patent/US8880414B2/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0212Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using orthogonal transformation

Definitions

  • the present invention relates to predictive encoding and decoding of a signal, more particularly it relates to predictive encoding and decoding of a signal representing sound, such as speech, audio, or video.
  • Real-time transmissions over packet switched networks such as speech, audio, or video over Internet Protocol based networks (mainly the Internet or Intranet networks)
  • Internet Protocol based networks mainly the Internet or Intranet networks
  • features include such things as relatively low operating costs, easy integration of new services, and one network for both non-real -time and real-time data.
  • Real-time data typically a speech, an audio, or a video signal
  • a digital signal i.e. into a bitstream, which is divided in portions of suitable size in order to be transmitted in data packets over the packet switched network from a transmitter end to a receiver end.
  • packet switched networks originally were designed for transmission of non-real-time data, transmissions of real-time data over such networks causes some problems.
  • Data packets can be lost during transmission, as they can be deliberately discarded by the network due to congestion problems or transmission errors. In non-realtime applications this is not a problem since a lost packet can be retransmitted. However, retransmission is not a possible solution for real-time applications that are delay sensitive. A packet that arrives too late to a real-time application cannot be used to reconstruct the corresponding signal since this signal already has been, or should have been, delivered to the receiving end, e.g. for playback by a speaker or for visualization on a display screen. Therefore, a packet that arrives too late is equivalent to a lost packet.
  • the main problem with lost or delayed data packets is the introduction of distortion in the reconstructed signal.
  • the distortion results from the fact that signal segments conveyed by lost or delayed data packets cannot be reconstructed .
  • a predictive coding method encodes a signal pattern based on dependencies between the pattern representations. It encodes the signal for transmission with a fixed bit rate and with a tradeoff between the signal quality and the transmitted bit rate.
  • Examples of predictive coding methods used for speech are Linear Predictive Coding (LPC) and Code Excited Linear Prediction (CELP) , which both coding methods are well known to a person skilled in the art.
  • a coder state is dependent on previously encoded parts of the signal.
  • a lost packet will lead to error propagation since information on which the predictive coder state at the receiving end is dependent upon will be lost together with the lost packet. This means that decoding of a subsequent packet will start with an incorrect coder state. Thus, the error due to the lost packet will propagate during decoding and reconstruction of the signal.
  • One way to solve this problem of error propagation is to reset the coder state at the beginning of the encoded signal part included by a packet.
  • a reset of the coder state will lead to a degradation of the quality of the reconstructed signal.
  • Another way of reducing the effect of a lost packet is to use different schemes for including redundancy information when encoding the signal. In this way the coder state after a lost packet can be approximated.
  • not only does such a scheme require more bandwidth for transferring the encoded signal, it furthermore only reduces the effect of the lost packet . Since the effect of a lost packet will not be completely eliminated, error propagation will still be present and result in a perceptually lower quality of the reconstructed signal.
  • Another problem with state of the art predictive coders is the encoding, and following reconstruction, of sudden signal transitions from a relatively very low to a much higher signal level, e.g. during a voicing onset of a speech signal.
  • a coder state reflect the sudden transition, and more important, the beginning of the voiced period following the transition. This in turn will lead to a degraded quality of the reconstructed signal at a decoding end.
  • An object of the present invention is to overcome at least some of the above-mentioned problems in connection with predictive encoding/decoding of a signal which is transmitted in packets. Another object is to enable an improved performance at a decoding end in connection with predictive encoding/decoding when a packet with an encoded signal portion transmitted from an encoding end is lost before being received at the decoding end. Yet another object is to improve the predictive encoding and decoding of a signal which undergoes a sudden increase of its signal power.
  • a signal is divided into blocks and then encoded, and eventually decoded, on a block by block basis.
  • the idea is to provide predictive encoding/decoding of a block so that the encoding/decoding is independent on any preceding blocks, while still being able to provide predictive encoding/decoding of a beginning end of the block in such way that a corresponding part of the signal can be reproduced with the same level of quality as other parts of the signal .
  • This is achieved by basing the encoding and the decoding of a block on a coded start state located somewhere between the end boundaries of the block. The start state is encoded/decoded using any applicable coding method.
  • a second block part • and a third block part, if such a third part is determined to exist, on respective sides of the start state and between the block boundaries are then encoded/decoded using any predictive coding method.
  • the two block parts are encoded/decoded in opposite directions with respect to each other. For example, the block part located at the end part of the block is encoded/decoded along the signal pattern as it occurs in time, while the other part located at the beginning of the block is encoded/decoded along the signal pattern backwards in time, from later occurring signal pattern to earlier occurring signal pattern.
  • the third block part is encoded in an opposite direction in comparison with the encoding of the second block part .
  • decoding of an encoded block is performed in three stages when reproducing a corresponding decoded signal block.
  • a predictive decoding method based on the start state is used for reproducing the second part of the block located between the start state and one of the two end boundaries of the block.
  • the signal subject to encoding in accordance with the present invention either corresponds to a digital signal or to a residual signal of an analysis filtered digital signal.
  • the signal comprises a sequential pattern which represents sound, such as speech or audio, or any other phenomena that can be represented as a sequential pattern, e.g. a video or an ElectroCardioGram (ECG) signal.
  • ECG ElectroCardioGram
  • the encoding/decoding of the start state uses a coding method which is independent of previous parts of the signal, thus making the block self-contained with respect to information defining the start state.
  • predictive encoding/decoding is preferably used also for the start state.
  • the signal block is divided into a set of consecutive intervals and the start state chosen to correspond to one or more consecutive intervals of those intervals that have the highest signal energy.
  • the start state can be optimized towards a signal part with relatively high signal energy. In this way an encoding/decoding of the rest of the block is accomplished which is efficient from a perceptual point of view since it can be based on a start state which is encoded/decoded with a high accuracy.
  • An advantage of the present invention is that it enables the predictive coding to be performed in such way that the coded block will be self-contained with respect to information in the excitation domain, i.e. the coded information will not be correlated with information in any previously encoded block. Consequently, at decoding, the decoding of the encoded block is based on information self-contained in the encoded block. This means that if a packet carrying an encoded block is lost during transmission, the predictive decoding of subsequent encoded blocks in subsequent received packets will not be affected by lost state information in the lost packet.
  • the present invention avoids the problem of error propagation that conventional predictive coding/decoding encounter during decoding when a packet carrying an encoded block is lost before reception at the decoding end. Accordingly, a codec applying the features of the present invention will become more robust to packet loss.
  • the start state is chosen so as to be located in the part of the block which is associated with the highest signal power.
  • a speech signal composed of voiced and unvoiced parts
  • high correlation exists between signal samples within a voiced part and low correlation between signal samples within an unvoiced part.
  • the correlation in the transition region between an unvoiced part and a voiced part, and vice versa, is minor and difficult to exploit. From a perceptual point of view it is more important to achieve a good waveform matching when reproducing a voiced part of the signal, whereas the waveform matching for an unvoiced part is less important.
  • the present invention is able to more fully exploit the high correlation in the voiced region to the benefit for the perception.
  • the transition from unvoiced to highly periodic voiced sound takes a few pitch periods.
  • the high bit rate of the start state encoding will be applied in a pitch cycle where high periodicity has been established, rather than in one of the very first pitch cycles of the voiced region.
  • Fig. 1 shows an overview of the transmitting part of a system for transmission of sound over a packet switched network
  • Fig. 2 shows an overview of the receiving part of a system for transmission of sound over a packet switched network
  • Fig. 3 shows an example of a residual signal block
  • Fig. 4 shows integer sub-block and higher resolution target for start state for the encoding of the residual Of Fig. 3;
  • Fig. 5 shows a functional block diagram of an encoder encoding a start state in accordance with an embodiment of the invention
  • Fig. 6 shows a functional block diagram of a decoder performing a decoding operation corresponding to the encoder in Fig. 5;
  • Fig. 7 shows the encoding of a signal from the start state towards the block end boundaries
  • Fig. 8 shows a functional block diagram of an adaptive codebook search advantageously exploited by an embodiment of the present invention.
  • the encoding and decoding functionality according to the invention is typically included in a codec having an encoder part and a decoder part.
  • a codec having an encoder part and a decoder part.
  • an embodiment of the invention is shown in a system used for transmission of sound over a packet switched network.
  • an encoder 130 operating in accordance with the present invention is included in a transmitting system.
  • the sound wave is picked up by a microphone 110 and transduced into an analog electronic signal 115.
  • This signal is sampled and digitized by an A/D-converter 120 to result in a sampled signal 125.
  • the sampled signal is the input to the encoder 130.
  • the output from the encoder is data packets 135.
  • Each data packet contains compressed information about a block of samples.
  • the data packets are, via a controller 140, forwarded to the packet switched network.
  • a decoder 270 operating in accordance with the present invention is included in a receiving system.
  • the data packets are received from the packet switched network by a controller 250, and stored in a jitter buffer 260. From the jitter buffer data packets 265 are made available to the decoder 270.
  • the output of the decoder is a sampled digital signal 275. Each data packet results in one block of signal samples.
  • the sampled digital signal is input to a D/A-converter 280 to result in an analog electronic signal 285. This signal can be forwarded to a sound transducer 290, containing a loudspeaker, to result in to reproduced sound wave.
  • LPC linear predictive coding
  • APC adaptive predictive coding
  • CELP code excited linear prediction
  • a codec according to the present invention uses a start state, i.e., a sequence of samples localized within the signal block to initialize the coding of the remaining parts of the signal block.
  • the principle of the invention complies with an open-loop analysis-synthesis approach for the LPC as well as the closed-loop analysis- by-synthesis approach, which is well known from CELP.
  • An open-loop coding in a perceptually weighted domain provides an alternative to analysis-by-synthesis to obtain a perceptual weighting of the coding noise. When compared with analysis-by-synthesis this method provides an advantageous compromise between voice quality and computational complexity of the proposed scheme.
  • the open-loop coding in a perceptually weighted domain is described later in this description.
  • the input to the encoder is the digital signal 125.
  • This signal can take the format of 16 bit uniform pulse code modulation (PCM) sampled at 8 kHz and with a direct current (DC) component removed.
  • PCM uniform pulse code modulation
  • DC direct current
  • the input is partitioned into blocks of e.g. 240 samples. Each block is subdivided into, e.g. 6, consecutive sub- blocks of, e.g., 40 samples each.
  • any method can be used to extract a spectral envelope from the signal block without diverging from the spirit of the invention.
  • One method is outlined as follows: For each input block, the encoder does a number, e.g. two, linear-predictive coding (LPC) analysis, each with an order of e.g. 10.
  • LPC linear-predictive coding
  • the resulting LPC coefficients are encoded, preferably in the form of line spectral frequencies (LSF) .
  • LSF line spectral frequencies
  • the encoding of LSF ' s is well known to a person skilled in the art. This encoding may exploit correlations between sets of coefficients, e.g., by use of predictive coding for some of the sets.
  • the LPC analysis may exploit different, and possibly non- symmetric window functions in order to obtain a good compromise between smoothness and centering of the windows and lookahead delay introduced in the coding.
  • the quantized LPC representations can advantageously be interpolated to result in a larger number of smoothly time varying sets of LSF coefficients. Subsequently the LPC residual is obtained using the quantized and smoothly interpolated LSF coefficients converted into coefficients for an analysis filter.
  • FIG. 3 An example of a residual signal block 315 and its partition into sub-blocks 316, 317, 318, 319, 320 and 321 is illustrated in Figure 3, the number of sub-blocks being merely illustrative. In this figure each interval on the time axis indicates a sub-block.
  • the identification of a target for a start state within the exemplary residual block in Figure 3 is illustrated in Figure 4. In a simple implementation this target can, e.g., be identified as the two consecutive sub-blocks 317 and 318 of the residual exhibiting the maximal energy of any two consecutive sub-blocks within the block.
  • the length of the target can be further shortened and localized with higher time resolution by identifying a subset of consecutive samples 325 of possibly predefined length within the two-sub-block interval.
  • a subset can be chosen as a trailing or tailing predefined number, e.g. 58, of samples within the two-sub-block interval.
  • the choice between trailing or tailing subset can be based on a maximum energy criterion.
  • start state can be encoded with basically any encoding method.
  • scalar quantization with predictive noise shaping is used, as illustrated in Figure 5.
  • the scalar quantization is pre-pended with an all-pass filtering 520 designed to spread the sample energy on all samples in the start state. It has been found that this results in a good tradeoff between overload and granular noise of a low rate bounded scalar quantizer.
  • a simple design of such an all -pass filter is obtained by applying the LPC synthesis filter forwards in time and the corresponding LPC analysis filter backwards in time. To be specific, when the quantized LPC analysis filter is Aq(z), with coefficients 516. Then the all-pass filter 520 is given by Aq(z A -l) /Aq (z) .
  • the filtered target 525 is normalized to exhibit a predefined maximal amplitude by the normalization 530 to result in the normalized target 535 and an index of quantized normalization factor 536.
  • the weighting of the quantization error is divided into a filtering 540 of the normalized target 535 and a filtering 560 of the quantized target 556, from which the ringing, or zero-input response, 545 for each sample is subtracted from the weighted target 545 to result in the quantization target 547, which is input to the quantizer 550.
  • the result is a sequence of indexes 555 of the quantized start state.
  • any noise shaping weighting filter 540 and 560 can be applied in this embodiment.
  • the same noise shaping is applied in the encoding of the start state as in the subsequent encoding of the remaining signal block, described later.
  • memset targetBuf , 0, FILTERORDER*sizeof (float) ) ; memset (syntOutBuf , 0, FILTERORDER*sizeof (float) ) ; memset (weightOutBuf , 0, FILTERORDER*sizeof (float) ) ;
  • memset (tmpbuf , 0, FILTERORDER*sizeof (float) ) ; memset (foutbuf , 0, FILTERORDER*sizeof (float) ) ;
  • numerator [k] syntDenum [FILTERORDER-k]
  • numerator [FILTERORDER] syntDenum [0]
  • tmp ttmpbuf [FILTERORDER]
  • fout &foutbuf [FILTERORDER] ;
  • ZeroPoleFilter tmp, numerator, syntDenum, 2*len, FILTERORDER, fout
  • AbsQuant (fou , syntDenum, eightNum, weightDenum, idxVec, len) ;
  • the quantized start state 615 are looked up in the scalar codebook 620 to result in the reconstruction of the quantized start state 625.
  • the quantized start state is then de-normalized 630 using the index of quantized normalization factor 626. This produces the de-normalized start state 635, which is input to the inverse all -pass filter 640, taking coefficients 636, to result in the decoded start state 645.
  • memset (tmpbuf , 0 , FILTERORDER* sizeof ( float) ) ; memset ( foutbuf , 0 , FILTERORDER*sizeof ( f loat) ) ;
  • numerator [k] syntDenum [FILTERORDER-k] ;
  • the remaining samples of the block can be encoded in a multitude of ways that all exploit the start state as an initialization for the state of the encoding algorithm.
  • a linear predictive algorithm can be used for the encoding of the remaining samples.
  • the application of an adaptive codebook enables an efficient exploitation of the start state during voiced speech segments.
  • the encoded start state is used to populate the adaptive codebook.
  • an initialization of the state for error weighting filters is advantageously done using the start state. The specifics of such initializations can be done in a multitude of ways well known by a person skilled in the art.
  • the start state 715 which is an example of the signal 645 and which is a decoded representation of the start state target 325, is extended to an integer sub-block length start state 725. Thereafter, these sub-blocks are used as start state for the encoding of the remaining sub-blocks within the block
  • A-B (the number of sub-blocks being merely illustrative) .
  • This encoding can start by either encoding the sub-blocks later in time, or by encoding the sub-blocks earlier in time. While both choices are readily possible under the scope of the invention, we describe in detail only embodiments which start with the encoding of sub-blocks later in time.
  • an adaptive codebook and weighting filter are initialized from the start state for encoding of sub-blocks later in time. Each of these sub-blocks are subsequently encoded. As an example, this can result in the signal 735 in Figure 7. If more than one sub-block is later in time than the integer sub-block start state within the block, then the adaptive codebook memory is updated with the encoded LPC excitation in preparation for the encoding of the next sub-block. This is done by methods which are well known by a person skilled in the art.
  • the block contains sub-blocks earlier in time than the ones encoded for the start state, then a procedure equal to the one applied for sub-blocks later in time is applied on the time-reversed block to encode these sub- blocks.
  • the difference is, when compared to the encoding of the sub-blocks later in time, that now not only the start state, but also the LPC excitation later in time than the start state, is applied in the initialization of the adaptive codebook and the perceptual weighting filter. As an example, this will extend the signal 735 into a full decoded representation 745, which is the resulting decoded representation of the LPC residual 315.
  • the signal 745 constitute the LPC excitation for the decoder.
  • void iLBC_encode ( /* main encoder function */ float *speech, /* (i) speech data vector */ unsigned char *bytes, /* (o) encoded data bits */ float *block, /* (o) decoded speech vector */ int mode, /* (i) 1 for standard encoding 2 for redundant encoding */ float *decresidual, /* (o) decoded residual prior to gain adaption (useful for a redundant encoding unit) */ float *syntdenum, /* (o) decoded synthesis filters (useful for a redundant encoding unit) */ float *weightnum, /* (o) weighting numerator (useful for a redundant encoding unit) */ float *weightdenum /* (o) weighting denumerator (useful for a redundant encoding unit) */ )
  • int start, idxForMax, idxVec [STATE_LEN] ; float reverseDecresidual [BLOCKL] , mem[MEML] ; int n, k, kk, meml_gotten, Nfor, Nback, i; int dummy 0 ; int gain_index[NSTAGES*NASUB] , extra_gain_index [NSTAGES] ; int cb_index[NSTAGES*NASUB] , extra_cb_index [NSTAGES] ; int lsf_i [LSF_NSPLIT*LPC_N] ; unsigned char *pbytes; int diff, start_pos, state_first ; float enl, en2; int index, gc_index; int subcount, subframe; float weightState [FILTERORDER] ;
  • variable start indicates the beginning of the signal 3 17,318 ( Figure 4) in integer number of subblocks */
  • variable start_pos now indicates the beginning of the signal 325 ( Figure 4) in integer number of samples */ /* scalar quantization of state */
  • This function does a weighted multistage search of shape and gain indexes */
  • decresidual contains the signal of which signal 725 in Figure 7 is an example */
  • Weighted adaptive codebook search In the described forward and backward encoding procedures.
  • the adaptive codebook search can be done in an un-weighted residual domain, or a traditional analysis-by-synthesis weighting can be applied.
  • the method consist of a pre-weighting of the adaptive codebook memory and the target signal prior to construction of the adaptive codebook and subsequent search for the best codebook index.
  • the advantage of this method compared to analysis-by- synthesis, is that the weighting filtering on the codebook memory leads to less computations than what is needed in the zero state filter recursion of an analysis- by-synthesis encoding for adaptive codebooks.
  • the drawback of this method is that the weighted codebook vectors will have a zero-input component which results from past samples in the codebook memory not from past samples of the decoded signal as in analysis-by- synthesis. This negative effect can be kept low by designing the weighting filter to have low energy in the zero input component relative to the zero state component over the length of a codebook vector.
  • FIG. 8 An implementation of this third method is schematized in Figure 8.
  • This buffer is then weighting filtered 830 using the weighted LPC coefficients 836.
  • the Weighted buffer 835 is then separated 840 into the time samples corresponding to the memory and those corresponding to the target .
  • the weighted memory 845 is then used to build the adaptive codebook 850.
  • the adaptive codebook 855 need not differ in physical memory location from the weighted memory 845 since time shifted codebook vectors can be addressed the same way as time shifted samples m the memory buffer.
  • memcpy (buf , weightstate, sizeof (float) *FILTERORDER) ; memcpy (&buf [FILTERORDER] , mem, lMem*sizeof (float) ) ; memcpy (&buf [FILTERORDER+lMem] , target, lTarget*sizeof (float) ) ; /* At this point buf is the signal 825 on Fig. 8 */
  • index [stage] best_index
  • gain gainquant (gain, (float) fabs (gains [stage-1] ) , 8, &gain_index [stage] ) ,* /*
  • the decoder covered by the present invention is any decoder that interoperates with an encoder according to the above description. Such a decoder will extract from the encoded data a location for the start state. It will decode the start state and use it as an initialization of a memory for the decoding of the remaining signal frame. In case a data packet is not received a packet loss concealment could be advantageous .
  • This function does a syntesis filtering of the decoded residual */ memcpy (decblock, decresidual, BLOCKL*sizeo (float) ) ; memcpy (old_syntdenum, syntdenum, NSUB* (FILTERORDER+1) *sizeof (float) ) ;

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Synchronisation In Digital Transmission Systems (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Dc Digital Transmission (AREA)
  • Stabilization Of Oscillater, Synchronisation, Frequency Synthesizers (AREA)

Abstract

The present invention relates to improvements of predictive encoding/decoding operations performed on a signal which is transmitted over a packet switched network. The signal is encoded on a block by block basis in such way that a block A-B is predictive encoded independently of any preceding blocks. A start state (715) located somewhere between the end boundaries A and B of the block is encoded using any applicable coding method. Both block parts surrounding the start state is then predictive encoded based on the start state and in opposite directions with respect to each other, thereby resulting in a full encoded representation (745) of the block A-B. At the decoding end, corresponding decoding operations are performed.

Description

LOW BIT RATE CODEC
Technical Field of the Invention
The present invention relates to predictive encoding and decoding of a signal, more particularly it relates to predictive encoding and decoding of a signal representing sound, such as speech, audio, or video.
Technical Background and Prior Art
Real-time transmissions over packet switched networks, such as speech, audio, or video over Internet Protocol based networks (mainly the Internet or Intranet networks) , has become increasingly attractive due to a number of features. These features include such things as relatively low operating costs, easy integration of new services, and one network for both non-real -time and real-time data. Real-time data, typically a speech, an audio, or a video signal, in packet switched systems is converted into a digital signal, i.e. into a bitstream, which is divided in portions of suitable size in order to be transmitted in data packets over the packet switched network from a transmitter end to a receiver end. As packet switched networks originally were designed for transmission of non-real-time data, transmissions of real-time data over such networks causes some problems. Data packets can be lost during transmission, as they can be deliberately discarded by the network due to congestion problems or transmission errors. In non-realtime applications this is not a problem since a lost packet can be retransmitted. However, retransmission is not a possible solution for real-time applications that are delay sensitive. A packet that arrives too late to a real-time application cannot be used to reconstruct the corresponding signal since this signal already has been, or should have been, delivered to the receiving end, e.g. for playback by a speaker or for visualization on a display screen. Therefore, a packet that arrives too late is equivalent to a lost packet.
When transferring a real-time signal as packets, the main problem with lost or delayed data packets is the introduction of distortion in the reconstructed signal. The distortion results from the fact that signal segments conveyed by lost or delayed data packets cannot be reconstructed .
When transferring a signal it is most often desired to use as little bandwidth as possible. As is well known, many signals have patterns containing redundancies. Appropriate coding methods can avoid the transmission of the redundant information thereby enabling a more bandwidth effective transmission of the signal. Typical coding methods taking advantage of such redundancies are predictive coding methods. A predictive coding method encodes a signal pattern based on dependencies between the pattern representations. It encodes the signal for transmission with a fixed bit rate and with a tradeoff between the signal quality and the transmitted bit rate. Examples of predictive coding methods used for speech are Linear Predictive Coding (LPC) and Code Excited Linear Prediction (CELP) , which both coding methods are well known to a person skilled in the art. In a predictive coding scheme a coder state is dependent on previously encoded parts of the signal. When using predictive coding in combination with packetization of the encoded signal, a lost packet will lead to error propagation since information on which the predictive coder state at the receiving end is dependent upon will be lost together with the lost packet. This means that decoding of a subsequent packet will start with an incorrect coder state. Thus, the error due to the lost packet will propagate during decoding and reconstruction of the signal.
One way to solve this problem of error propagation is to reset the coder state at the beginning of the encoded signal part included by a packet. However, such a reset of the coder state will lead to a degradation of the quality of the reconstructed signal. Another way of reducing the effect of a lost packet is to use different schemes for including redundancy information when encoding the signal. In this way the coder state after a lost packet can be approximated. However, not only does such a scheme require more bandwidth for transferring the encoded signal, it furthermore only reduces the effect of the lost packet . Since the effect of a lost packet will not be completely eliminated, error propagation will still be present and result in a perceptually lower quality of the reconstructed signal.
Another problem with state of the art predictive coders is the encoding, and following reconstruction, of sudden signal transitions from a relatively very low to a much higher signal level, e.g. during a voicing onset of a speech signal. When coding such transitions it is difficult to make the coder states reflect the sudden transition, and more important, the beginning of the voiced period following the transition. This in turn will lead to a degraded quality of the reconstructed signal at a decoding end.
Summary of the Invention
An object of the present invention is to overcome at least some of the above-mentioned problems in connection with predictive encoding/decoding of a signal which is transmitted in packets. Another object is to enable an improved performance at a decoding end in connection with predictive encoding/decoding when a packet with an encoded signal portion transmitted from an encoding end is lost before being received at the decoding end. Yet another object is to improve the predictive encoding and decoding of a signal which undergoes a sudden increase of its signal power.
According to the present invention, these objects are achieved by methods, apparatuses and computer- readable mediums having the features as defined in the appended claims and representing different aspects of the invention.
According to the invention, a signal is divided into blocks and then encoded, and eventually decoded, on a block by block basis. The idea is to provide predictive encoding/decoding of a block so that the encoding/decoding is independent on any preceding blocks, while still being able to provide predictive encoding/decoding of a beginning end of the block in such way that a corresponding part of the signal can be reproduced with the same level of quality as other parts of the signal . This is achieved by basing the encoding and the decoding of a block on a coded start state located somewhere between the end boundaries of the block. The start state is encoded/decoded using any applicable coding method. A second block part and a third block part, if such a third part is determined to exist, on respective sides of the start state and between the block boundaries are then encoded/decoded using any predictive coding method. To facilitate predictive encoding/decoding of both block parts surrounding the start state, and since encoding/decoding of both of these parts will be based on the same start state, the two block parts are encoded/decoded in opposite directions with respect to each other. For example, the block part located at the end part of the block is encoded/decoded along the signal pattern as it occurs in time, while the other part located at the beginning of the block is encoded/decoded along the signal pattern backwards in time, from later occurring signal pattern to earlier occurring signal pattern. By encoding the block in three stages in accordance with the invention, coding independency between blocks is achieved and proper predictive encoding/decoding of the beginning end of the block always facilitated. The three encoding stages are :
* Encoding a first part of the block, which encoded part represents an encoded start state.
* Encoding a second block part between the encoded start state and one of the block end boundaries using a predictive coding method which gradually codes this second block part from the start state to the end boundary .
* Determining whether a third block part exists between the encoded start state and the other one of the block end boundaries, and if so, encoding this third block part using a predictive coding method which gradually codes this third block part from the start state to this other end boundary. With respect to a time base associated with the block, the third block part is encoded in an opposite direction in comparison with the encoding of the second block part .
Correspondingly, decoding of an encoded block is performed in three stages when reproducing a corresponding decoded signal block.
* Decoding the encoded start state.
* Decoding an encoded second part of the block. A predictive decoding method based on the start state is used for reproducing the second part of the block located between the start state and one of the two end boundaries of the block.
* Determining whether an encoded third block part exists, and if so, decoding this encoded third part of the block. Again, a predictive decoding method based on the start state is used for reproducing the third part of the block located between the start state and the other one of the two end boundaries of the block. With respect to a time base associated with the reproduced block, this third part of the block is reproduced in opposite direction as compared with the reproduction of the second part of the block. The signal subject to encoding in accordance with the present invention either corresponds to a digital signal or to a residual signal of an analysis filtered digital signal. The signal comprises a sequential pattern which represents sound, such as speech or audio, or any other phenomena that can be represented as a sequential pattern, e.g. a video or an ElectroCardioGram (ECG) signal. Thus, the present invention is applicable to any sequential pattern that can be coded so as to be described by consecutive states that are correlated with each other.
Preferably, the encoding/decoding of the start state uses a coding method which is independent of previous parts of the signal, thus making the block self-contained with respect to information defining the start state. However, when the invention is applied in the LPC residual domain, predictive encoding/decoding is preferably used also for the start state. By the assumption that the quantization noise in the decoded signal prior to the beginning of the start state can be neglected, the error weighting or error feedback filter of a predictive encoder can be started from a zero state. Hereby the self-contained coding of the start state is achieved.
Preferably, the signal block is divided into a set of consecutive intervals and the start state chosen to correspond to one or more consecutive intervals of those intervals that have the highest signal energy. This means that encoding/decoding of the start state can be optimized towards a signal part with relatively high signal energy. In this way an encoding/decoding of the rest of the block is accomplished which is efficient from a perceptual point of view since it can be based on a start state which is encoded/decoded with a high accuracy.
An advantage of the present invention is that it enables the predictive coding to be performed in such way that the coded block will be self-contained with respect to information in the excitation domain, i.e. the coded information will not be correlated with information in any previously encoded block. Consequently, at decoding, the decoding of the encoded block is based on information self-contained in the encoded block. This means that if a packet carrying an encoded block is lost during transmission, the predictive decoding of subsequent encoded blocks in subsequent received packets will not be affected by lost state information in the lost packet. Thus, the present invention avoids the problem of error propagation that conventional predictive coding/decoding encounter during decoding when a packet carrying an encoded block is lost before reception at the decoding end. Accordingly, a codec applying the features of the present invention will become more robust to packet loss.
Preferably, the start state is chosen so as to be located in the part of the block which is associated with the highest signal power. For example, in a speech signal composed of voiced and unvoiced parts, this implies that the start state will be located well within the voiced part in a block including an unvoiced and a voiced part . In a speech signal, high correlation exists between signal samples within a voiced part and low correlation between signal samples within an unvoiced part. The correlation in the transition region between an unvoiced part and a voiced part, and vice versa, is minor and difficult to exploit. From a perceptual point of view it is more important to achieve a good waveform matching when reproducing a voiced part of the signal, whereas the waveform matching for an unvoiced part is less important. Conventional predictive coders operate on the signal representations in the same order as that with which the corresponding signal is produced by the signal source. Thus, any coder state representing the signal at a certain time will be correlated with previous coder states representing earlier parts of the signal. Due to the difficulties of exploiting any correlation during a transition from an unvoiced period to a voiced period, the coder states for conventional predictive coders will during the beginning of a voiced period following such a transition include information which gives a quite poor approximation of the original signal . Consequently, the regeneration of the speech signal at the decoding end will provide a perceptually degraded signal for the beginning of the voiced region.
By placing the start state well within a voiced region of a block, and then encoding/decoding the block from the start state towards the end boundaries, the present invention is able to more fully exploit the high correlation in the voiced region to the benefit for the perception. The transition from unvoiced to highly periodic voiced sound takes a few pitch periods. When placing the start state well within a voiced region of a block, the high bit rate of the start state encoding will be applied in a pitch cycle where high periodicity has been established, rather than in one of the very first pitch cycles of the voiced region.
The above mentioned and further features of, and advantages with, the present invention, will be more fully described from the following description.
Brief Description of the Drawings
Fig. 1 shows an overview of the transmitting part of a system for transmission of sound over a packet switched network; Fig. 2 shows an overview of the receiving part of a system for transmission of sound over a packet switched network;
Fig. 3 shows an example of a residual signal block; Fig. 4 shows integer sub-block and higher resolution target for start state for the encoding of the residual Of Fig. 3;
Fig. 5 shows a functional block diagram of an encoder encoding a start state in accordance with an embodiment of the invention;
Fig. 6 shows a functional block diagram of a decoder performing a decoding operation corresponding to the encoder in Fig. 5;
Fig. 7 shows the encoding of a signal from the start state towards the block end boundaries; and
Fig. 8 shows a functional block diagram of an adaptive codebook search advantageously exploited by an embodiment of the present invention.
Detailed Description of the Invention
The encoding and decoding functionality according to the invention is typically included in a codec having an encoder part and a decoder part. With reference to Fig. 1 and 2, an embodiment of the invention is shown in a system used for transmission of sound over a packet switched network.
In Fig. 1 an encoder 130 operating in accordance with the present invention is included in a transmitting system. In this system the sound wave is picked up by a microphone 110 and transduced into an analog electronic signal 115. This signal is sampled and digitized by an A/D-converter 120 to result in a sampled signal 125. The sampled signal is the input to the encoder 130. The output from the encoder is data packets 135. Each data packet contains compressed information about a block of samples. The data packets are, via a controller 140, forwarded to the packet switched network.
In Fig. 2 a decoder 270 operating in accordance with the present invention is included in a receiving system. In this system the data packets are received from the packet switched network by a controller 250, and stored in a jitter buffer 260. From the jitter buffer data packets 265 are made available to the decoder 270. The output of the decoder is a sampled digital signal 275. Each data packet results in one block of signal samples. The sampled digital signal is input to a D/A-converter 280 to result in an analog electronic signal 285. This signal can be forwarded to a sound transducer 290, containing a loudspeaker, to result in to reproduced sound wave.
The essence of the codec is linear predictive coding (LPC) as is well known from adaptive predictive coding (APC) and code excited linear prediction (CELP) . A codec according to the present invention, however, uses a start state, i.e., a sequence of samples localized within the signal block to initialize the coding of the remaining parts of the signal block. The principle of the invention complies with an open-loop analysis-synthesis approach for the LPC as well as the closed-loop analysis- by-synthesis approach, which is well known from CELP. An open-loop coding in a perceptually weighted domain, provides an alternative to analysis-by-synthesis to obtain a perceptual weighting of the coding noise. When compared with analysis-by-synthesis this method provides an advantageous compromise between voice quality and computational complexity of the proposed scheme. The open-loop coding in a perceptually weighted domain is described later in this description. Encoder
In the embodiment of Fig. 1, the input to the encoder is the digital signal 125. This signal can take the format of 16 bit uniform pulse code modulation (PCM) sampled at 8 kHz and with a direct current (DC) component removed. The input is partitioned into blocks of e.g. 240 samples. Each block is subdivided into, e.g. 6, consecutive sub- blocks of, e.g., 40 samples each.
In principle any method can be used to extract a spectral envelope from the signal block without diverging from the spirit of the invention. One method is outlined as follows: For each input block, the encoder does a number, e.g. two, linear-predictive coding (LPC) analysis, each with an order of e.g. 10. The resulting LPC coefficients are encoded, preferably in the form of line spectral frequencies (LSF) . The encoding of LSF ' s is well known to a person skilled in the art. This encoding may exploit correlations between sets of coefficients, e.g., by use of predictive coding for some of the sets. The LPC analysis may exploit different, and possibly non- symmetric window functions in order to obtain a good compromise between smoothness and centering of the windows and lookahead delay introduced in the coding. The quantized LPC representations can advantageously be interpolated to result in a larger number of smoothly time varying sets of LSF coefficients. Subsequently the LPC residual is obtained using the quantized and smoothly interpolated LSF coefficients converted into coefficients for an analysis filter.
An example of a residual signal block 315 and its partition into sub-blocks 316, 317, 318, 319, 320 and 321 is illustrated in Figure 3, the number of sub-blocks being merely illustrative. In this figure each interval on the time axis indicates a sub-block. The identification of a target for a start state within the exemplary residual block in Figure 3 is illustrated in Figure 4. In a simple implementation this target can, e.g., be identified as the two consecutive sub-blocks 317 and 318 of the residual exhibiting the maximal energy of any two consecutive sub-blocks within the block. Additionally, the length of the target can be further shortened and localized with higher time resolution by identifying a subset of consecutive samples 325 of possibly predefined length within the two-sub-block interval. Advantageously, such a subset can be chosen as a trailing or tailing predefined number, e.g. 58, of samples within the two-sub-block interval. Again, the choice between trailing or tailing subset can be based on a maximum energy criterion.
Encoding of start state
Without diverging from the spirit of the invention, the start state can be encoded with basically any encoding method.
According to an embodiment of the invention scalar quantization with predictive noise shaping is used, as illustrated in Figure 5. By the invention, the scalar quantization is pre-pended with an all-pass filtering 520 designed to spread the sample energy on all samples in the start state. It has been found that this results in a good tradeoff between overload and granular noise of a low rate bounded scalar quantizer. A simple design of such an all -pass filter is obtained by applying the LPC synthesis filter forwards in time and the corresponding LPC analysis filter backwards in time. To be specific, when the quantized LPC analysis filter is Aq(z), with coefficients 516. Then the all-pass filter 520 is given by Aq(zA-l) /Aq (z) . For the inverse operation of this filter in the decoder, encoded LPC coefficients should be used and the filtering should be a circular convolution of the length of the start state. The remaining part of the start state encoder is well known by a person skilled in the art: The filtered target 525 is normalized to exhibit a predefined maximal amplitude by the normalization 530 to result in the normalized target 535 and an index of quantized normalization factor 536. The weighting of the quantization error is divided into a filtering 540 of the normalized target 535 and a filtering 560 of the quantized target 556, from which the ringing, or zero-input response, 545 for each sample is subtracted from the weighted target 545 to result in the quantization target 547, which is input to the quantizer 550. The result is a sequence of indexes 555 of the quantized start state.
Any noise shaping weighting filter 540 and 560 can be applied in this embodiment. Advantageously the same noise shaping is applied in the encoding of the start state as in the subsequent encoding of the remaining signal block, described later. As an example, the noise shaping can be implemented by minimizing the quantization error after weighting it with a weighting filter equal to A(z/Ll) / (Aq(z) *A(z/L2) ) , where A(z) is the unquantized LPC analysis filter after a possible initial bandwidth expansion, Aq(z) is the quantized LPC analysis filter, and LI and L2 are bandwidth expansion coefficients, which can advantageously be set to Ll=0.8 and L2=0.6, respectively. All LPC and weighting coefficients needed in this filtering is in Figure 5 gathered in the inputs 546 and 565. An alternative with shorter impulse response, useful when the remaining encoding is done with the third alternative method described later, is to set Ll=1.0 and L2=0.4.
Below follows a c-code example implementation of a start state encoder void ΞtateSearch ( /* encoding of a state */ float *residual, /* (i) target residual vector, i.e., signal 515 in Fig. 5 */ float *syntDenum, /* (i) lpc coefficients for signals 516, 546 and 565 in Fig. 5*/ float *weightNum, /* (i) weight filter numerator for signals 546 and 565 in Fig. 5 */ float *weightDenum, /* (i) weight filter denuminator for signals 546 and 565 in Fig. 5 */ int *idxForMax, /* (o) quantizer index for maximum amplitude, i.e., signal 536 in Fig.5 */ int *idxVec, /* (o) vector of quantization indexes, i.e., signal 555 in Fig. 5 */ int len /* (i) length of all vectors, e.g., 58 */ ) ;
void AbsQuantW( float *in, float *syntDenum, float *weightNum, float *weightDenum, int *out, int len) {
float *target, targetBuf [FILTERORDER+STATE_LEN] ,
*syntOut, syntOutBuf [FILTERORDER+STATE_LEN] , *weightOut, weightOutBuf [FILTERORDER+STATE_LEN] , toQ, xq; int n; int index;
memset (targetBuf , 0, FILTERORDER*sizeof (float) ) ; memset (syntOutBuf , 0, FILTERORDER*sizeof (float) ) ; memset (weightOutBuf , 0, FILTERORDER*sizeof (float) ) ;
target = StargetBuf [FILTERORDER] ; syntOut = {.syntOutBuf [FILTERORDER] ; weightOut = s-weightOutBuf [FILTERORDER] ;
for (n=-0;n<len,*n++) <
if( n==STATE_LEN/2 ){ syntDenum += (FILTERORDER+1) ; weightNum += (FILTERORDER+1); weightDenum += (FILTERORDER+1) AllPoleFilter ( &in[n], weightDenum, 1, FILTERORDER ) ; /* this function does an all pole filtering of the vector in, result is returned in same vector */ /* this is the filtering 540 in Figure 5 */ syntOut [n] = 0.0;
AllPoleFilter ( ksyntOut [n] , weightDenum, 1, FILTERORDER ) ,* /* this is the filtering 560 in Figure 5 */
/* the quantizer */ toQ = in [n] -syntOut [n] ; /* This is the subtraction of signal 566 from signal 545 to result in signal 547 in Figure 5 */ sort_sq(&xq, &index, toQ, state_sq3, 8) ;
/* this function does a scalar quantization */ /* This is the function 550 in Figure 5 */ out [n] =index; syntOut [n] = state_sq3 [out [n] ] ;
AllPoleFilter( &syntOut [n] , weightDenum, 1, FILTERORDER ); /* This updates the weighting filter 560 in Figure 5 for next sample */
void StateSearch ( float *residual, float *syntDenum, float *weightNum, float *weightDenum, int *idxForMax, int *idxVec, int len) {
float dtmp, maxVal, tmpbuf [FILTERORDER+2*STATE_LEN] , *tmp, numerator [1+FILTERORDER] , foutbuf [FILTERORDER+2*STATE_LEN] , *fout; int k, utmp ; int index,*
memset (tmpbuf , 0, FILTERORDER*sizeof (float) ) ; memset (foutbuf , 0, FILTERORDER*sizeof (float) ) ;
for(k=0; k<FILTERORDER; k++) { numerator [k] =syntDenum [FILTERORDER-k] } numerator [FILTERORDER] =syntDenum [0] ; tmp = ttmpbuf [FILTERORDER] ; fout = &foutbuf [FILTERORDER] ;
/* from here */ memcpy(tmp, residual, len*sizeof (float) ) ; memset (tmp+len, 0, len*sizeof (float) ) ,*
ZeroPoleFilter (tmp, numerator, syntDenum, 2*len, FILTERORDER, fout) ;
/* this function does an pole-zero filtering of tmp and returns the filtered vector in fout */ for(k=0;k<len,*k++) { fout [k] += fout [k+len] ; }
/* to here is the the all-pass filtering 520 in Figure 5 */ maxVal = fout [0] ; for(k=l; k<len; k++) { if (fout [k] *fout [k] > maxVal*maxVal) { maxVal = fout [k] ,*
} } maxVal= (float) fabs (maxVal) ;
if (maxVal < 10.0) { maxVal = 10.0;
} maxVal = (float) loglO (maxVal) ; sort_sq (Sdtmp, kindex, maxVal, state_frgq, 64); /* this function does a sorting of squared values */ maxVal=state_frgq [index] ; utmp=index;
*idxForMax=utmp;
maxVal = (float)pow(lθ,maxVal) ; maxVal = (float) (4.5) /maxVal , for(k=0,*k<len,*k++) { fout [k] = maxVal; /* This is the normalization 530 in Figure 5 */
}
AbsQuant (fou , syntDenum, eightNum, weightDenum, idxVec, len) ;
}
Decoding of start state
The Decoding of the start state follows naturally from the method applied in the encoding of the start state. A decoding method corresponding to the encoding method of Figure 5 is illustrated in Figure 6. First the indexes
615 are looked up in the scalar codebook 620 to result in the reconstruction of the quantized start state 625. The quantized start state is then de-normalized 630 using the index of quantized normalization factor 626. This produces the de-normalized start state 635, which is input to the inverse all -pass filter 640, taking coefficients 636, to result in the decoded start state 645. Below follows a c-code example of the decoding of a start state.
void StateConstr*uct ( /* decodes one state of speech residual */ int idxForMax, /* (i) 7-bit index for the quantization of max amplitude, i.e., signal 626 in Fig. 6 */ int *idxVec, /* (i) vector of quantization indexes, i.e., signal 615 in Fig. 6 */ float *syntDenum, /* (i) synthesis filter denumerator, i.e., signal 636 in Fig. 6 */ float *out, /* (o) the decoded state vector, i.e., signal 645 in Fig. 6 */ int len /* (i) length of a state vector, e.g., 58 */
)
{ float maxVal, tmpbuf [FILTER0RDER+2*STATE_LEN] , *tmp, numerator [FILTERORDER+1] ; float foutbuf [FILTER0RDER+2*STATE_LEN] , *fout; int k,tmpi;
maxVal = state_frgq [idxForMax] ,* maxVal = ( float) pow (lθ , maxVal ) / ( float) 4 . 5 ;
memset (tmpbuf , 0 , FILTERORDER* sizeof ( float) ) ; memset ( foutbuf , 0 , FILTERORDER*sizeof ( f loat) ) ;
for (k=0 ; k<FILTERORDER; k++) { numerator [k] =syntDenum [FILTERORDER-k] ;
} numerator [FILTERORDER] =syntDenum [0] ; tmp = ttmpbuf [FILTERORDER] ; fout = Scfoutbuf [FILTERORDER] ; for(k=0; k<len; k++) { tmpi = len-l-k; tmp [k] = maxVal*state_sq3 [idxVec [tmpi] ] ,* /* This is operations 620 and 630 in Figure 6 */
)
/* from here */ memset (tmp+len, 0, len*sizeof (float) ) ; ZeroPoleFilter (tmp, numerator, syntDenum, 2*len, FILTERORDER, fout); for(k=0;k<len;k++) {
Out [k] = fout [len-l-k] +fout [2*len-l-k] ;
} /* to here is the operation 640 in Figure 6 */
}
Encoding from the start state towards the block boundaries
Within the scope of the invention the remaining samples of the block can be encoded in a multitude of ways that all exploit the start state as an initialization for the state of the encoding algorithm. Advantageously, a linear predictive algorithm can be used for the encoding of the remaining samples. In particular, the application of an adaptive codebook enables an efficient exploitation of the start state during voiced speech segments. In this case, the encoded start state is used to populate the adaptive codebook. Also an initialization of the state for error weighting filters is advantageously done using the start state. The specifics of such initializations can be done in a multitude of ways well known by a person skilled in the art.
The encoding from the start state towards the block boundaries is exemplified by the signals in Figure 7.
In an embodiment based on sub-blocks for which the start state is identified as an interval of a predefined length towards one end of an interval defined by a number of sub-blocks, it is advantageous to first apply the adaptive codebook algorithm on the remaining interval to reach encoding of the entire interval defined by a number of sub-blocks. As example, the start state 715, which is an example of the signal 645 and which is a decoded representation of the start state target 325, is extended to an integer sub-block length start state 725. Thereafter, these sub-blocks are used as start state for the encoding of the remaining sub-blocks within the block
A-B (the number of sub-blocks being merely illustrative) .
This encoding can start by either encoding the sub-blocks later in time, or by encoding the sub-blocks earlier in time. While both choices are readily possible under the scope of the invention, we describe in detail only embodiments which start with the encoding of sub-blocks later in time.
Encoding of sub-blocks later in time
If the block contains sub-blocks later in time of the ones encoded for start state, then an adaptive codebook and weighting filter are initialized from the start state for encoding of sub-blocks later in time. Each of these sub-blocks are subsequently encoded. As an example, this can result in the signal 735 in Figure 7. If more than one sub-block is later in time than the integer sub-block start state within the block, then the adaptive codebook memory is updated with the encoded LPC excitation in preparation for the encoding of the next sub-block. This is done by methods which are well known by a person skilled in the art.
Encoding of sub-blocks earlier in time
If the block contains sub-blocks earlier in time than the ones encoded for the start state, then a procedure equal to the one applied for sub-blocks later in time is applied on the time-reversed block to encode these sub- blocks. The difference is, when compared to the encoding of the sub-blocks later in time, that now not only the start state, but also the LPC excitation later in time than the start state, is applied in the initialization of the adaptive codebook and the perceptual weighting filter. As an example, this will extend the signal 735 into a full decoded representation 745, which is the resulting decoded representation of the LPC residual 315. The signal 745 constitute the LPC excitation for the decoder.
The encoding steps of the present invention have been exemplified on a block of speech LPC residual signal in Figures 3 to 5. However, these steps also apply to other signals, e.g., an unfiltered sound signal in the time domain or a medical signal such as EKG, without diverging from the general idea of the present invention.
Example c-code for the encoding from the start state towards block boundaries
void iLBC_encode ( /* main encoder function */ float *speech, /* (i) speech data vector */ unsigned char *bytes, /* (o) encoded data bits */ float *block, /* (o) decoded speech vector */ int mode, /* (i) 1 for standard encoding 2 for redundant encoding */ float *decresidual, /* (o) decoded residual prior to gain adaption (useful for a redundant encoding unit) */ float *syntdenum, /* (o) decoded synthesis filters (useful for a redundant encoding unit) */ float *weightnum, /* (o) weighting numerator (useful for a redundant encoding unit) */ float *weightdenum /* (o) weighting denumerator (useful for a redundant encoding unit) */ )
{ float data [BLOCKL] ; float residual [BLOCKL] , reverseResidual [BLOCKL] ; float weightnum [NSUB* (FILTERORDER+1) ] , weightdenum [NSUB* (FILTERORDER+1) ] ;
int start, idxForMax, idxVec [STATE_LEN] ; float reverseDecresidual [BLOCKL] , mem[MEML]; int n, k, kk, meml_gotten, Nfor, Nback, i; int dummy=0 ; int gain_index[NSTAGES*NASUB] , extra_gain_index [NSTAGES] ; int cb_index[NSTAGES*NASUB] , extra_cb_index [NSTAGES] ; int lsf_i [LSF_NSPLIT*LPC_N] ; unsigned char *pbytes; int diff, start_pos, state_first ; float enl, en2; int index, gc_index; int subcount, subframe; float weightState [FILTERORDER] ;
memcpy (data, block, BLOCKL*sizeof (float) ) ;
/* LPC of input data */
LPCencode (syntdenum, weightnum, weightdenum, lsf_i, data); /* This function does LPC analysis and quantization and smooth interpolation of the LPC coefficients */
/* Inverse filter to get residual */ for (n=0; n<NSUB; n++ ) { anaFilter(&data[n*SUBL] , &syntdenum[n* (FILTERORDER+1) ] , SUBL, fcresidual [n*SUBL] ) ;
} /* This function does an LPC analysis filtering using the quantized and interpolated LPC coefficients */ /* At this point residual is the signal of which signal 315 in Figure 3 is an example */
/* find state location */ start = FrameClassify (residual) ;
/* This function localizes the start state with resolution of integer sub frames */
/* The variable start indicates the beginning of the signal 317,318 (Figure 4) in integer number of subblocks */
/* Check if state should be in first or last part of the two subframes */ diff = STATE_LEN - STATE_SHORT_LEN ; enl = 0 ; index = (start-1) *SUBL; for (i=0; i < STATE_SHORT_LEN; i++) enl += residual [index+i] *residual [index+i] ; en2 = 0 ; index = (start-1) *SUBL+diff; for (i = 0; i < STATE_SHORT_LEN; i++) en2 += residual [index+i] *residual [index+i] ;
if (enl > en2) { state_first = 1; start_pos = (start-1) *SUBL;
} else { state_first = 0; start_pos = (start-1) *SUBL + diff;
} /* The variable start_pos now indicates the beginning of the signal 325 (Figure 4) in integer number of samples */ /* scalar quantization of state */
StateSearchWf&residual [start_pos] , &syntdenum [ (start-1) * (FILTERORDER+1) ] , &weightnum[ (start-1) * (FILTERORDER+1) ] , &weightdenum[ (start-1) * (FILTERORDER+1) ] , fcidxForMax, idxVec, STATE_SHORT_LEN) ;
/* This function encodes the start state (specified earlier in this description */
ΞtateConstruct (idxForMax, idxVec, &syntdenum [ (start-1) * (FILTERORDER+1) ] , fcdecresidual [start_pos] , STATE_SHORT_LEN) ;
/* This function decodes the start state */ /* At this point decresidual contains the signal of which signal 715 in figure 7 is an example */
/* predictive quantization in state */ if (state_first) { /* Put adaptive part in the end */
/* Setup memory */ memset (mem, 0, (MEML-STATE_SHORT_LEN) *sizeof (float) ) ; memcpy (mem+MEML-STATE_SHORT_LEN, decresidual+start_pos,
STATE_SHORT_LEN*sizeof (float) ) ; memset (weightstate, 0, FILTERORDER*sizeof (float) ) ;
/* Encode subframes */ iCBSearch(extra_cb_index, extra_gain_index, kresidual [start_pos+STATE_SHORT_LEN] , mem+MEML-stMemL, stMemL, diff, NSTAGES, tsyntdenum [ (start-1) * (FILTERORDER+1) ] , &weightnum[ (start-1) * (FILTERORDER+1) ] , &weightdenum[ (start-1) * (FILTERORDER+1) ] , weightstate
) ; /* This function does a weighted multistage search of shape and gain indexes */
/* construct decoded vector */ iCBConstruct (kdecresidual [start_pos+STATE_SHORT_LEN] , extra_cb_index, extra_gain_index, mem+MEML-stMemL, stMemL, diff, NSTAGES) ; /* This function decodes the multistage encoding */
} else {/* Put adaptive part in the beginning */
/* create reversed vectors for prediction */ for (k=0; k<diff ; k++ ) { reverseResidual [k] = residual [ (start+1) *SUBL -1- (k+STATE_SHORT_LEN) ] ; reverseDecresidual [k] = decresidual [ (start+1) *SUBL -1-
(k+STATE_SHORT_LEN) ] ; }
/* Setup memory */ meml_gotten = STATE_SHORT_LEN; for( k=0; k<meml_gotten; k++) { mem [MEML-l-k] = decresidual [start_pos + k] ,* } memset (mem, 0, (MEML-k) *sizeof (float) ) ; memset (weightstate, 0, FILTERORDER*sizeof (float) ) ;
/* Encode subframes */ iCBSearch (extra_cb_index, extra_gain_index, reverseResidual, mem+MEML-stMemL, stMemL, diff, NSTAGES, &syntdenum[ (start-1) * (FILTERORDER+1) ] , &weightnum[ (start-1) * (FILTERORDER+1) ] ,
^weightdenum [ (start-1) * (FILTERORDER+1) ] , weightstate ) ;
/* construct decoded vector */ iCBConstruct (reverseDecresidual, extra_cb_index, extra_gain_index, mem+MEML-stMemL, StMemL, diff, NSTAGES) ;
/* get decoded residual from reversed vector */ for( k=0; k<diff; k++ ){ decresidual [start_pos-l-k] = reverseDecresidual [k] ; /* At this point decresidual contains the signal of which signal 725 in Figure 7 is an example */
/* counter for predicted subframes */ subcount=0 ;
/* forward prediction of subframes */ Nfor = NSUB-start-1; if ( Nfor > 0 ) {
/* Setup memory */ memset (mem, 0, (MEML-STATE_LEN) *sizeof (float) ) ; memcpy (mem+MEML-STATE_LEN, decresidual÷ (start-1) *SUBL, STATE_LEN*sizeof (float) ) ; memset (weightstate, 0, FILTERORDER*sizeof (float) ) ;
/* Loop over subframes to encode */ for (subframe=0; subframe<Nfor ; subframe++) {
/* Encode subf rame */ iCBSearch (cb_index+subcount*NSTAGES , gain_index+subcount*NSTAGES , &residual [ (start+1+subf rame) *SUBL] , mem+MEML-memLf [subcount] , memLf [subcount] , SUBL,
NSTAGES ,
Scsyntdenumt (start+1+subframe) * (FILTERORDER+1) ] , &weightnum[ (start+1+subframe) * (FILTERORDER+1) ] , iweightdenum [ (start+1+subframe) * (FILTERORDER+1) ] , weightstate) ;
/* construct decoded vector */ iCBConstruct ( fcdecresidual [ ( start+1+subf rame) *SUBL] , cb_index+subcount*NSTAGEΞ , gain_index+subcount*NSTAGES , mem+MEML-memLf [subcount] , memLf [subcount] , SUBL,
NSTAGES) ; /* Update memory */ memcpy (mem, mem+SUBL, (MEML-SUBL) *sizeof (float) ) ; memcpy (mem+MEML-SUBL, &decresidual [ (start+1+subframe) *SUBL] , SUBL*sizeof (float) ) ; memse (weightstate, 0, FILTERORDER*sizeof (float) ) ; subcount++;
/* At this point decresidual contains the signal of which signal 735 in Figure 7 is an example */
/* backward prediction of subframes */ Nback = start-1; if ( Nback > 0 ) {
/* Create reverse order vectors */ for( n=0; n<Nback; n++ ){ for( k=0; k<SUBL; k++ ){ reverseResidual [n*SUBL+k] = residual [ (start-1) *SUBL-l-n*SUBL-k] ; reverseDecresidual [n*SUBL+k] = decresidual [ (start-1) *SUBL-l-n*SUBL-k] ;
} }
/* Setup memory */ meml_gotten = SUBL* (NSUB+1-start) ; if( meml_got en > MEML ){ meml_gotten=MEML; } for( k=0; k<meml_gotten; k++) { mem [MEML-l-k] = decresidual [ (start-1) *SUBL + k] ; } memset (mem, 0, (MEML-k) *sizeof (float) ) ; memset (weightstate, 0, FILTERORDER*sizeof (float) ) ;
/* Loop over subframes to encode */ for (subframe=0; subframe<Nback; subframe++) { /* Encode subframe */ iCBSearch (cb_index+subcount*NSTAGEΞ , gain_index+subcount*NSTAGES, {•reverseResidual [subframe*SUBL] , mem+MEML-memLf [subcount] , memLf [subcount] , SUBL, NSTAGES,
&syntdenum[ (start-1 -subframe) * (FILTERORDER+1) ] , S-weightnum [ (start-1-subframe) * (FILTERORDER+1) ] , &weightdenum [ (start-1-subframe) * (FILTERORDER+1) ] , weightstate) ;
/* construct decoded vector */ iCBConstruct (SreverseDecresidual [subframe*SUBL] , cb_index+subcount*NSTAGES, gain_index+subcount*NSTAGES, mem+MEML-memLf [subcount] , memLf [subcount] , SUBL, NSTAGES) ;
/* Update memory */ memcpy (mem, mem+SUBL, (MEML-SUBL) *sizeof (float) ) ; memcpy (mem+MEML-SUBL, ^reverseDecresidual [subframe*SUBL] , SUBL*sizeof (float) ) ; memset (weightstate, 0, FILTERORDER* sizeof (float) ) ; subcount++;
/* get decoded residual from reversed vector */ for (i = 0; i < SUBL*Nback; i++) decresidual [SUBL*Nback - i - 1] = reverseDecresidual [i]
} /* At this point decresidual contains the signal of which signal 745 in Figure 7 is an example */
packing information into bytes
Weighted adaptive codebook search In the described forward and backward encoding procedures. The adaptive codebook search can be done in an un-weighted residual domain, or a traditional analysis-by-synthesis weighting can be applied. We here describe in detail a third method applicable to adaptive codebooks . This method supplies an alternative to analysis-by-synthesis, and gives a good compromise between performance and computational complexity. The method consist of a pre-weighting of the adaptive codebook memory and the target signal prior to construction of the adaptive codebook and subsequent search for the best codebook index.
The advantage of this method, compared to analysis-by- synthesis, is that the weighting filtering on the codebook memory leads to less computations than what is needed in the zero state filter recursion of an analysis- by-synthesis encoding for adaptive codebooks. The drawback of this method is that the weighted codebook vectors will have a zero-input component which results from past samples in the codebook memory not from past samples of the decoded signal as in analysis-by- synthesis. This negative effect can be kept low by designing the weighting filter to have low energy in the zero input component relative to the zero state component over the length of a codebook vector. Advantageous parameters for a weighting filter of the form A(z/Ll)/ (Aq(z) *A(z/L2) ) , is to set Ll=1.0 and L2=0.4.
An implementation of this third method is schematized in Figure 8. First the adaptive codebook memory 815 and the quantization target 816 are concatenated in time 820 to result in a buffer 825. This buffer is then weighting filtered 830 using the weighted LPC coefficients 836. The Weighted buffer 835 is then separated 840 into the time samples corresponding to the memory and those corresponding to the target . The weighted memory 845 is then used to build the adaptive codebook 850. As is well known by a person skilled in the art, the adaptive codebook 855 need not differ in physical memory location from the weighted memory 845 since time shifted codebook vectors can be addressed the same way as time shifted samples m the memory buffer.
Below follows a c-code example implementation of this third method for weighted codebook search.
void iCBSearch ( /* adaptive codebook search */ int 'index, /* (o) vector lmdexes This is signal 865 on Fig 8 */ int *gaιn_mdex, /* (o) vector gam indexes
This is signal 866 on Fig 8 */ float *target, /* d) quantization target
This is signal 816 on Fig 8 */ float *mem, /* (I) memory for adaptive codebook This is signal 815 on Fig 8 */ int lMem, /* (ι) length of memory */ int lTarget, /* (I) length of target vector */ int nStages, /* (I) number of quantization stages */ float *weιghtDenum /* (l) weighting filter denumerator coefficients
This is signal 836 on Fig 8 */ float *weιghtstate /* (l) state of the weighting filter for the target filtering Th s is state for the filtering 830 on Fig 8 */ )
{ int l, "j , icount, stage, best_mdex, float max_measure, ga , measure, crossDot invDot, float gams [NSTAGES] , float cb [ (MEML+SUBL+1) *CBEXPAND*SUBL] , int base_mdex, slnd, elnd, base_sιze,
/* for the weighting */ float buf [MEML+SUBL+2*FILTERORDER] , base_size=lMem-lTarget+l; if (lTarget==SUBL) base_size=lMem-ITarget+l+lτarget/2;
memcpy (buf , weightstate, sizeof (float) *FILTERORDER) ; memcpy (&buf [FILTERORDER] , mem, lMem*sizeof (float) ) ; memcpy (&buf [FILTERORDER+lMem] , target, lTarget*sizeof (float) ) ; /* At this point buf is the signal 825 on Fig. 8 */
AllPoleFilter (&bu [FILTERORDER] , weightDenum, IMem+lTarget , FILTERORDER); /* this function does an all pole filtering of buf. The result is returned in buf. This is the function 830 on Fig. 8 */ /* At this point buf is the signal 835 on Fig. 8 */
/* Construct the CB and target needed */ createCB(&buf [FILTERORDER] , cb, lMem, ITarget); memcpy (target, S-buf [FILTERORDER+lMem] , lTarget*sizeof (float) ) ; /* At this point target is the Signal 846 on Fig. 8 and cb is the signal 855 on Fig. 8 */
/* The Main Loop over stages */
/* This loop does the function 860 on Fig. 8 */ for (stage=0 ; stage<nStages,* stage++) { max_measure = (float) -10000000.0; best_index = 0 ; for (icount = 0; icount<base_size; icount++) { crossDot=0.0; invDot=0.0; for (j=0; j<ITarget; j++) { crossDot += target [j] *cb [icount*ITarget+j ] ; invDot += cb [icount*lTarget+j] *cb[icount*lTarget+j] ;
} invDot = (float)1.0/(invDot+EPS) ; if (stage==0) { measure= (float) -10000000.0; if (crossDot > 0.0) measure = crossDot*crossDot* invDot ; else { measure = crossDot*crossDot*invDot ;
} if (measure>max_measure) { best_index = icount ; max_measure = measure; gain = crossDot*invDot; } } base_index=best_index;
if (RESRANGE == -1) { /* unrestricted search */ slnd=0; elnd=base_size-l; } else { sInd=base_index-RESRANGE/2 ; if (slnd < 0) slnd=0; elnd = slnd+RESRANGE; if (elnd>=base_size) { elnd=base_size-l; Slnd=elnd-RESRANGE; } } for (i=l; i<CBEXPAND; i++) { slnd += base_size; elnd += base_size; for (icount=sInd; icount<=eInd; icount++) { crossDot=0.0; invDot=0.0; for ( j=0; j<lTarget; j++) { crossDot += target [j ] *cb [icount*lTarget+j ] ; invDot += cb [icount*lTarget+j ] *cb [icount*lTarget+j ] ;
invDot = (float) 1.0/ (invDo +EPS) ; if (stage==0) { measure= (float) -10000000.0; if (crossDot > 0.0) measure = crossDot*crossDot*invDot ,*
} else { measure = crossDot*crossDot*invDot;
} if (measure>max_measure) { best_index = icount; max_measure = measure ,* gain = crossDot*invDot ;
index [stage] = best_index;
/* index is signal 865 on Fig. 8 */
/* gain quantization */ if (stage==0) { if (gain<0.0) gain = 0.0; if (gain>1.0) gain = 1.0; gain = gainquant (gain, 1.0, 16, &gain_index [stage] ) ; /* This function search the best index for the gain quantizations */ /* gain_index is signal 866 on Fig. 8 */
} else { if (fabs (gain) > fabs (gains [stage-1] ) ) { gain = gain * (float) fabs ( gains [stage-1] ) / (float) fabs (gain) ,
}
gain = gainquant (gain, (float) fabs (gains [stage-1] ) , 8, &gain_index [stage] ) ,* /* This function search the best index for the gain quantizations */ /* gain_index is signal 866 on Fig. 8 */ /* Update target */ for ( *) =0 , 3 <lTarget , ] ++) target [] ] -= gam*cb [index [stage] *lTarget+] ]
gains [stage] =gam, } /* end of Main Loop for (stage=0 , */
Decoder
The decoder covered by the present invention is any decoder that interoperates with an encoder according to the above description. Such a decoder will extract from the encoded data a location for the start state. It will decode the start state and use it as an initialization of a memory for the decoding of the remaining signal frame. In case a data packet is not received a packet loss concealment could be advantageous .
Below follows a c-code example implementation of a decoder.
void ιLBC_decode ( /* mam decoder function */ float *decblock, /* (o) decoded signal block */ unsigned char *bytes, /* d) encoded signal bits */ int bytes_are_good /* (I) 1 if bytes are good data 0 if not */
){ float reverseDecresidual [BLOCKL] , mem [MEML] , int n, k, meml_gotten, Nfor, Nback, I, int diff, start_pos, int subcount, subframe, float factor, float std_decresιdual, one_mmus_factor_scaled, int gaussstart,
diff = STATE_LEN - STATE_SHORT_LEN, f (state_fιrst == 1) start_pos = (start-1) *SUBL, else start_pos = (start-1) *SUBL + diff;
StateConstruct (idxForMax, idxVec,
&syntdenum[ (start-1) * (FILTERORDER+1) ] , &decresidual [start_pos] , STATE_SHORT_LEN) ;
/* This function decodes the start state */
if (state_first) { /* Put adaptive part in the end */
/* Setup memory */ memset (mem, 0, (MEML-STATE_SHORT_LEN) *sizeof (float) ) ; memcpy (mem+MEML-STATE_SHORT_LEN, decresidual+start_pos, STATE_SHORT_LEN*sizeof (float) ) ;
/* construct decoded vector */ iCBConstruct (&decresidual [start_pos+STATE_SHORT_LEN] , extra_cb_index, extra_gain_index, mem+MEML-stMemL, stMemL, diff, NSTAGES) ; /* This function decodes a frame of residual */ } else {/* Put adaptive part in the beginning */
/* create reversed vectors for prediction */ for(k=0; k<diff ; k++ ) { reverseDecresidual [k] = decresidual [ (start+1) *SUBL -1- (k+STATE SHORT LEN)];
/* Setup memory */ meml_gotten = STATE_SHORT_LEN; for( k=0; k<meml_gotten; k++) { mem[MEML-l-k] = decresidual [start_pos k]; } memset (mem, 0, (MEML-k) *sizeof (float) ) ;
/* construct decoded vector */ iCBConstruct (reverseDecresidual , extra_cb_index, extra_gain_index, mem+MEML-stMemL, StMemL, diff, NSTAGES) ; /* get decoded residual from reversed vector */ for ( k=0 ; k<diff ; k++ ) { decresidual [start_pos-l-k] = reverseDecresidual [k] >
/* counter for predicted subframes */ subcount=0 ;
/* forward prediction of subframes */ Nfor = NSUB- start-1; if ( Nfor > 0 ) {
/* Setup memory */ memset (mem, 0, (MEML-STATE_LEN) *sizeof (float) ) ; memcpy (mem+MEML-STATE_LEN, decresidual÷ (start-1) *SUBL, STATE_LEN*sizeof (float) ) ;
/* Loop over subframes to encode */ for (subframe=0; subframe<Nfor; subframe++) { /* construct decoded vector */ iCBConstruct (&decresidual [ (start+1+subframe) *SUBL] , cb_index+subcount*NSTAGES, gain_index+subcount*NSTAGES, mem+MEML-memLf [subcount] , memLf [subcount] ,
SUBL, NSTAGES) ; /* Update memory */ memcpy(mem, mem+SUBL, (MEML-SUBL) *sizeof (float) ) ; memcpy (mem+MEML-SUBL, &decresidual [ (start+1+subframe) *SUBL] , SUBL*sizeof (float) ) ;
subcount++;
/* backward prediction of subframes */ Nback = start- 1 ; if ( Nback > 0 ) {
/* Create reverse order vectors */ for ( n=0; n<Nback; n++ ){ for( k=0; k<SUBL; k++ ){ reverseDecresidual [n*SUBL+k] = decresidual [ (start-
1) *SUBL-l-n*SUBL-k] ; } }
/* Setup memory */ meml_gotten = SUBL* (NSUB+1-start) ; if ( meml_gotten > MEML ){ meml_gotten=MEML; } for ( k=0; k<meml_gotten; k++) { mem [MEML-l-k] = decresidual [ (start- 1) *SUBL + k] ; } memset (mem, 0, (MEML-k) *sizeof (float) ) ;
/* Loop over subframes to decode */ for (subframe=0; subframe<Nback; subframe++) {
/* Construct decoded vector */ iCBConstruct (^reverseDecresidual [subframe*SUBL] , cb_index+subcount*NΞTAGES, gain_index+subcount*NSTAGES, mem+MEML-memLf [subcount] , memLf [subcount] , SUBL, NSTAGES) ;
/* Update memory */ memcpy (mem, mem+SUBL, (MEML-SUBL) *sizeof (float) ) ; memcpy (mem+MEML-SUBL, ^reverseDecresidual [subframe*SUBL] , SUBL*sizeof (float) ) ,*
subcount++;
/* get decoded residual from reversed vector */ for (i = 0; i < SUBL*Nback; i++) decresidual [SUBL*Nback - i - 1] = reverseDecresidual [i] ;
factor= (float) (gc_index+l) / (float) 16.0 ; for (i=0;i<STATE_SHORT_LEN;i++) decresidual [start_pos+i] *= factor;
factor *= 1.5; if (factor < 1.0) {
std_decresidual = 0.0; for (i=0;i<BLOCKL;i++) std_decresidual += decresidual [i] *decresidual [i] ; std_decresidual /= BLOCKL; std_decresidual = (float) sqrt (std_decresidual) ,*
one_minus_factor_scaled = (float) sqrt (1-factor* factor) *std_decresidual; gaussstart = (int) ceil (decresidual [0] ) % (GAUSS_NOISE_L-BLOCKL) ; for (i=0; i<BL0CKL;i++) decresidual [i] += one_minus_f ctor_scaled*gaussnoise [gaussstart+i]
void iLBC_decode (float *decblock, unsigned char *bytes, int bytes_are_good) {
static float old_syntdenum [ (FILTERORDER + 1) *NSUB] = {1,0,0,0,0,0,0,0,0,0,0,
1,0, 0,0,0,0,0,0,0,0,0, 1,0,0,0,0,0,0,0,0,0,0, 1,0,0,0,0,0,0,0,0, 0,0, 1,0, 0,0,0,0,0,0,0,0,0,
1,0, 0,0,0,0,0,0,0,0,0} static int last_lag = 20; float data [BLOCKL] ; float lsfunq[FILTERORDER*LPC_N] ; float PLCresidual [BLOCKL] , PLClpc [FILTERORDER + 1] float zeros [BLOCKL] , one [FILTERORDER + 1] ; int k, kk, i, start, idxForMax; int ιdxVec[STATE_LEN] , int dummy=0 , chec , int gam_ιndex[NASUB*NSTAGES] , extra_gam_ιndex [NSTAGES] , int cb_mdex[NSTAGES*NASUB] , extra_cb_mdex [NSTAGES] , int lsf_ι [LSF_NSPLIT*LPC_N] , int state_fιrst, gc_mdex, unsigned char *pbytes, float weightnum [(FILTERORDER + 1) *NSUB] , weightdenum [ (FILTERORDER + 1) *NSUB] int order_plus_one, f (bytes_are_good) { extracting parameters from bytes SimplelsfUNQdsfunq, lsf_ι) ,
/* This function decodes the LPC coefficients m LSF domain */ check=LSF_check(lsfunq, FILTERORDER, LPC_N) , /* This function checks stability of the LPC filter */
DecoderInterpolateLΞF(syntdenum, lsfunq, FILTERORDER), /* This function interpolates the LPC filter over the block */
Decode (decresidual, start, idxForMax, idxVec, syntdenum, cb_mdex, gam_mdex, extra_cb_mdex, extra_gam_mdex, state_fιrst,gc_ιndex) , /* This function is included above */
/* Preparing the pic for a future loss */ doThePLC(PLCresιdual, PLClpc, 0, decresidual, syntdenum + (FILTERORDER + 1)*(NSUB - 1), NSUB, SUBL, last_lag, start) , /* This function deals with packet loss concealments */ memcpy (decresidual, PLCresidual, BLOCKL*sιzeof (float) ) , } else {
/* Packet loss conceal */ memse (zeros, 0, BLOCKL*sιzeof (float) ) , one[0] = 1, memset (one+1, 0, FILTERORDER*sizeof (float) ) , start=0, doThePLC (PLCresidual, PLClpc, 1, zeros, one, NSUB, SUBL, last_lag, start) , memcpy (decresidual, PLCresidual, BLOCKL*sizeof (float) ) ;
order_plus_one = FILTERORDER + 1 ; for (i = 0; i < NSUB; i++) memcpy (syntdenum+ (i*order_plus_one) +1, PLClpc+1,
FILTERORDER*sizeof (float) ) ;
}
... postfiltering of the decoded residual for (i=0; i < NSUB; i++) syntFilter (decresidual + i*SUBL, syntdenum + i* (FILTERORDER+1) , SUBL);
/* This function does a syntesis filtering of the decoded residual */ memcpy (decblock, decresidual, BLOCKL*sizeo (float) ) ; memcpy (old_syntdenum, syntdenum, NSUB* (FILTERORDER+1) *sizeof (float) ) ;

Claims

1. A method of encoding a signal which is divided into consecutive blocks, wherein the method includes the following steps applied to a block: encoding a first part of the block, which first part is located somewhere between the two end boundaries of the block, thereby obtaining an encoded start state for the block; encoding a second part of the block using a predictive coding method that is based on said encoded start state and that gradually encodes said second part in the direction of one of said two end boundaries; and determining if there are any signal samples located between said start state and the other one of said two end boundaries, and if so, encoding a third part of the block including these samples using a predictive coding method that is based on said encoded start state and that gradually encodes said third part in the direction of said other one of said two end boundaries, whereby said third part, with respect to a time base associated with the block, is encoded in an opposite direction as compared with the encoding of said second part .
2. The method as claimed in claim 1, wherein the encoding of said third part is based on, in addition to said encoded start state, at least a part of the encoded second part of the block.
3. The method as claimed in claims 1 or 2 , wherein said second part is encoded in a direction along said time base towards the one of said two end boundaries that is located at the end of the block.
4. The method as claimed in claims 1 or 2 , wherein said second part is encoded in a direction which is opposite to said time base and towards the one of said two end boundaries that is located at the beginning of the block.
5. The method as claimed in any one of claims 1-4, wherein the encoding of the start state is based on any coding method in which the encoding is independent on, or made to be independent on, any previously encoded parts of the signal .
6. The method as claimed in any one of claims 1-5, wherein the predictive coding of said second and third parts includes an additional step of synthesis filtering from the excitation domain to the encoded signal domain.
7. The method as claimed in any one of claims 1-5, wherein said signal is a residual signal of an analysis filtered digital signal.
8. The method as claimed in claim 7, wherein the encoding of the start state is based on predictive encoding with noise shaping, which predictive encoding is made independent on any encoded part of the residual signal that precedes the part of the residual signal corresponding to said first part of the block.
9. The method as claimed in any one of claims 1-8, wherein the start state is all-pass filtered prior to encoding so as to distribute the energy more evenly among the samples of the start state.
10. The method as claimed in any one of claims 1-9, wherein the method uses recursive encoding by encoding a sub-block composed of said first part of the block in such way that the same steps as those applied to the block are applied to the sub-block.
11. The method as claimed in any one of claims 1-10, including partitioning the block into a set of consecutive intervals, wherein the encoding of said first part of the block includes encoding one or more consecutive intervals between the two end boundaries, in order to obtain said encoded start state.
12. The method as claimed in claim 11, wherein said one or more consecutive intervals are chosen among those intervals having the highest signal energy.
13. The method as claimed in any one of claims 1-12, wherein the encoding of the second and third part is based on any of the following coding methods: Linear Prediction Coding (LPC) ; Code Excited Linear Prediction (CELP) ; CELP with one or more adaptive codebook stages; Self Excited Linear Prediction (SELP) ; or Multi- Pulse Linear Prediction Coding (MP-LPC) .
14. The method as claimed in any one of claims 1-13, wherein the encoding of the second and third part is based on pre-weighting of an adaptive codebook memory and the target signal prior to construction of the adaptive codebook.
15. The method as claimed in any one of claims 1-14, wherein said signal is a speech signal.
16. The method as claimed in any one of claims 1-14, wherein said signal is an audio signal .
17. An apparatus for predictive encoding of a signal which is divided into consecutive blocks, wherein the apparatus includes means for performing the steps of the method as claimed in any one of claims 1-16 on each of said blocks.
18. A computer-readable medium storing computer- executable components for predictive encoding of a signal which is divided into consecutive blocks, wherein the computer-executable components performs the steps of the method as claimed in any one of claims 1-16 on each of said blocks .
19. A method of decoding of an encoded signal, which signal at the encoding end was divided into consecutive blocks before encoding of each block, wherein the method includes the following steps applied to an encoded block for reproducing a corresponding decoded block: decoding an encoded start state for reproducing a start state located somewhere between the two end boundaries of the block to be reproduced; decoding an encoded second part of the block using a predictive decoding method based on said start state for gradually reproducing said second part in the direction of one of said two end boundaries; and determining if the encoded block includes an encoded third part, and if so, decoding the encoded third part of the block using a predictive decoding method based on said start state for gradually reproducing said third part in the direction of the other one of said two end boundaries, whereby said third part, with respect to a time base associated with the block, is reproduced in an opposite direction as compared with the reproduction of said second part .
20. The method as claimed in claim 19, wherein the decoding of said third part is based on, in addition to said start state, at least a part of the decoded second part of the block.
21. The method as claimed in claim 19 or 20, wherein said second part is reproduced in a direction along said time base towards the one of said two end boundaries that is located at the end of the block.
22. The method as claimed in claim 19 or 20, wherein said second part is reproduced in a direction which is opposite to said time base and towards the one of said two end boundaries that is located at the beginning of the block.
23. The method as claimed in any one of claims 19-
22, wherein the decoding of the start state is based on any decoding method which reproduces the start state independently of any previously reproduced parts of the signal .
24. The method as claimed in any one of claims 19-
23, wherein the decoding of said second and third parts includes an additional step of synthesis filtering from the excitation domain to the decoded signal domain, the synthesis filtering of the second and third parts being performed in the same order as the reproduction of the second and third parts of the block.
25. The method as claimed in any one of claims 19- 23, wherein said signal is a residual signal of an analysis filtered digital signal .
26. The method as claimed in any one of claims 19- 25, wherein the decoding of said first, second and third parts is followed by an additional step of synthesis filtering from the excitation domain to the decoded signal domain, wherein the synthesis filtering of the block is performed in sequential order from the one of said two end boundaries occurring first in time to the other boundary occurring later in time.
27. The method as claimed in claim 25 or 26, wherein the decoding of the first part is based on predictive decoding with noise shaping, which decoding reproduces the start state independently of any previously reproduced part of the residual signal that precedes the part of the residual signal corresponding to said start state .
28. The method as claimed in any one of claims 19- 27, wherein the start state is all-pass filtered after said decoding of said first part so as to further concentrate the energy.
29. The method as claimed in any one of claims 19-
28, wherein the method uses recursive decoding by decoding a sub-block composed of said encoded start state in such way that the same steps as those applied to the block are applied to the sub-block.
30. The method as claimed in any one of claims 19-
29, wherein the decoding of the second and third part is based on any of the following decoding methods: Linear
Prediction Coding (LPC) ; Code Excited Linear Prediction (CELP) ; CELP with one or more adaptive codebooks; Self Excited Linear Prediction (SELP) ; or Multi-Pulse Linear Prediction Coding (MP-LPC) .
31. The method as claimed in any one of claims 19-
30, wherein said signal is a speech signal.
32. The method as claimed in any one of claims 19- 30, wherein said signal is an audio signal.
33. An apparatus for predictive decoding of an encoded signal, which signal at the encoding end was divided into consecutive blocks before encoding of each block, wherein the apparatus includes means for performing the steps of the method as claimed in any one of claims 19-32 on each encoded block for reproducing a corresponding decoded block.
34. A computer-readable medium storing computer- executable components for predictive decoding of an encoded signal, which signal at the encoding end was divided into consecutive blocks before encoding of each block, wherein the computer-executable components performs the steps of the method as claimed in any one of claims 19-32 on each encoded block for reproducing a corresponding decoded block.
PCT/SE2002/002226 2001-12-04 2002-12-03 Low bit rate codec WO2003049081A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
AU2002358365A AU2002358365A1 (en) 2001-12-04 2002-12-03 Low bit rate codec
US10/497,530 US7895046B2 (en) 2001-12-04 2002-12-03 Low bit rate codec
EP02792126A EP1451811B1 (en) 2001-12-04 2002-12-03 Low bit rate codec
AT02792126T ATE437431T1 (en) 2001-12-04 2002-12-03 LOW BITRATE CODEC
DE60233068T DE60233068D1 (en) 2001-12-04 2002-12-03 CODEC WITH LOW BITRATE
US13/030,929 US8880414B2 (en) 2001-12-04 2011-02-18 Low bit rate codec

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
SE0104059A SE521600C2 (en) 2001-12-04 2001-12-04 Lågbittaktskodek
SE0104059-1 2001-12-04

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US10497530 A-371-Of-International 2002-12-03
US13/030,929 Continuation US8880414B2 (en) 2001-12-04 2011-02-18 Low bit rate codec

Publications (1)

Publication Number Publication Date
WO2003049081A1 true WO2003049081A1 (en) 2003-06-12

Family

ID=20286184

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2002/002226 WO2003049081A1 (en) 2001-12-04 2002-12-03 Low bit rate codec

Country Status (8)

Country Link
US (2) US7895046B2 (en)
EP (1) EP1451811B1 (en)
CN (1) CN1305024C (en)
AT (1) ATE437431T1 (en)
AU (1) AU2002358365A1 (en)
DE (1) DE60233068D1 (en)
SE (1) SE521600C2 (en)
WO (1) WO2003049081A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007008001A3 (en) * 2005-07-11 2007-03-22 Lg Electronics Inc Apparatus and method of encoding and decoding audio signal
WO2007124485A2 (en) * 2006-04-21 2007-11-01 Dilithium Networks Pty Ltd. Method and apparatus for audio transcoding
EP2296144A1 (en) * 2008-12-31 2011-03-16 Huawei Technologies Co., Ltd. Method and apparatus for distributing sub-frame

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE521600C2 (en) 2001-12-04 2003-11-18 Global Ip Sound Ab Lågbittaktskodek
US7024358B2 (en) * 2003-03-15 2006-04-04 Mindspeed Technologies, Inc. Recovering an erased voice frame with time warping
FR2861491B1 (en) * 2003-10-24 2006-01-06 Thales Sa METHOD FOR SELECTING SYNTHESIS UNITS
US7602867B2 (en) 2004-08-17 2009-10-13 Broadcom Corporation System and method for linear distortion estimation by way of equalizer coefficients
CA2596341C (en) * 2005-01-31 2013-12-03 Sonorit Aps Method for concatenating frames in communication system
TWI285568B (en) * 2005-02-02 2007-08-21 Dowa Mining Co Powder of silver particles and process
SG179433A1 (en) * 2007-03-02 2012-04-27 Panasonic Corp Encoding device and encoding method
US8280539B2 (en) * 2007-04-06 2012-10-02 The Echo Nest Corporation Method and apparatus for automatically segueing between audio tracks
US20100274556A1 (en) * 2008-01-16 2010-10-28 Panasonic Corporation Vector quantizer, vector inverse quantizer, and methods therefor
CA2717584C (en) * 2008-03-04 2015-05-12 Lg Electronics Inc. Method and apparatus for processing an audio signal
CA2729665C (en) * 2008-07-10 2016-11-22 Voiceage Corporation Variable bit rate lpc filter quantizing and inverse quantizing device and method
FR2938688A1 (en) * 2008-11-18 2010-05-21 France Telecom ENCODING WITH NOISE FORMING IN A HIERARCHICAL ENCODER
US9245529B2 (en) * 2009-06-18 2016-01-26 Texas Instruments Incorporated Adaptive encoding of a digital signal with one or more missing values
US8554746B2 (en) 2010-08-18 2013-10-08 Hewlett-Packard Development Company, L.P. Multiple-source data compression
MX2018016263A (en) 2012-11-15 2021-12-16 Ntt Docomo Inc Audio coding device, audio coding method, audio coding program, audio decoding device, audio decoding method, and audio decoding program.
US10523490B2 (en) * 2013-08-06 2019-12-31 Agilepq, Inc. Authentication of a subscribed code table user utilizing optimized code table signaling
US10056919B2 (en) 2014-07-02 2018-08-21 Agilepq, Inc. Data recovery utilizing optimized code table signaling
AU2017278253A1 (en) 2016-06-06 2019-01-24 Agilepq, Inc. Data conversion systems and methods
US9934785B1 (en) 2016-11-30 2018-04-03 Spotify Ab Identification of taste attributes from an audio signal

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE501981C2 (en) * 1993-11-02 1995-07-03 Ericsson Telefon Ab L M Method and apparatus for discriminating between stationary and non-stationary signals
US5621852A (en) * 1993-12-14 1997-04-15 Interdigital Technology Corporation Efficient codebook structure for code excited linear prediction coding
US6101276A (en) * 1996-06-21 2000-08-08 Compaq Computer Corporation Method and apparatus for performing two pass quality video compression through pipelining and buffer management
FR2762464B1 (en) * 1997-04-16 1999-06-25 France Telecom METHOD AND DEVICE FOR ENCODING AN AUDIO FREQUENCY SIGNAL BY "FORWARD" AND "BACK" LPC ANALYSIS
EP1146713B1 (en) * 2000-03-03 2005-04-27 NTT DoCoMo, Inc. Method and apparatus for packet transmission with header compression
SE522261C2 (en) * 2000-05-10 2004-01-27 Global Ip Sound Ab Encoding and decoding of a digital signal
JP2002101417A (en) * 2000-09-22 2002-04-05 Oki Electric Ind Co Ltd Moving image encoding method and device therefor
US7020284B2 (en) * 2000-10-06 2006-03-28 Patrick Oscar Boykin Perceptual encryption and decryption of movies
US7171355B1 (en) * 2000-10-25 2007-01-30 Broadcom Corporation Method and apparatus for one-stage and two-stage noise feedback coding of speech and audio signals
JP3957460B2 (en) * 2001-01-15 2007-08-15 沖電気工業株式会社 Transmission header compression apparatus, moving picture encoding apparatus, and moving picture transmission system
SE521600C2 (en) 2001-12-04 2003-11-18 Global Ip Sound Ab Lågbittaktskodek

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ANDERSEN S.V. ET AL.: "Multiplexed predictive coding of speech", 2001 IEEE INTERNATIONAL CONFERENCE ON ACCOUSTICS, SPEECH AND SIGNAL PROCESSING, 2001. PROCEEDINGS, vol. 2, 7 May 2001 (2001-05-07) - 11 May 2001 (2001-05-11), SALT LAKE, CITY, UT, USA, pages 741 - 744, XP002960914 *
BOYCE J.M.: "Packet loss resilient transmission of MPEG video over the internet", SIGNAL PROCESSING IMAGE COMMUNICATIONS, vol. 15, no. 1-2, September 1999 (1999-09-01), pages 7 - 24, XP002902148 *
LESLIE B. ET AL.: "Packet loss resilient, scalable audio compression and streaming for IP networks", SECOND INTERNATIONAL CONFERENCE ON 3G MOBILE COMMUNICATION TECHNOLOGIES, 2001. (CONF. PUBL: NO.477), 26 March 2001 (2001-03-26) - 28 March 2001 (2001-03-28), LONDON, UK, pages 119 - 123, XP002960915 *

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8180631B2 (en) 2005-07-11 2012-05-15 Lg Electronics Inc. Apparatus and method of processing an audio signal, utilizing a unique offset associated with each coded-coefficient
US8010372B2 (en) 2005-07-11 2011-08-30 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8554568B2 (en) 2005-07-11 2013-10-08 Lg Electronics Inc. Apparatus and method of processing an audio signal, utilizing unique offsets associated with each coded-coefficients
US8046092B2 (en) 2005-07-11 2011-10-25 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US7830921B2 (en) 2005-07-11 2010-11-09 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US7835917B2 (en) 2005-07-11 2010-11-16 Lg Electronics Inc. Apparatus and method of processing an audio signal
US8510120B2 (en) 2005-07-11 2013-08-13 Lg Electronics Inc. Apparatus and method of processing an audio signal, utilizing unique offsets associated with coded-coefficients
US7930177B2 (en) 2005-07-11 2011-04-19 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signals using hierarchical block switching and linear prediction coding
US7949014B2 (en) 2005-07-11 2011-05-24 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US7962332B2 (en) 2005-07-11 2011-06-14 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8032386B2 (en) 2005-07-11 2011-10-04 Lg Electronics Inc. Apparatus and method of processing an audio signal
US8510119B2 (en) 2005-07-11 2013-08-13 Lg Electronics Inc. Apparatus and method of processing an audio signal, utilizing unique offsets associated with coded-coefficients
US8050915B2 (en) 2005-07-11 2011-11-01 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signals using hierarchical block switching and linear prediction coding
US7987009B2 (en) 2005-07-11 2011-07-26 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signals
US7991012B2 (en) 2005-07-11 2011-08-02 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US7991272B2 (en) 2005-07-11 2011-08-02 Lg Electronics Inc. Apparatus and method of processing an audio signal
US7996216B2 (en) 2005-07-11 2011-08-09 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8326132B2 (en) 2005-07-11 2012-12-04 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8032368B2 (en) 2005-07-11 2011-10-04 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signals using hierarchical block swithcing and linear prediction coding
US8032240B2 (en) 2005-07-11 2011-10-04 Lg Electronics Inc. Apparatus and method of processing an audio signal
US7966190B2 (en) 2005-07-11 2011-06-21 Lg Electronics Inc. Apparatus and method for processing an audio signal using linear prediction
US8417100B2 (en) 2005-07-11 2013-04-09 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US7987008B2 (en) 2005-07-11 2011-07-26 Lg Electronics Inc. Apparatus and method of processing an audio signal
US8055507B2 (en) 2005-07-11 2011-11-08 Lg Electronics Inc. Apparatus and method for processing an audio signal using linear prediction
US8065158B2 (en) 2005-07-11 2011-11-22 Lg Electronics Inc. Apparatus and method of processing an audio signal
US8108219B2 (en) 2005-07-11 2012-01-31 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8121836B2 (en) 2005-07-11 2012-02-21 Lg Electronics Inc. Apparatus and method of processing an audio signal
US8149877B2 (en) 2005-07-11 2012-04-03 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8149876B2 (en) 2005-07-11 2012-04-03 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8149878B2 (en) 2005-07-11 2012-04-03 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8155153B2 (en) 2005-07-11 2012-04-10 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8155152B2 (en) 2005-07-11 2012-04-10 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
US8155144B2 (en) 2005-07-11 2012-04-10 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signal
WO2007008001A3 (en) * 2005-07-11 2007-03-22 Lg Electronics Inc Apparatus and method of encoding and decoding audio signal
US8255227B2 (en) 2005-07-11 2012-08-28 Lg Electronics, Inc. Scalable encoding and decoding of multichannel audio with up to five levels in subdivision hierarchy
US8275476B2 (en) 2005-07-11 2012-09-25 Lg Electronics Inc. Apparatus and method of encoding and decoding audio signals
US7805292B2 (en) 2006-04-21 2010-09-28 Dilithium Holdings, Inc. Method and apparatus for audio transcoding
WO2007124485A2 (en) * 2006-04-21 2007-11-01 Dilithium Networks Pty Ltd. Method and apparatus for audio transcoding
WO2007124485A3 (en) * 2006-04-21 2008-06-19 Dilithium Networks Pty Ltd Method and apparatus for audio transcoding
EP2538407A3 (en) * 2008-12-31 2013-04-24 Huawei Technologies Co., Ltd. Framing method and apparatus
EP2296144A4 (en) * 2008-12-31 2011-06-22 Huawei Tech Co Ltd Method and apparatus for distributing sub-frame
EP2296144A1 (en) * 2008-12-31 2011-03-16 Huawei Technologies Co., Ltd. Method and apparatus for distributing sub-frame
EP2755203A1 (en) * 2008-12-31 2014-07-16 Huawei Technologies Co., Ltd. Framing method and apparatus of an audio signal
US8843366B2 (en) 2008-12-31 2014-09-23 Huawei Technologies Co., Ltd. Framing method and apparatus

Also Published As

Publication number Publication date
SE0104059L (en) 2003-07-03
ATE437431T1 (en) 2009-08-15
CN1615509A (en) 2005-05-11
EP1451811A1 (en) 2004-09-01
SE0104059D0 (en) 2001-12-04
SE521600C2 (en) 2003-11-18
US20060153286A1 (en) 2006-07-13
US7895046B2 (en) 2011-02-22
US20110142126A1 (en) 2011-06-16
AU2002358365A1 (en) 2003-06-17
US8880414B2 (en) 2014-11-04
DE60233068D1 (en) 2009-09-03
EP1451811B1 (en) 2009-07-22
CN1305024C (en) 2007-03-14

Similar Documents

Publication Publication Date Title
US8880414B2 (en) Low bit rate codec
KR101246991B1 (en) Audio codec post-filter
KR100837451B1 (en) Method and apparatus for improved quality voice transcoding
JP4005359B2 (en) Speech coding and speech decoding apparatus
CN101006495A (en) Audio encoding apparatus, audio decoding apparatus, communication apparatus and audio encoding method
WO2001059757A2 (en) Method and apparatus for compression of speech encoded parameters
WO2000038177A1 (en) Periodic speech coding
EP1141947A2 (en) Variable rate speech coding
EP2041745A1 (en) Adaptive encoding and decoding methods and apparatuses
EP2945158B1 (en) Method and arrangement for smoothing of stationary background noise
JPH10124094A (en) Voice analysis method and method and device for voice coding
US6826527B1 (en) Concealment of frame erasures and method
JP2003501675A (en) Speech synthesis method and speech synthesizer for synthesizing speech from pitch prototype waveform by time-synchronous waveform interpolation
US7684978B2 (en) Apparatus and method for transcoding between CELP type codecs having different bandwidths
CA2293165A1 (en) Method for transmitting data in wireless speech channels
EP1103953A2 (en) Method for concealing erased speech frames
Andersen et al. RFC 3951: Internet Low Bit Rate Codec (iLBC)
JP2004348120A (en) Voice encoding device and voice decoding device, and method thereof
KR100341398B1 (en) Codebook searching method for CELP type vocoder
JP2002073097A (en) Celp type voice coding device and celp type voice decoding device as well as voice encoding method and voice decoding method
JP3350340B2 (en) Voice coding method and voice decoding method
EP1212750A1 (en) Multimode vselp speech coder

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2002792126

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 20028271866

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2002792126

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2006153286

Country of ref document: US

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 10497530

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 10497530

Country of ref document: US