US8200481B2 - Method and device for performing frame erasure concealment to higher-band signal - Google Patents

Method and device for performing frame erasure concealment to higher-band signal Download PDF

Info

Publication number
US8200481B2
US8200481B2 US12/129,118 US12911808A US8200481B2 US 8200481 B2 US8200481 B2 US 8200481B2 US 12911808 A US12911808 A US 12911808A US 8200481 B2 US8200481 B2 US 8200481B2
Authority
US
United States
Prior art keywords
band signal
frame
current lost
repetition
pitch period
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/129,118
Other versions
US20090076805A1 (en
Inventor
Jianfeng Xu
Lei Miao
Chen Hu
Qing Zhang
Lijing Xu
Wei Li
Zhengzhong Du
Yi Yang
Fengyan Qi
Wuzhou Zhan
Dongqi Wang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Assigned to HUAWEI TECHNOLOGIES CO., LTD. reassignment HUAWEI TECHNOLOGIES CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ZHANG, QING, DU, ZHENGZHONG, HU, CHEN, LI, WEI, MIAO, LEI, Qi, Fengyan, WANG, DONGQI, XU, JIANFENG, XU, LIJING, YANG, YI, ZHAN, WUZHOU
Priority to US12/273,391 priority Critical patent/US7552048B2/en
Publication of US20090076805A1 publication Critical patent/US20090076805A1/en
Application granted granted Critical
Publication of US8200481B2 publication Critical patent/US8200481B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/005Correction of errors induced by the transmission channel, if related to the coding algorithm
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition

Definitions

  • the present invention relates to the field of signal decoding techniques, and in particular to a method and device for performing a frame erasure concealment to a higher-band signal.
  • the bandwidth of voice signal is low. Only a few voice codecs have a wide bandwidth, with the development of the network technology, the network transmission rate increases and the requirement for the wideband codec becomes higher.
  • the bandwidth of the voice codec is up to the ultra-wideband (50 Hz-14000 Hz) and fullband (20 Hz-20000 Hz).
  • a voice codec may be divided into a plurality of layers. The following description will be given with the voice codec including two layers as an example.
  • the voice codec including two layers separates the input signals into higher-band signals and lower-band signals with an analysis Quadrature-Mirror Filterbank at the coding side.
  • the lower-band signal is input into a lower-band coder for coding and the higher-band signal is input into a higher-band coder for coding.
  • the obtained lower-band data and higher-band data are synthesized into a bitstream via a bitstream multiplexer and the bitstream is sent out.
  • the lower-band signal refers to a signal whose frequency is in the lower band of the bandwidth for the signal and the higher-band signal refers to a signal whose frequency is in the higher band of the bandwidth for the signal.
  • the bandwidth of an input signal is 50 Hz-7000 Hz
  • the bandwidth of the lower-band signal may be 50 Hz-4000 Hz and the bandwidth of the higher-band signal may be 4000 Hz-7000 Hz.
  • the decoding is implemented at the decoding side.
  • the bitstream is divided into a lower-band bitstream and a higher-band bitstream, and the lower-band bitstream and the higher-band bitstream are input into the lower-band decoder and the higher-band decoder for decoding, respectively.
  • the lower-band signal and the higher-band signal are obtained.
  • the lower-band signal and the higher-band signal are synthesized into the voice signal to be output with a synthesis Quadrature-Mirror Filterbank.
  • VoIP Voice over IP
  • the voice transmission requires transmitting a small data packet in realtime and reliably.
  • a voice frame is lost during the transmission, there is no time for resending the lost voice frame.
  • the voice frame is equivalent to a lost frame.
  • the voice frame may be considered as a lost frame.
  • the voice is intermittent and the voice quality is affected greatly.
  • a frame erasure concealment processing is required.
  • the lost voice data are estimated and the estimated data are used to replace the lost data.
  • a better voice quality may be obtained in a frame lost environment.
  • the voice codec which divides the input signal into the higher-band signal and the lower-band signal
  • the frame erasure concealment is performed to the lower-band signal and the higher-band signal respectively during the frame erasure concealment, and the higher-band signal and the lower-band signal obtained after the frame erasure concealment are synthesized into a voice signal to be output via the synthesis Quadrature-Mirror Filterbank.
  • the frame erasure concealment method includes the insertion method, the interpolation method and the regeneration method.
  • the insertion method for the frame erasure concealment includes the splicing, the silence replacement, the noise replacement and the previous frame repetition.
  • the interpolation method for the frame erasure concealment includes the waveform replacement, the pitch repetition and the time domain waveform revision.
  • the regeneration method includes the coder parameter interpolation and the model-based regeneration method.
  • the model-based regeneration method has the best voice quality and the highest algorithm complexity, and the previous frame repetition method has a good voice quality and an algorithm complexity which is not high.
  • a frame erasure concealment algorithm with a high complexity and a high voice quality (for example, the pitch repetition, the time domain waveform revision, the coder parameter interpolation and the model-based regeneration method) is used for the lower-band signal.
  • a frame erasure concealment algorithm with a low complexity and a low voice quality is used for the higher-band signal.
  • the pitch repetition is used for the lower-band signal to implement the frame erasure concealment, while the previous frame repetition and attenuation method is used for the higher-band signal to implement the frame erasure concealment.
  • N represents the number of the samples of a frame
  • the attenuation coefficient ⁇ is a nonnegative number ranging from 0 to 1.
  • the attenuation coefficient ⁇ may be a constant such as 0.8 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
  • the lower-band signal and the higher-band signal have the consistent periodicity.
  • the original periodicity of the higher-band signal is destroyed when the frame erasure concealment is performed to the higher-band signal with the prior art.
  • the quality of the voice signal output from the speech decoder is lowered.
  • One embodiment of the present invention provides a method for performing a frame erasure concealment to a higher-band signal so as to improve the quality of the voice signal output from the speech decoder.
  • Another embodiment of the present invention provides a device for performing a frame erasure concealment to a higher-band signal so as to improve the quality of the voice signal output from the speech decoder.
  • Another embodiment of the present invention provides a speech decoder so as to improve the quality of the voice signal output from the speech decoder.
  • a method for performing a frame erasure concealment to a higher-band signal includes:
  • a device for performing a frame erasure concealment to a higher-band signal includes:
  • a periodic intensity calculation module adapted to calculate a periodic intensity of the higher-band signal with respect to pitch period information of a lower-band signal, judge whether the periodic intensity is higher than or equal to a preconfigured threshold, if the periodic intensity is higher than or equal to the preconfigured threshold, transmit the higher-band signal of a current lost frame to a pitch period repetition module, and if the periodic intensity is lower than the preconfigured threshold, transmit the higher-band signal of the current lost frame to a previous frame data repetition module;
  • the pitch period repetition module adapted to perform the frame erasure concealment to the higher-band signal of the current lost frame with a pitch period repetition based method
  • the previous frame data repetition module adapted to perform the frame erasure concealment to the higher-band signal of the current lost frame with a previous frame data repetition based method.
  • a speech decoder includes:
  • bitstream demultiplex module adapted to demultiplex an input bitstream into a lower-band bitstream and a higher-band bitstream
  • a lower-band decoder and a higher-band decoder adapted to decode the lower-band bitstream and the higher-band bitstream to a lower-band signal and a higher-band signal respectively;
  • a frame erasure concealment device for a lower-band signal, adapted to perform a frame erasure concealment to the lower-band signal to obtain a pitch period of the lower-band signal;
  • a frame erasure concealment method for a higher-band signal adapted to calculate a periodic intensity of the higher-band signal with respect to pitch period information of the lower-band signal, determine whether the periodic intensity of the higher-band signal is higher than or equal to a preconfigured threshold; if the periodic intensity of the higher-band signal is higher than or equal to the preconfigured threshold, use a pitch period repetition based method to perform the frame erasure concealment to the higher-band signal of a current lost frame, and if the periodic intensity of the higher-band signal is lower than the preconfigured threshold, use a previous frame data repetition based method to perform the frame erasure concealment to the higher-band signal of the current lost frame; and
  • a synthesis Quadrature-Mirror Filterbank adapted to synthesize the lower-band signal and the higher-band signal after the frame erasure concealment, into a voice signal to be output.
  • the periodic intensity of the higher-band signal with respect to the pitch period of the lower-band signal is calculated; then, it is determined whether the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a preconfigured threshold; when the periodic intensity is higher than or equal to the threshold, the pitch period repetition based method is used to perform the frame erasure concealment to the higher-band signal of the current lost frame.
  • the higher-band signal has a strong periodicity, the periodicity of the higher-band signal is not destroyed while the periodicity of the higher-band signal.
  • the problem that the quality of the voice signal is lowered because the periodicity of the higher-band signal is destroyed, can be avoided.
  • the previous frame data repetition based method is used to perform the frame erasure concealment to the current lost frame.
  • the periodic intensity of the higher-band signal is weak, the high frequency noise is introduced. Therefore, the problem that the voice quality of the voice signal is lowered because the high frequency noise is introduced, can be avoided.
  • the technical solution for performing the frame erasure concealment to the higher-band signal according to one embodiment of the present invention can improve the quality of the voice signal output from the speech decoder.
  • FIG. 1 is a structure diagram of the speech decoder according an embodiment of the present invention.
  • FIG. 2 is a flow char showing the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention
  • FIG. 3 is a structure diagram of the frame erasure concealment device for the higher-band signal according one embodiment of the present invention.
  • FIG. 4 is a structure diagram of the pitch period repetition module according one embodiment of the present invention.
  • FIG. 5 is a structure diagram of a previous frame data repetition module according to one embodiment of the present invention.
  • FIG. 6 is a structure diagram of another previous frame data repetition module according to one embodiment of the present invention.
  • FIG. 1 is a structure diagram of the speech decoder according one embodiment of the present invention.
  • the speech decoder includes a bitstream demultiplex module, a lower-band decoder, a higher-band decoder, a frame erasure concealment device for a lower-band signal, a frame erasure concealment device for a higher-band signal and a synthesis Quadrature-Mirror Filterbank.
  • the bitstream demultiplex module is adapted to demultiplex the input bitstream into a lower-band bitstream and a higher-band bitstream.
  • the lower-band signal and the higher-band signal are obtained by decoding the lower-band bitstream and the higher-band bitstream with the lower-band decoder and the higher-band decoder respectively.
  • the lower-band signal and the higher-band signal are processed by the frame erasure concealment device for the lower-band signal and the frame erasure concealment device for the higher-band signal respectively, and then are synthesized by the synthesis Quadrature-Mirror Filterbank into a voice signal to be output.
  • the frame erasure concealment device for the lower-band signal processes the frame erasure concealment of the lower-band signal and provides the pitch period of the lower-band signal to the frame erasure concealment device for the higher-band signal.
  • the frame erasure concealment device for the higher-band signal performs the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention.
  • the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention includes: calculating a periodic intensity of a higher-band signal with respect to the pitch period information of a lower-band signal; determining whether the periodic intensity of the higher-band signal is higher than or equal to a preconfigured threshold; if the periodic intensity of the higher-band signal is higher than or equal to the preconfigured threshold, using a pitch period repetition based method to perform the frame erasure concealment to the higher-band signal of a current lost frame, and if the periodic intensity of the higher-band signal is lower than the preconfigured threshold, using a previous frame data repetition based method to perform the frame erasure concealment to the higher-band signal of the current lost frame.
  • FIG. 2 is a flow char showing the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention.
  • FIG. 3 is a structure diagram of the frame erasure concealment device for the higher-band signal according one embodiment of the present invention.
  • the method for performing the frame erasure concealment to the higher-band signal includes the following steps.
  • Step 700 A periodic intensity of a higher-band signal with respect to a lower-band signal is calculated according to a lower-band signal pitch period which is obtained through the frame erasure concealment of the lower-band signal.
  • the frame erasure concealment of the lower-band signal use a frame erasure concealment method which may obtain the pitch period, such as a pitch repetition based method, a model-based regeneration based method and a coder parameter interpolation based method, and the coder parameter includes a pitch period parameter.
  • the model-based regeneration based method may a frame erasure concealment method which implements the regeneration based on the linear predictive model.
  • the frame erasure concealment device for the higher-band signal first uses the signal frame erasure concealment for the lower-band signal to calculate the pitch period of the lower-band signal t lb and then uses the history buffer signal of the higher-band signal s hb (n) to calculate the periodic intensity r(t lb ) of the higher-band signal with respect to t lb .
  • the function according to evaluating the periodic intensity of signal includes the autocorrelation function and the normalized correlation function.
  • the pitch period of the lower-band signal may be obtained by calculating the autocorrelation function for the lower-band signal.
  • the formula of the correlation function is as follows:
  • r(i) represents the correlation function with respect to i
  • s lb (j) represents the lower-band signals
  • N represents the length of the window for calculating the correlation function, such as the number of the samples for the voice signal of a frame
  • min_pitch is the lower limit for searching the pitch period
  • max_pitch is the upper limit for searching the pitch period.
  • the pitch period of the lower-band signal is as follows:
  • t lb is equal to the value of i when r(i) has the maximum value.
  • s hb (n) ⁇ M, . . . , ⁇ 1 represents the history buffer signal of the higher-band signal and M represents the number of the samples in the history buffer signal of the higher-band signal.
  • N is a constant positive integer such as the number of the samples for the higher-band signal in a frame.
  • N is a constant positive integer such as the number of the samples for the higher-band signal in a frame.
  • the frame erasure concealment device for the higher-band signal as shown in FIG. 3 includes a periodic intensity calculating module, a pitch period repetition module and a previous frame data repetition module.
  • the periodic intensity calculating module calculates the lower-band signal pitch period with the signal frame erasure concealment for the lower-band signal and calculates the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal.
  • the pitch period information of the lower-band signal may include a value around the pitch period of the lower-band signal t lb .
  • the frame erasure concealment device for the higher-band signal may first calculate the pitch period of the lower-band signal t lb with the signal frame erasure concealment for the lower-band signal.
  • an interval in the pitch period of the lower-band signal t lb such as [max(t lb ⁇ m, pit_min), min(t lb +m, pit_max)] may be used to calculate the normalized correlation function for the higher-band signal.
  • the history buffer signal of the higher-band signal s hb (n) is used to calculate the periodic intensity of the higher-band signal r(t lb ) with respect to [max(t lb ⁇ m,pit_min), min(t lb +m,pit_max)],
  • m is the radius of the searching interval, such as 3 or any other value less than or equal to 3. According to experiment results, the larger the m is, the higher the accuracy is and the higher the algorithm complexity is. In this embodiment, m is equal to 3.
  • the pitch period for higher-band signal t hb is as follows:
  • step 701 it is determined whether the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a preconfigured threshold. If the periodic intensity of the higher-band signal with respect to the pitch period of the lower-band signal is higher than or equal to a preconfigured threshold, step 702 is performed, otherwise, step 703 is performed.
  • a threshold R may be selected through a large number of test.
  • the speech decoder for implementing the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention may be used to obtain voice signals output with different thresholds, then the signal to noise ratio (SNR) of the voice signals are calculated, and then a threshold corresponding to a voice signal with the maximum SNR is selected as the threshold selected in step 701 .
  • the threshold selected in step 701 may be determined according an empirical value.
  • the threshold may be a nonnegative number ranging from 0 to 1.
  • the R nor such as 0.7, may be selected through a large number of test.
  • the processes are the same as those in the method for calculating the periodic intensity with the correlation function.
  • an empirical value may be selected.
  • the periodic intensity calculating module calculates the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal, then judges whether the calculated periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a threshold preconfigured in the periodic intensity calculating module. If the calculated periodic intensity is higher than or equal to the threshold, the pitch period repetition module performs subsequent processes; otherwise, the previous frame data repetition module performs subsequent processes.
  • step 702 the pitch period repetition method is used to perform the frame erasure concealment of the higher-band signal in the lost frame.
  • the pitch period repetition method includes a pitch repetition method, a model-based regeneration based method or a pitch repetition and attenuation based method.
  • step 702 when the pitch repetition is used to perform the frame erasure concealment to the higher-band signal.
  • the pitch period repetition method includes the pitch repetition and attenuation based method, the frame erasure concealment is performed to the higher-band signal of the current lost frame.
  • N represents the number of the samples of a frame; the attenuation coefficient ⁇ is a nonnegative number ranging from 0 to 1.
  • the attenuation coefficient ⁇ may be a constant such as 0.8, or a variable which changes adaptively according to the number of continuously lost packets. For example, for the first lost frame, a larger attenuation coefficient such as 0.9 is multiplied; for the second lost frame and the following frames, a smaller attenuation coefficient such as 0.7 is multiplied.
  • the method for determining the threshold may also be used to determine the attenuation coefficient and repeated descriptions thereof are omitted.
  • MDCT Modified Discrete Cosine Transform
  • IMDCT Invert Modified Discrete Cosine Transform
  • is an attenuation factor, such as ⁇ square root over (2/2) ⁇ .
  • the attenuation coefficient ⁇ may be a nonnegative number ranging from 0 to 1.
  • FIG. 4 shows a pitch period repetition module according one embodiment of the present invention, including: a repetition module, adapted to duplicate a signal of a frame according to a pitch period; an attenuation module, adapted to add a sinusoid window to a duplicated signal of the frame and attenuate the signal to obtain an estimated value of the IMDCT coefficient for the frame; and an overlap-add (OLA) module, adapted to overlap-add the estimated value of current frame with the latter frame of IMDCT coefficient of a previous frame and attenuate.
  • OVA overlap-add
  • the higher-band signal of the lost frame is obtained with the residual of the higher-band signal via the linear predictive synthesizer.
  • the formula is as follows:
  • the recovered signals are multiplied by an attenuation coefficient ⁇ , and the higher-band signal which is obtained by performing the frame erasure concealment with the regeneration method based on the linear predictive model is as follows:
  • s hb (n) 0, . . . ,N ⁇ 1 represents the recovered higher-band signal of the current lost frame, and N represents the number of the samples in a frame.
  • the attenuation coefficient ⁇ may be a nonnegative number ranging from 0 to 1.
  • the attenuation coefficient ⁇ may be a constant such as 0.8, or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
  • the pitch period repetition module shown in FIG. 3 performs the frame erasure concealment to the higher-band signal of the lost frame with the pitch period repetition based method.
  • the pitch period repetition module may perform the frame erasure concealment to the higher-band signal with the pitch repetition based method, or perform the frame erasure concealment to the higher-band signal with the regeneration based method based on a model such as the linear predictive model method.
  • step 703 the previous frame data repetition based method is used to perform the frame erasure concealment to the higher-band signal of the lost frame.
  • the previous frame data repetition based method includes the previous frame repetition based method, the previous frame repetition and attenuation based method, and the coder parameter interpolation based method.
  • the previous frame data repetition module shown in FIG. 3 performs the frame erasure concealment to the higher-band signal of the lost frame with the previous data repetition based method.
  • the previous frame repetition based method, the previous frame repetition and attenuation based method or the coder parameter interpolation based method may be used.
  • the time domain data of the previous frame of the current lost frame is duplicated into the current lost frame and an attenuation coefficient ⁇ is multiplied.
  • N represents the number of the samples contained in a frame.
  • the attenuation coefficient ⁇ may be a nonnegative number ranging from 0 to 1.
  • the attenuation coefficient ⁇ may be a constant such as 0.8 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
  • FIG. 5 shows a previous frame data repetition module according one embodiment of the present invention.
  • the previous frame data repetition module includes a repetition module for a higher-band signal of a previous frame, adapted to duplicate the higher-band signal of the previous frame into the current lost frame and input the duplicated frame into an attenuation module; the attenuation module, adapted to multiply the duplicated frame by the attenuation coefficient ⁇ to obtain the higher-band signal after the frame erasure concealment.
  • the previous frame repetition and attenuation based method is used to repeat and attenuate some intermediate data during recovering the time domain data from the frequent domain data of the previous frame, including: using an intermediate data which is obtained during recovering a time domain data from a frequent domain data of the previous frame of the current lost frame, as the intermediate data of the current lost frame and attenuating the intermediate data, and synthesizing the attenuated time domain data of the current lost frame with the intermediate data of the current lost frame; or, using the intermediate data which is obtained during recovering the time domain data from the frequent domain data of the previous frame and is attenuated, as the intermediate data of the current lost frame, and then the time domain data of the lost frame is synthesized with the intermediate data.
  • the IMDCT coefficient of the previous frame may be repeated and attenuated to estimate the IMDCT coefficient of the current lost frame.
  • the IMDCT coefficient of the previous frame and the IMDCT coefficient of the current lost frame are overlap-added to obtain the time domain data of the current lost frame.
  • d cur (n) is the IMDCT coefficient of the current lost frame
  • d pre (n) is the IMDCT coefficient of the previous frame
  • N represents the number of the samples contained in a frame.
  • the attenuation coefficient ⁇ is a nonnegative number ranging from 0 to 1.
  • the attenuation coefficient ⁇ may be a constant such as 0.8 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
  • s hb (n) is the time domain data of the current lost frame
  • w tdac (n) is the window function to be added during the OLA synthesis, such as the hamming window and the sinusoid window.
  • the method for determining the window function is the same as the method for determining the window function during calculating the s hb (n) in the prior art.
  • FIG. 6 is a structure diagram of another previous frame data repetition module according to one embodiment of the present invention.
  • the previous frame data repetition module includes a previous frame IMDCT coefficient storage module, an attenuation module and an OLA module.
  • the previous frame IMDCT coefficient storage module is adapted to store IMDCT coefficient during recovering the time domain data from the frequent domain data.
  • the attenuation module is adapted to attenuate the IMDCT coefficient with ⁇ to obtain the IMDCT coefficient of the current lost frame.
  • the IMDCT coefficient of the previous frame and the IMDCT coefficient of the current lost frame obtained after the attenuation are input into the OLA module for overlap-adding. Then, the higher-band signal of the current lost frame after the frame erasure concealment is obtained.
  • the IMDCT is performed to the MDCT coefficient to obtain the IMDCT coefficient, and the IMDCT coefficient is attenuated.
  • the time domain data of the current lost frame is obtained through the OLA process.
  • the calculation amount of the IMDCT process is further added.
  • the higher-band decoder is a higher-band decoder based on fast fourier transform (FFT)
  • FFT fast fourier transform
  • the invert fast fourier transform (IFFT) coefficient of the previous frame may be repeated and attenuated to estimate the IFFT coefficient of the current lost frame. Then, the OLA is performed to obtain the time domain data of the current lost frame.
  • FFT fast fourier transform
  • IFFT invert fast fourier transform
  • d cur (n) is the IFFT coefficient of the current lost frame
  • d pre (n) is the IFFT coefficient of the previous frame
  • M represents the number of the IFFT coefficients required by a frame.
  • M is larger than N which represents the number of the samples in a frame.
  • the attenuation coefficient ⁇ is a nonnegative number ranging from 0 to 1.
  • the attenuation coefficient ⁇ may be a constant such as 0.875 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
  • s hb (n) is the time domain data of the current lost frame
  • w(n) is the window function to be added during the OLA synthesis, such as the hamming window and the sinusoid window.
  • the speech decoder may further include a multi-layer decoder including a core layer and an enhance layer.
  • the core codec is a traditional narrowband or wideband codec. Some enhance layers are extended based on the core layer of the core codec. Thus, the core layer may intercommunicate with corresponding traditional voice codec directly.
  • the enhance layer includes a lower-band enhance layer adapted to improve the voice quality of the lower-band voice signal and a higher-band enhance layer adapted to expand the voice bandwidth. For example, the narrowband signal is expanded to the wideband signal, or the wideband signal is expanded to the ultra-wideband signal, or the ultra wideband signal is expanded to the fullband signal.
  • the speech decoder including at least two layers synthesizes the signals of different layers which have been decoded into the lower-band signal and the higher-band signal and performs the frame erasure concealment processing respectively, thus the voice signal to be output from the speech decoder is obtained. Therefore, the technical solution for performing the frame erasure concealment to the higher-band signal according to one embodiment of the present invention is also applicable to the multilayer decoder including the core layer and the enhance layer.
  • the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is calculated; then, it is determined whether the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a preconfigured threshold; if the periodic intensity is higher than or equal to the preconfigured threshold, the pitch period repetition based method is used to perform the frame erasure concealment to the higher-band signal of the current lost frame.
  • the pitch period of the lower-band signal is obtained when the frame erasure concealment is performed to the lower-band signal and the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is calculated.
  • the hardware overhead of configuring the periodicity intensity calculation module can be decreased.
  • the previous frame data repetition based method is used to perform the frame erasure concealment to the current lost frame.
  • the periodic intensity of the higher-band signal is weak, the high frequency noise is introduced. Therefore, the problem that the voice quality of the voice signal is lowered because the high frequency noise is introduced, can be avoided.
  • the technical solution for performing the frame erasure concealment to the higher-band signal according to one embodiment of the present invention can improve the quality of the voice signal output from the speech decoder.
  • the intermediate data during recovering the time domain data from the frequent domain data of the previous frame may be used to perform the frame erasure concealment to the higher-band signal of the current lost frame.
  • the IMDCT coefficient obtained from the decoder may be repeated and attenuated, then the OLA process is performed to recover the time domain data of the current lost frame.
  • the calculation amount can be reduced.
  • Embodiments within the scope of the present invention also include computer-readable media for carrying or having computer-executable instructions, computer-readable instructions, or data structures stored thereon.
  • Such computer-readable media can include physical storage media such as RAM, ROM, other optical disk storage, or magnetic disk storage.
  • the program of instructions stored in the computer-readable media is executed by a machine to perform a method. The method may include the steps of any one of the method embodiments of the present invention.

Abstract

The present invention discloses a method for performing a frame erasure concealment to a higher-band signal, including: calculating a periodic intensity of a higher-band signal with respect to a lower-band signal; judging whether the periodic intensity of the higher-band signal is higher than or equal to a preconfigured threshold; if the periodic intensity of the higher-band signal is higher than or equal to the preconfigured threshold, using a pitch period repetition method to perform the frame erasure concealment to the higher-band signal of a current lost frame; and if the periodic intensity of the higher-band signal is lower than the preconfigured threshold, using a previous frame data repetition method to perform the frame erasure concealment to the higher-band signal of the current lost frame. The present invention further discloses a device for performing a frame erasure concealment to a higher-band signal and a speech decoder. The problem that the quality of the voice signal is lowered is avoided.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS
The present application claims the benefit of Chinese Patent Application No. 200710153955.0, filed on Sep. 15, 2007, entitled “METHOD AND DEVICE FOR PERFORMING FRAME ERASURE CONCEALMENT TO HIGHER-BAND SIGNAL”, and Chinese Patent Application No. 200710194570.9, filed on Nov. 24, 2007, entitled “METHOD AND DEVICE FOR PERFORMING FRAME ERASURE CONCEALMENT TO HIGHER-BAND SIGNAL,” both of which are hereby incorporated by reference in their entirety.
FIELD OF THE INVENTION
The present invention relates to the field of signal decoding techniques, and in particular to a method and device for performing a frame erasure concealment to a higher-band signal.
BACKGROUND OF THE INVENTION
In most traditional voice codecs, the bandwidth of voice signal is low. Only a few voice codecs have a wide bandwidth, with the development of the network technology, the network transmission rate increases and the requirement for the wideband codec becomes higher. Optionally, it is desirable that the bandwidth of the voice codec is up to the ultra-wideband (50 Hz-14000 Hz) and fullband (20 Hz-20000 Hz).
In order to make the wideband voice codec compatible with the traditional voice codec, a voice codec may be divided into a plurality of layers. The following description will be given with the voice codec including two layers as an example.
First, the voice codec including two layers separates the input signals into higher-band signals and lower-band signals with an analysis Quadrature-Mirror Filterbank at the coding side. The lower-band signal is input into a lower-band coder for coding and the higher-band signal is input into a higher-band coder for coding. The obtained lower-band data and higher-band data are synthesized into a bitstream via a bitstream multiplexer and the bitstream is sent out. The lower-band signal refers to a signal whose frequency is in the lower band of the bandwidth for the signal and the higher-band signal refers to a signal whose frequency is in the higher band of the bandwidth for the signal. For example, when the bandwidth of an input signal is 50 Hz-7000 Hz, the bandwidth of the lower-band signal may be 50 Hz-4000 Hz and the bandwidth of the higher-band signal may be 4000 Hz-7000 Hz. The decoding is implemented at the decoding side. The bitstream is divided into a lower-band bitstream and a higher-band bitstream, and the lower-band bitstream and the higher-band bitstream are input into the lower-band decoder and the higher-band decoder for decoding, respectively. Thus, the lower-band signal and the higher-band signal are obtained. The lower-band signal and the higher-band signal are synthesized into the voice signal to be output with a synthesis Quadrature-Mirror Filterbank.
At present, the application of Voice over IP (VoIP) and the application of the wireless network voice become more and more popular. The voice transmission requires transmitting a small data packet in realtime and reliably. When a voice frame is lost during the transmission, there is no time for resending the lost voice frame. Similarly, if a voice frame passes through a long routing and can not reach timely when the voice frame is to be played, the voice frame is equivalent to a lost frame. Thus, in the voice system, if a voice frame can not reach or can not reach in time, the voice frame may be considered as a lost frame.
If no processing is performed to the lost frame, the voice is intermittent and the voice quality is affected greatly. Thus, for the lost frame, a frame erasure concealment processing is required. In other words, the lost voice data are estimated and the estimated data are used to replace the lost data. Hence, a better voice quality may be obtained in a frame lost environment. As for the voice codec which divides the input signal into the higher-band signal and the lower-band signal, the frame erasure concealment is performed to the lower-band signal and the higher-band signal respectively during the frame erasure concealment, and the higher-band signal and the lower-band signal obtained after the frame erasure concealment are synthesized into a voice signal to be output via the synthesis Quadrature-Mirror Filterbank.
The frame erasure concealment method includes the insertion method, the interpolation method and the regeneration method.
The insertion method for the frame erasure concealment includes the splicing, the silence replacement, the noise replacement and the previous frame repetition.
The interpolation method for the frame erasure concealment includes the waveform replacement, the pitch repetition and the time domain waveform revision.
The regeneration method includes the coder parameter interpolation and the model-based regeneration method.
The model-based regeneration method has the best voice quality and the highest algorithm complexity, and the previous frame repetition method has a good voice quality and an algorithm complexity which is not high.
Because the affections on the voice quality by the lower-band signal are higher than that by the higher-band signal, a frame erasure concealment algorithm with a high complexity and a high voice quality (for example, the pitch repetition, the time domain waveform revision, the coder parameter interpolation and the model-based regeneration method) is used for the lower-band signal. A frame erasure concealment algorithm with a low complexity and a low voice quality is used for the higher-band signal. Thus, the compromise between the voice quality and the complexity is accomplished.
In the speech decoder of the prior art, the pitch repetition is used for the lower-band signal to implement the frame erasure concealment, while the previous frame repetition and attenuation method is used for the higher-band signal to implement the frame erasure concealment.
The formula for recovering the higher-band signal based on the previous frame repetition and attenuation method is as follows:
s hb(n)=s hb(n−N)·α,n=0, . . . ,N−1
In the formula, shb(n), n=0, . . . , N−1 represents the recovered higher-band signal of the lost frame, and N represents the number of the samples of a frame; the attenuation coefficient α is a nonnegative number ranging from 0 to 1. The attenuation coefficient α may be a constant such as 0.8 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
In the process of realizing the invention, the inventor finds: when the signal has a strong periodicity, the higher-band signal can not be recovered correctly. When the lower-band signal and the higher-band signal have the consistent periodicity. the original periodicity of the higher-band signal is destroyed when the frame erasure concealment is performed to the higher-band signal with the prior art. Thus, the quality of the voice signal output from the speech decoder is lowered.
SUMMARY OF THE INVENTION
One embodiment of the present invention provides a method for performing a frame erasure concealment to a higher-band signal so as to improve the quality of the voice signal output from the speech decoder.
Another embodiment of the present invention provides a device for performing a frame erasure concealment to a higher-band signal so as to improve the quality of the voice signal output from the speech decoder.
Another embodiment of the present invention provides a speech decoder so as to improve the quality of the voice signal output from the speech decoder.
The technical solutions according to the embodiments of the present invention are implemented as follows to accomplish the above objects.
A method for performing a frame erasure concealment to a higher-band signal, includes:
calculating a periodic intensity of the higher-band signal with respect to pitch period information of a lower-band signal;
judging whether the periodic intensity is higher than or equal to a preconfigured threshold, if the periodic intensity is higher than or equal to the preconfigured threshold, performing the frame erasure concealment to the higher-band signal of a current lost frame with a pitch period repetition based method, if the periodic intensity is lower than the preconfigured threshold, performing the frame erasure concealment to the higher-band signal of the current lost frame with a previous frame data repetition based method.
A device for performing a frame erasure concealment to a higher-band signal, includes:
a periodic intensity calculation module, adapted to calculate a periodic intensity of the higher-band signal with respect to pitch period information of a lower-band signal, judge whether the periodic intensity is higher than or equal to a preconfigured threshold, if the periodic intensity is higher than or equal to the preconfigured threshold, transmit the higher-band signal of a current lost frame to a pitch period repetition module, and if the periodic intensity is lower than the preconfigured threshold, transmit the higher-band signal of the current lost frame to a previous frame data repetition module;
the pitch period repetition module, adapted to perform the frame erasure concealment to the higher-band signal of the current lost frame with a pitch period repetition based method; and
the previous frame data repetition module, adapted to perform the frame erasure concealment to the higher-band signal of the current lost frame with a previous frame data repetition based method.
A speech decoder includes:
a bitstream demultiplex module, adapted to demultiplex an input bitstream into a lower-band bitstream and a higher-band bitstream;
a lower-band decoder and a higher-band decoder, adapted to decode the lower-band bitstream and the higher-band bitstream to a lower-band signal and a higher-band signal respectively;
a frame erasure concealment device for a lower-band signal, adapted to perform a frame erasure concealment to the lower-band signal to obtain a pitch period of the lower-band signal;
a frame erasure concealment method for a higher-band signal, adapted to calculate a periodic intensity of the higher-band signal with respect to pitch period information of the lower-band signal, determine whether the periodic intensity of the higher-band signal is higher than or equal to a preconfigured threshold; if the periodic intensity of the higher-band signal is higher than or equal to the preconfigured threshold, use a pitch period repetition based method to perform the frame erasure concealment to the higher-band signal of a current lost frame, and if the periodic intensity of the higher-band signal is lower than the preconfigured threshold, use a previous frame data repetition based method to perform the frame erasure concealment to the higher-band signal of the current lost frame; and
a synthesis Quadrature-Mirror Filterbank, adapted to synthesize the lower-band signal and the higher-band signal after the frame erasure concealment, into a voice signal to be output.
In the technical solution according to one embodiment of the present invention, the periodic intensity of the higher-band signal with respect to the pitch period of the lower-band signal is calculated; then, it is determined whether the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a preconfigured threshold; when the periodic intensity is higher than or equal to the threshold, the pitch period repetition based method is used to perform the frame erasure concealment to the higher-band signal of the current lost frame. Thus, when the higher-band signal has a strong periodicity, the periodicity of the higher-band signal is not destroyed while the periodicity of the higher-band signal. Hence, the problem that the quality of the voice signal is lowered because the periodicity of the higher-band signal is destroyed, can be avoided. When the periodic intensity of the higher-band signal is lower than the threshold and it is determined that the periodic intensity of the higher-band signal is weak, the previous frame data repetition based method is used to perform the frame erasure concealment to the current lost frame. When the periodic intensity of the higher-band signal is weak, the high frequency noise is introduced. Therefore, the problem that the voice quality of the voice signal is lowered because the high frequency noise is introduced, can be avoided. In this way, the technical solution for performing the frame erasure concealment to the higher-band signal according to one embodiment of the present invention can improve the quality of the voice signal output from the speech decoder.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a structure diagram of the speech decoder according an embodiment of the present invention;
FIG. 2 is a flow char showing the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention;
FIG. 3 is a structure diagram of the frame erasure concealment device for the higher-band signal according one embodiment of the present invention;
FIG. 4 is a structure diagram of the pitch period repetition module according one embodiment of the present invention;
FIG. 5 is a structure diagram of a previous frame data repetition module according to one embodiment of the present invention; and
FIG. 6 is a structure diagram of another previous frame data repetition module according to one embodiment of the present invention.
DETAILED DESCRIPTION OF THE EMBODIMENTS
The present invention will be described in detail with reference to the accompanying drawings and the specific embodiments below.
FIG. 1 is a structure diagram of the speech decoder according one embodiment of the present invention. As shown in FIG. 1, the speech decoder includes a bitstream demultiplex module, a lower-band decoder, a higher-band decoder, a frame erasure concealment device for a lower-band signal, a frame erasure concealment device for a higher-band signal and a synthesis Quadrature-Mirror Filterbank.
The bitstream demultiplex module is adapted to demultiplex the input bitstream into a lower-band bitstream and a higher-band bitstream. The lower-band signal and the higher-band signal are obtained by decoding the lower-band bitstream and the higher-band bitstream with the lower-band decoder and the higher-band decoder respectively. The lower-band signal and the higher-band signal are processed by the frame erasure concealment device for the lower-band signal and the frame erasure concealment device for the higher-band signal respectively, and then are synthesized by the synthesis Quadrature-Mirror Filterbank into a voice signal to be output.
The frame erasure concealment device for the lower-band signal processes the frame erasure concealment of the lower-band signal and provides the pitch period of the lower-band signal to the frame erasure concealment device for the higher-band signal.
The frame erasure concealment device for the higher-band signal performs the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention. The frame erasure concealment method for the higher-band signal according to one embodiment of the present invention includes: calculating a periodic intensity of a higher-band signal with respect to the pitch period information of a lower-band signal; determining whether the periodic intensity of the higher-band signal is higher than or equal to a preconfigured threshold; if the periodic intensity of the higher-band signal is higher than or equal to the preconfigured threshold, using a pitch period repetition based method to perform the frame erasure concealment to the higher-band signal of a current lost frame, and if the periodic intensity of the higher-band signal is lower than the preconfigured threshold, using a previous frame data repetition based method to perform the frame erasure concealment to the higher-band signal of the current lost frame.
FIG. 2 is a flow char showing the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention. FIG. 3 is a structure diagram of the frame erasure concealment device for the higher-band signal according one embodiment of the present invention. With reference to FIG. 2 and FIG. 3, the detailed descriptions of the technical solution for implementing the frame erasure concealment according to one embodiment of the present invention will be given as follows.
As shown in FIG. 2, the method for performing the frame erasure concealment to the higher-band signal includes the following steps.
Step 700: A periodic intensity of a higher-band signal with respect to a lower-band signal is calculated according to a lower-band signal pitch period which is obtained through the frame erasure concealment of the lower-band signal.
In step 700, the frame erasure concealment of the lower-band signal use a frame erasure concealment method which may obtain the pitch period, such as a pitch repetition based method, a model-based regeneration based method and a coder parameter interpolation based method, and the coder parameter includes a pitch period parameter. For example, the model-based regeneration based method may a frame erasure concealment method which implements the regeneration based on the linear predictive model.
In step 700, the frame erasure concealment device for the higher-band signal first uses the signal frame erasure concealment for the lower-band signal to calculate the pitch period of the lower-band signal tlb and then uses the history buffer signal of the higher-band signal shb(n) to calculate the periodic intensity r(tlb) of the higher-band signal with respect to tlb.
Generally, the function according to evaluating the periodic intensity of signal includes the autocorrelation function and the normalized correlation function.
The pitch period of the lower-band signal may be obtained by calculating the autocorrelation function for the lower-band signal. The formula of the correlation function is as follows:
r ( i ) = j = - N - 1 s lb ( j ) s lb ( j - i ) , i = min_pitch , ... , max_pitch
In the formula, r(i) represents the correlation function with respect to i; slb(j) represents the lower-band signals; N represents the length of the window for calculating the correlation function, such as the number of the samples for the voice signal of a frame; min_pitch is the lower limit for searching the pitch period and max_pitch is the upper limit for searching the pitch period. Thus, the pitch period of the lower-band signal is as follows:
t lb = arg max i = min _ pitch , , max _ pitch r ( i ) ;
in other words, tlb is equal to the value of i when r(i) has the maximum value.
The formula for calculating the periodic intensity of signal with the autocorrelation function is as follows.
r ( t lb ) = n = 0 N s hb ( n ) s hb ( n - t lb )
In the formula, shb(n) n=−M, . . . ,−1 represents the history buffer signal of the higher-band signal and M represents the number of the samples in the history buffer signal of the higher-band signal. N is a constant positive integer such as the number of the samples for the higher-band signal in a frame.
The formula for calculating the periodic intensity of signal with the normalized correlation function is as follows.
r nor ( t lb ) = n = 0 N - 1 s hb ( n ) s hb ( n - t lb ) n = 0 N - 1 s hb 2 ( n ) n = 0 79 s hb 2 ( n - t lb )
In the formula, N is a constant positive integer such as the number of the samples for the higher-band signal in a frame.
Referring to FIG. 3, the frame erasure concealment device for the higher-band signal as shown in FIG. 3 includes a periodic intensity calculating module, a pitch period repetition module and a previous frame data repetition module. In step 700, the periodic intensity calculating module calculates the lower-band signal pitch period with the signal frame erasure concealment for the lower-band signal and calculates the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal.
In step 700, in addition to the pitch period of the lower-band signal tlb, the pitch period information of the lower-band signal may include a value around the pitch period of the lower-band signal tlb. The frame erasure concealment device for the higher-band signal may first calculate the pitch period of the lower-band signal tlb with the signal frame erasure concealment for the lower-band signal. In order to reduce the complexity for searching the pitch period of the higher-band signal and improve the accuracy for the pitch period of the higher-band signal, an interval in the pitch period of the lower-band signal tlb, such as [max(tlb−m, pit_min), min(tlb+m, pit_max)], may be used to calculate the normalized correlation function for the higher-band signal. The history buffer signal of the higher-band signal shb(n) is used to calculate the periodic intensity of the higher-band signal r(tlb) with respect to [max(tlb−m,pit_min), min(tlb+m,pit_max)],
r nor ( i ) = n = 0 N - 1 s hb ( n ) s hb ( n - i ) n = 0 N - 1 s hb 2 ( n ) n = 0 N - 1 s hb 2 ( n - i ) ,
max(t lb −m,pit_min)≦i≦min(t lb +m,pit_max)
In the formula, m is the radius of the searching interval, such as 3 or any other value less than or equal to 3. According to experiment results, the larger the m is, the higher the accuracy is and the higher the algorithm complexity is. In this embodiment, m is equal to 3. pit_min is the minimum pitch period. In this embodiment, pit_min=16. pit_max is the maximum pitch period. In this embodiment, pit_max=144. In other embodiments, it is also allowed that pit_min=20 and pit_max=143 or pit_min=16 and pit_max=160. The pitch period for higher-band signal thb is as follows:
t hb = arg max i = max ( t lb - m , pit _ min ) , ... , min ( t lb + m , pit _ max ) r nor ( i ) .
Correspondingly, the normalized correlation function is as follows:
r nor _ max = max i = max ( t lb - m , pit _ min ) , ... , min ( t lb + m , pit _ max ) r nor ( i ) .
Thus, the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is obtained.
In step 701, it is determined whether the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a preconfigured threshold. If the periodic intensity of the higher-band signal with respect to the pitch period of the lower-band signal is higher than or equal to a preconfigured threshold, step 702 is performed, otherwise, step 703 is performed.
In step 701, in the method for calculating the periodic intensity with the correlation function, a threshold R may be selected through a large number of test. For example, in a simulation, the speech decoder for implementing the frame erasure concealment method for the higher-band signal according to one embodiment of the present invention may be used to obtain voice signals output with different thresholds, then the signal to noise ratio (SNR) of the voice signals are calculated, and then a threshold corresponding to a voice signal with the maximum SNR is selected as the threshold selected in step 701. Optionally, the threshold selected in step 701 may be determined according an empirical value. If r(tlb)≧R, it is determined that the history buffer signal of the higher-band signal shb(n) has a strong periodic intensity with respect to tlb, otherwise, it is determined that the history buffer signal of the higher-band signal shb(n) does not have a strong periodic intensity with respect to tlb.
In the method for calculating the periodic intensity with the normalized correlation function, the threshold may be a nonnegative number ranging from 0 to 1. The Rnor, such as 0.7, may be selected through a large number of test. The processes are the same as those in the method for calculating the periodic intensity with the correlation function. Optionally, an empirical value may be selected. If rnor(tlb)≧Rnor or rnor max≧Rnor, it is determined that the history buffer signal of the higher-band signal shb(n) has a strong periodic intensity with respect to the pitch period information of the lower-band signal, otherwise, it is determined that the history buffer signal of the higher-band signal shb(n) does not have a strong periodic intensity with respect to the pitch period information of the lower-band signal.
In the frame erasure concealment device for the higher-band signal as shown in FIG. 3, the periodic intensity calculating module calculates the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal, then judges whether the calculated periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a threshold preconfigured in the periodic intensity calculating module. If the calculated periodic intensity is higher than or equal to the threshold, the pitch period repetition module performs subsequent processes; otherwise, the previous frame data repetition module performs subsequent processes.
In step 702, the pitch period repetition method is used to perform the frame erasure concealment of the higher-band signal in the lost frame.
In step 702, the pitch period repetition method includes a pitch repetition method, a model-based regeneration based method or a pitch repetition and attenuation based method.
In step 702, for example, when the pitch repetition is used to perform the frame erasure concealment to the higher-band signal. The following formula is used to regenerate the higher-band signal of the lost frame:
s hb(n)=s hb(n−t lb),n=0, . . . ,N−1.
In the formula, shb(n), n=0, . . . , N−1 represents the recovered higher-band signal of the lost frame, and N represents the number of the samples contained in a frame. shb(n), n=−M, . . . ,−1 represents the history buffer signal of the higher-band signal and M represents the number of the samples in the history buffer signal of the higher-band signal.
When the frame erasure concealment is performed to the higher-band signal by simply repeating the periodicity, in the case of a large number of continuously lost frames, a signal with an excessive periodicity may be caused. In order to enhance the effect, the recovered signals are multiplied by an attenuation coefficient α. The pitch period repetition method includes the pitch repetition and attenuation based method, the frame erasure concealment is performed to the higher-band signal of the current lost frame. The obtained higher-band signal is as follows:
s hb(n)=s hb(n−t lb)·α,n=0, . . . ,N−1.
In the formula, N represents the number of the samples of a frame; the attenuation coefficient α is a nonnegative number ranging from 0 to 1. The attenuation coefficient α may be a constant such as 0.8, or a variable which changes adaptively according to the number of continuously lost packets. For example, for the first lost frame, a larger attenuation coefficient such as 0.9 is multiplied; for the second lost frame and the following frames, a smaller attenuation coefficient such as 0.7 is multiplied. The method for determining the threshold may also be used to determine the attenuation coefficient and repeated descriptions thereof are omitted.
the pitch repetition and attenuation based method, the frame erasure concealment is performed to the higher-band signal of the current lost frame. Furthermore, in the case that the frame erasure concealment is based on the Modified Discrete Cosine Transform (MDCT), the signal of two frames s′hb(n) are first duplicated through the pitch period repetition:
s′ hb(n)=s hb(n−t lb),n=0, . . . ,2N−1.
The signal s′hb(n) is added with the sinusoid window stdac(n) and is attenuated, and an estimated value dcur(n) of the Invert Modified Discrete Cosine Transform (IMDCT) coefficient for current frame is obtained as follows:
d cur(n)=w tdac(n)s hb(n)β,n=0, . . . ,2N−1.
β is an attenuation factor, such as √{square root over (2/2)}. dcur(n) is overlap-added with the IMDCT coefficient dpre(n) of the previous frame and is attenuated, thus the output signal of the current frame is obtained as follows:
s hb(n)=(w tdac(n+N)d pre(n+N)+w tdac(n)d cur(n))α,n=0, . . . ,N−1.
the latter frame of the IMDCT coefficient dpre(n) of the previous frame is called as the latter part of the IMDCT coefficient of the previous frame. The attenuation coefficient α may be a nonnegative number ranging from 0 to 1. The attenuation coefficient α may be a constant such as 0.8 or a variable which changes adaptively according to the number of continuously lost packets, such as α=1−0.005×(n+1). The attenuation is increased point by point and thus the output signal becomes smoother.
FIG. 4 shows a pitch period repetition module according one embodiment of the present invention, including: a repetition module, adapted to duplicate a signal of a frame according to a pitch period; an attenuation module, adapted to add a sinusoid window to a duplicated signal of the frame and attenuate the signal to obtain an estimated value of the IMDCT coefficient for the frame; and an overlap-add (OLA) module, adapted to overlap-add the estimated value of current frame with the latter frame of IMDCT coefficient of a previous frame and attenuate.
In step 702, when the frame erasure concealment is performed to the higher-band signal with the regeneration based method based on the linear predictive model, the following formula is used to implement the pitch period repetition for the higher-band residual signal ehb(n):
e hb(n)=e hb(n−t lb),n=0, . . . ,N−1.
In the formula ehb(n), n=0, . . . ,N−1 represents the higher-band residual signal of the current lost frame; and ehb(n), n=−M, . . . ,−1 represents the residual of the history buffer signal of the higher-band signal with respect to the linear predictive analysis.
Then, the higher-band signal of the lost frame is obtained with the residual of the higher-band signal via the linear predictive synthesizer. The formula is as follows:
s hb ( n ) = e ( n ) - i = 1 8 a i s hb ( n - i ) , n = 0 , ... , N - 1
Optionally, in order to enhance the subjective effect, the recovered signals are multiplied by an attenuation coefficient α, and the higher-band signal which is obtained by performing the frame erasure concealment with the regeneration method based on the linear predictive model is as follows:
s hb ( n ) = ( e ( n ) - i = 1 8 a i s hb ( n - i ) ) · α , n = 0 , ... , N - 1.
In the formula, shb(n), n=0, . . . ,N−1 represents the recovered higher-band signal of the current lost frame, and N represents the number of the samples in a frame. shb(n), n=−M, . . . ,−1 represents the history buffer signal of the higher-band signal and M represents the number of the samples in a higher-band signal. The attenuation coefficient α may be a nonnegative number ranging from 0 to 1. The attenuation coefficient α may be a constant such as 0.8, or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
In step 702, the pitch period repetition module shown in FIG. 3 performs the frame erasure concealment to the higher-band signal of the lost frame with the pitch period repetition based method. The pitch period repetition module may perform the frame erasure concealment to the higher-band signal with the pitch repetition based method, or perform the frame erasure concealment to the higher-band signal with the regeneration based method based on a model such as the linear predictive model method.
In step 703, the previous frame data repetition based method is used to perform the frame erasure concealment to the higher-band signal of the lost frame.
In step 703, the previous frame data repetition based method includes the previous frame repetition based method, the previous frame repetition and attenuation based method, and the coder parameter interpolation based method.
In step 703, the previous frame data repetition module shown in FIG. 3 performs the frame erasure concealment to the higher-band signal of the lost frame with the previous data repetition based method. In particular, the previous frame repetition based method, the previous frame repetition and attenuation based method or the coder parameter interpolation based method may be used.
For example, when the previous frame repetition and attenuation method is used, the time domain data of the previous frame of the current lost frame is duplicated into the current lost frame and an attenuation coefficient α is multiplied. In other word, the following formula may be used to recover the lost frame:
s hb(n)=s hb(n−N)·α,n=0, . . . ,N−1.
In the formula, N represents the number of the samples contained in a frame. The attenuation coefficient α may be a nonnegative number ranging from 0 to 1. The attenuation coefficient α may be a constant such as 0.8 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
FIG. 5 shows a previous frame data repetition module according one embodiment of the present invention. As shown in FIG. 5, the previous frame data repetition module includes a repetition module for a higher-band signal of a previous frame, adapted to duplicate the higher-band signal of the previous frame into the current lost frame and input the duplicated frame into an attenuation module; the attenuation module, adapted to multiply the duplicated frame by the attenuation coefficient α to obtain the higher-band signal after the frame erasure concealment.
If the algorithm of the higher-band signal decoder is a frequent domain algorithm, the previous frame repetition and attenuation based method is used to repeat and attenuate some intermediate data during recovering the time domain data from the frequent domain data of the previous frame, including: using an intermediate data which is obtained during recovering a time domain data from a frequent domain data of the previous frame of the current lost frame, as the intermediate data of the current lost frame and attenuating the intermediate data, and synthesizing the attenuated time domain data of the current lost frame with the intermediate data of the current lost frame; or, using the intermediate data which is obtained during recovering the time domain data from the frequent domain data of the previous frame and is attenuated, as the intermediate data of the current lost frame, and then the time domain data of the lost frame is synthesized with the intermediate data.
For example, when the higher-band decoder is a higher-band decoder which is based on the MDCT, the IMDCT coefficient of the previous frame may be repeated and attenuated to estimate the IMDCT coefficient of the current lost frame. According to the synthesis formula, the IMDCT coefficient of the previous frame and the IMDCT coefficient of the current lost frame are overlap-added to obtain the time domain data of the current lost frame.
The IMDCT coefficient of the current lost frame may be estimated with the following formula:
d cur(n)=d pre(n)·α,n=0, . . . ,2N−1.
In the formula, dcur(n) is the IMDCT coefficient of the current lost frame, dpre(n) is the IMDCT coefficient of the previous frame, N represents the number of the samples contained in a frame. The attenuation coefficient α is a nonnegative number ranging from 0 to 1. The attenuation coefficient α may be a constant such as 0.8 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
The time domain data of the current lost frame is obtained by performing the OLA to the IMDCT coefficient with the following formula:
s hb(n)=w tdac(n+N)d pre(n+N)+w tdac(n)d cur(n),n=0, . . . ,N−1
In the formula, shb(n) is the time domain data of the current lost frame, wtdac(n) is the window function to be added during the OLA synthesis, such as the hamming window and the sinusoid window. The method for determining the window function is the same as the method for determining the window function during calculating the shb(n) in the prior art.
FIG. 6 is a structure diagram of another previous frame data repetition module according to one embodiment of the present invention. As shown in FIG. 6, the previous frame data repetition module includes a previous frame IMDCT coefficient storage module, an attenuation module and an OLA module. The previous frame IMDCT coefficient storage module is adapted to store IMDCT coefficient during recovering the time domain data from the frequent domain data. The attenuation module is adapted to attenuate the IMDCT coefficient with α to obtain the IMDCT coefficient of the current lost frame. The IMDCT coefficient of the previous frame and the IMDCT coefficient of the current lost frame obtained after the attenuation are input into the OLA module for overlap-adding. Then, the higher-band signal of the current lost frame after the frame erasure concealment is obtained.
If the MDCT coefficient instead of the IMDCT coefficient is repeated and attenuated, the IMDCT is performed to the MDCT coefficient to obtain the IMDCT coefficient, and the IMDCT coefficient is attenuated. The time domain data of the current lost frame is obtained through the OLA process. However, the calculation amount of the IMDCT process is further added. Those skilled in the art can appreciate that, if the IMDCT coefficient of the previous frame is repeated and attenuated directly and the time domain data of the current lost frame is synthesized with the OLA process, the calculation amount can be reduced.
Moreover, for example, when the higher-band decoder is a higher-band decoder based on fast fourier transform (FFT), the invert fast fourier transform (IFFT) coefficient of the previous frame may be repeated and attenuated to estimate the IFFT coefficient of the current lost frame. Then, the OLA is performed to obtain the time domain data of the current lost frame.
The IFFT coefficient of the current lost frame may be estimated with the following formula:
d cur(n)=d pre(n)·α,n=0, . . . ,M−1
In the formula, dcur(n) is the IFFT coefficient of the current lost frame, dpre(n) is the IFFT coefficient of the previous frame, M represents the number of the IFFT coefficients required by a frame. Generally, M is larger than N which represents the number of the samples in a frame. The attenuation coefficient α is a nonnegative number ranging from 0 to 1. The attenuation coefficient α may be a constant such as 0.875 or a variable which changes adaptively according to the number of continuously lost packets. For example, the first lost frame is multiplied by a larger attenuation coefficient such as 0.9, while the second lost frame and the following frames are multiplied by a smaller attenuation coefficient such as 0.7.
The (M−N) samples before the current lost frame are recovered with the following OLA formula:
s hb(n)=w(n+N)d pre(n+N)+w(n)d cur(n),n=0, . . . ,M−N−1.
In the formula, shb(n) is the time domain data of the current lost frame, w(n) is the window function to be added during the OLA synthesis, such as the hamming window and the sinusoid window.
The (2N−M) samples after the current lost frame are recovered with the following formula:
s hb(n)=d cur(n),n=M−N, . . . ,N−1
In the formula, M is the number of the IFFT coefficients required by a frame and N is the number of the samples of a frame.
Except for the two layer codec, the speech decoder may further include a multi-layer decoder including a core layer and an enhance layer. The core codec is a traditional narrowband or wideband codec. Some enhance layers are extended based on the core layer of the core codec. Thus, the core layer may intercommunicate with corresponding traditional voice codec directly. The enhance layer includes a lower-band enhance layer adapted to improve the voice quality of the lower-band voice signal and a higher-band enhance layer adapted to expand the voice bandwidth. For example, the narrowband signal is expanded to the wideband signal, or the wideband signal is expanded to the ultra-wideband signal, or the ultra wideband signal is expanded to the fullband signal. However, the speech decoder including at least two layers synthesizes the signals of different layers which have been decoded into the lower-band signal and the higher-band signal and performs the frame erasure concealment processing respectively, thus the voice signal to be output from the speech decoder is obtained. Therefore, the technical solution for performing the frame erasure concealment to the higher-band signal according to one embodiment of the present invention is also applicable to the multilayer decoder including the core layer and the enhance layer.
As can be seen from the above descriptions, according to the technical solution provided according to one embodiment of the present invention, the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is calculated; then, it is determined whether the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is higher than or equal to a preconfigured threshold; if the periodic intensity is higher than or equal to the preconfigured threshold, the pitch period repetition based method is used to perform the frame erasure concealment to the higher-band signal of the current lost frame. Thus, when the higher-band signal has a strong periodicity, the periodicity of the higher-band signal is not destroyed while the periodicity of the higher-band signal is destroyed. Hence, the problem that the quality of the voice signal is lowered because the periodicity of the higher-band signal is destroyed, can be avoided.
Moreover, according to one embodiment of the present invention, the pitch period of the lower-band signal is obtained when the frame erasure concealment is performed to the lower-band signal and the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal is calculated. Thus, the hardware overhead of configuring the periodicity intensity calculation module can be decreased.
When the periodic intensity of the higher-band signal is lower than the threshold and it is determined that the periodic intensity of the higher-band signal is weak, the previous frame data repetition based method is used to perform the frame erasure concealment to the current lost frame. When the periodic intensity of the higher-band signal is weak, the high frequency noise is introduced. Therefore, the problem that the voice quality of the voice signal is lowered because the high frequency noise is introduced, can be avoided. In this way, the technical solution for performing the frame erasure concealment to the higher-band signal according to one embodiment of the present invention can improve the quality of the voice signal output from the speech decoder.
Moreover, when the algorithm of the higher-band signal decoder is a frequent domain algorithm, the intermediate data during recovering the time domain data from the frequent domain data of the previous frame may be used to perform the frame erasure concealment to the higher-band signal of the current lost frame. When the higher-band signal is encoded based on the MDCT, the IMDCT coefficient obtained from the decoder may be repeated and attenuated, then the OLA process is performed to recover the time domain data of the current lost frame. Thus, the calculation amount can be reduced.
The skilled person in the art will readily appreciate that the present invention may be implemented using either hardware, or software, or both. Embodiments within the scope of the present invention also include computer-readable media for carrying or having computer-executable instructions, computer-readable instructions, or data structures stored thereon. Such computer-readable media can include physical storage media such as RAM, ROM, other optical disk storage, or magnetic disk storage. The program of instructions stored in the computer-readable media is executed by a machine to perform a method. The method may include the steps of any one of the method embodiments of the present invention.
The above embodiments are provided for illustration only and the order of the embodiments can not be considered as a criterion for evaluating the embodiments. In addition, the expression “step” in the embodiments does not intend to limit the sequence of the steps for implementing the present invention to the sequence as described herein.
Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. Accordingly, various modifications and variations may be made without departing from the scope of the invention as defined by the appended claims and their equivalents.

Claims (21)

1. A method for performing a frame erasure concealment to a higher-band signal, comprising:
calculating, by a device for performing a frame erasure concealment to a higher-band signal, a periodic intensity of the higher-band signal with respect to pitch period information of a lower-band signal;
judging, by the device for performing the frame erasure concealment to the higher-band signal whether the periodic intensity is higher than or equal to a preconfigured threshold, if the periodic intensity is higher than or equal to the preconfigured threshold, performing the frame erasure concealment to the higher-band signal of a current lost frame with a pitch period repetition based method, and if the periodic intensity is lower than the preconfigured threshold, performing the frame erasure concealment to the higher-band signal of the current lost frame with a previous frame data repetition based method;
wherein the higher-band signal is a voice signal.
2. The method according to claim 1, wherein, the pitch period information of the lower-band signal comprises a pitch period of the lower-band signal and an interval in the pitch period of the lower-band signal, a first border of the interval being a larger one of a value which is obtained by subtracting m from the pitch period of the lower-band signal and a minimum pitch period, a second border of the interval being a smaller one of a value which is obtained by adding m to the pitch period of the lower-band signal and a maximum pitch period, and m being smaller than or equal to 3.
3. The method according to claim 1, further comprising:
obtaining, by the device for performing the frame erasure concealment to the higher-band signal, the pitch period of the lower-band signal through a frame erasure concealment process of the lower-band signal.
4. The method according to claim 1, wherein, calculating the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal comprises: calculating the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal via an autocorrelation function and a normalized correlation function with a history buffer signal of the higher-band signal of a current lost frame.
5. The method according to claim 4, wherein, the pitch period repetition based method comprises: a pitch repetition based method, a pitch repetition and attenuation based method and a model-based regeneration method.
6. The method according to claim 1, wherein, the pitch period repetition based method comprises: a pitch repetition based method, a pitch repetition and attenuation based method and a model-based regeneration method.
7. The method according to claim 6, wherein, performing the frame erasure concealment to the higher-band signal of the current lost frame with the pitch repetition and attenuation based method comprises: duplicating a history buffer signal of the higher-band signal based on the pitch period, adding a sinusoid window to a duplicated signal and attenuating a windowed signal to obtain an estimated value of an Invert Modified Discrete Cosine Transform (IMDCT) coefficient of the current frame; overlap-adding and attenuating the estimated value with a latter part of IMDCT coefficient of a previous frame.
8. The method according to claim 7, wherein, an attenuation coefficient for overlap-adding and attenuating the estimated value with the latter part of IMDCT coefficient of the previous frame is a variable which changes adaptively according to a number of continuously lost packets.
9. The method according to claim 1, wherein, the previous frame data repetition based method comprises a previous frame repetition based method, a previous frame repetition and attenuation based method and a coder parameter interpolation based method.
10. The method according to claim 9, wherein, performing the frame erasure concealment to the higher-band signal of the current lost frame with the previous frame data repetition and attenuation based method comprises: using a time domain data of a previous frame of the current lost frame, as the time domain data of the current frame and attenuating the time domain data.
11. The method according to claim 10, wherein, performing the frame erasure concealment to the higher-band signal of the current lost frame with the previous frame repetition method comprises:
using an intermediate data which is obtained during recovering a time domain data from a frequent domain data of the previous frame of the current lost frame, as the intermediate data of the current lost frame and attenuating the intermediate data, and synthesizing the attenuated time domain data of the current lost frame with the intermediate data of the current lost frame; or, using the intermediate data which is obtained during recovering the time domain data from the frequent domain data of the previous frame and is attenuated, as the intermediate data of the current lost frame; and synthesizing the time domain data of the current lost frame with the intermediate data of the current lost frame.
12. The method according to claim 9, wherein, performing the frame erasure concealment to the higher-band signal of the current lost frame with the previous frame repetition method comprises:
using an intermediate data which is obtained during recovering a time domain data from a frequent domain data of the previous frame of the current lost frame, as the intermediate data of the current lost frame and attenuating the intermediate data, and synthesizing the attenuated time domain data of the current lost frame with the intermediate data of the current lost frame; or, using the intermediate data which is obtained during recovering the time domain data from the frequent domain data of the previous frame and is attenuated, as the intermediate data of the current lost frame; and synthesizing the time domain data of the current lost frame with the intermediate data of the current lost frame.
13. The method according to claim 12, wherein, when the intermediate data is the IMDCT coefficient, the method further comprises: synthesizing the time domain data of the current lost frame with the intermediate data of the current lost frame comprises:
overlap-adding the IMDCT coefficient of the current lost frame and the IMDCT coefficient of the previous frame to obtain the time domain data of the current lost frame.
14. The method according to claim 1, further comprising:
obtaining, by the device for performing the frame erasure concealment to the higher-band signal, the pitch period of the lower-band signal through a frame erasure concealment process of the lower-band signal.
15. A tangible, non-transient computer readable medium comprising:
computer executable instructions, which, when executed by a computer unit, causes the computer unit to perform the steps according to claim 1.
16. A device for performing a frame erasure concealment to a higher-band signal, wherein the higher-band signal is a voice signal and the device comprises:
a periodic intensity calculation module, configured to calculate a periodic intensity of the higher-band signal with respect to pitch period information of a lower-band signal, judge whether the periodic intensity is higher than or equal to a preconfigured threshold, if the periodic intensity is higher than or equal to the preconfigured threshold, transmit the higher-band signal of a current lost frame to a pitch period repetition module, if the periodic intensity is lower than the preconfigured threshold, transmit the higher-band signal of the current lost frame to a previous frame data repetition module;
the pitch period repetition module, configured to perform the frame erasure concealment to the higher-band signal of the current lost frame with a pitch period repetition based method; and
the previous frame data repetition module, configured to perform the frame erasure concealment to the higher-band signal of the current lost frame with a previous frame data repetition based method.
17. The device according to claim 16, wherein, the previous frame data repetition module further comprises:
a repetition module for the higher-band signal of a previous frame, configured to duplicate the higher-band signal of the previous frame into the current lost frame; and
an attenuation module, configured to multiply the higher-band signal of the previous frame which is duplicated by the repetition module for the higher-band signal of the previous frame, by an attenuation coefficient to obtain the higher-band signal after the frame erasure concealment.
18. The device according to claim 16, wherein, the previous frame data repetition module comprises:
a previous frame Invert Modified Discrete Cosine Transform (IMDCT) coefficient storage module, configured to store an IMDCT coefficient during recovering a time domain data from a frequent domain data of the previous frame;
an attenuation module, adapted to attenuate the IMDCT coefficient in the previous frame IMDCT coefficient storage module to obtain the IMDCT coefficient of the current lost frame; and
an OverLap-Add (OLA) module, configured to overlap-add the IMDCT coefficient of the previous frame in the previous frame IMDCT coefficient storage module and the IMDCT coefficient of the current lost frame obtained by the attenuation module, to obtain the time domain data of the current lost frame.
19. The device according to claim 16, wherein, the pitch period repetition module comprises:
a repetition module, configured to duplicate a signal of a current frame according to a pitch period;
an attenuation module, configured to add a sinusoid window to a duplicated signal and attenuate a windowed signal to obtain an estimated value of an Invert Modified Discrete Cosine Transform coefficient of the current frame; and
an OverLap-Add (OLA) module, configured to overlap-add the estimated value with the latter part of the IMDCT coefficient of the previous frame and attenuate.
20. A speech decoder, comprising:
a bitstream demultiplex module, configured to demultiplex an input bitstream into a lower-band bitstream and a higher-band bitstream;
a lower-band decoder and a higher-band decoder, configured to decode the lower-band bitstream and the higher-band bitstream to a lower-band signal and a higher-band signal respectively; wherein the lower-band signal and the higher-band signal are voice signals;
a frame erasure concealment device for a lower-band signal, configured to perform a frame erasure concealment to the lower-band signal to obtain a pitch period of the lower-band signal;
a frame erasure concealment device for a higher-band signal, configured to calculate a periodic intensity of the higher-band signal with respect to pitch period information of the lower-band signal, determine whether the periodic intensity of the higher-band signal is higher than or equal to a preconfigured threshold, if the periodic intensity of the higher-band signal is higher than or equal to the preconfigured threshold, use a pitch period repetition based method to perform the frame erasure concealment to the higher-band signal of a current lost frame, and if the periodic intensity of the higher-band signal is lower than the preconfigured threshold, use a previous frame data repetition based method to perform the frame erasure concealment to the higher-band signal of the current lost frame; and
a synthesis Quadrature-Mirror Filterbank, configured to synthesize the lower-band signal and the higher-band signal after the frame erasure concealment, into another voice signal to be output.
21. The speech decoder according to claim 20, wherein, the frame erasure concealment device for the higher-band signal comprises:
a periodic intensity calculating module, configured to calculate the periodic intensity of the higher-band signal with respect to the pitch period information of the lower-band signal of the current lost frame, judge whether the periodic intensity is higher than or equal to the preconfigured threshold, if the periodic intensity is higher than or equal to the preconfigured threshold, transmit the higher-band signal of the current lost frame to a pitch period repetition module, if the periodic intensity is lower than the preconfigured threshold, transmit the higher-band signal of the current lost frame to a previous frame data repetition module;
the pitch period repetition module, configured to perform the frame erasure concealment to the higher-band signal of the current lost frame with the pitch period repetition based method; and
the previous frame data repetition module, configured to perform the frame erasure concealment to the higher-band signal of the current lost frame with the previous frame data repetition based method.
US12/129,118 2007-09-15 2008-05-29 Method and device for performing frame erasure concealment to higher-band signal Active 2031-02-23 US8200481B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/273,391 US7552048B2 (en) 2007-09-15 2008-11-18 Method and device for performing frame erasure concealment on higher-band signal

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN200710153955 2007-09-15
CN200710153955 2007-09-15
CN200710153955.0 2007-09-15
CN200710194570 2007-11-24
CNB2007101945709A CN100524462C (en) 2007-09-15 2007-11-24 Method and apparatus for concealing frame error of high belt signal
CN200710194570.9 2007-11-24

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/273,391 Continuation US7552048B2 (en) 2007-09-15 2008-11-18 Method and device for performing frame erasure concealment on higher-band signal

Publications (2)

Publication Number Publication Date
US20090076805A1 US20090076805A1 (en) 2009-03-19
US8200481B2 true US8200481B2 (en) 2012-06-12

Family

ID=39898258

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/129,118 Active 2031-02-23 US8200481B2 (en) 2007-09-15 2008-05-29 Method and device for performing frame erasure concealment to higher-band signal
US12/134,410 Abandoned US20090076807A1 (en) 2007-09-15 2008-06-06 Method and device for performing frame erasure concealment to higher-band signal
US12/273,391 Active US7552048B2 (en) 2007-09-15 2008-11-18 Method and device for performing frame erasure concealment on higher-band signal

Family Applications After (2)

Application Number Title Priority Date Filing Date
US12/134,410 Abandoned US20090076807A1 (en) 2007-09-15 2008-06-06 Method and device for performing frame erasure concealment to higher-band signal
US12/273,391 Active US7552048B2 (en) 2007-09-15 2008-11-18 Method and device for performing frame erasure concealment on higher-band signal

Country Status (9)

Country Link
US (3) US8200481B2 (en)
EP (2) EP2068306B1 (en)
JP (2) JP4603091B2 (en)
KR (1) KR100998430B1 (en)
CN (2) CN100524462C (en)
AT (2) ATE485581T1 (en)
DE (2) DE602008003085D1 (en)
ES (1) ES2328649T3 (en)
WO (1) WO2009033375A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110082575A1 (en) * 2008-06-10 2011-04-07 Dolby Laboratories Licensing Corporation Concealing Audio Artifacts
US20130297322A1 (en) * 2006-11-24 2013-11-07 Samsung Electronics Co., Ltd Error concealment method and apparatus for audio signal and decoding method and apparatus for audio signal using the same
RU2665887C1 (en) * 2015-03-13 2018-09-04 Долби Интернэшнл Аб Decoding of audio bitstreams with metadata of extended copying of the spectral band in at least one filler

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8239190B2 (en) * 2006-08-22 2012-08-07 Qualcomm Incorporated Time-warping frames of wideband vocoder
CN101325631B (en) * 2007-06-14 2010-10-20 华为技术有限公司 Method and apparatus for estimating tone cycle
CN100524462C (en) * 2007-09-15 2009-08-05 华为技术有限公司 Method and apparatus for concealing frame error of high belt signal
KR100922897B1 (en) * 2007-12-11 2009-10-20 한국전자통신연구원 An apparatus of post-filter for speech enhancement in MDCT domain and method thereof
KR100998396B1 (en) * 2008-03-20 2010-12-03 광주과학기술원 Method And Apparatus for Concealing Packet Loss, And Apparatus for Transmitting and Receiving Speech Signal
US8706479B2 (en) * 2008-11-14 2014-04-22 Broadcom Corporation Packet loss concealment for sub-band codecs
US8280725B2 (en) * 2009-05-28 2012-10-02 Cambridge Silicon Radio Limited Pitch or periodicity estimation
CN101615910B (en) 2009-05-31 2010-12-22 华为技术有限公司 Method, device and equipment of compression coding and compression coding method
CN101958119B (en) * 2009-07-16 2012-02-29 中兴通讯股份有限公司 Audio-frequency drop-frame compensator and compensation method for modified discrete cosine transform domain
US8326607B2 (en) * 2010-01-11 2012-12-04 Sony Ericsson Mobile Communications Ab Method and arrangement for enhancing speech quality
CN101937679B (en) * 2010-07-05 2012-01-11 展讯通信(上海)有限公司 Error concealment method for audio data frame, and audio decoding device
JP2012032713A (en) * 2010-08-02 2012-02-16 Sony Corp Decoding apparatus, decoding method and program
EP2458585B1 (en) * 2010-11-29 2013-07-17 Nxp B.V. Error concealment for sub-band coded audio signals
RU2586597C2 (en) 2011-02-14 2016-06-10 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Encoding and decoding positions of pulses of audio signal tracks
RU2560788C2 (en) 2011-02-14 2015-08-20 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Device and method for processing of decoded audio signal in spectral band
JP5712288B2 (en) 2011-02-14 2015-05-07 フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン Information signal notation using duplicate conversion
CN103477387B (en) 2011-02-14 2015-11-25 弗兰霍菲尔运输应用研究公司 Use the encoding scheme based on linear prediction of spectrum domain noise shaping
CN103620672B (en) * 2011-02-14 2016-04-27 弗劳恩霍夫应用研究促进协会 For the apparatus and method of the error concealing in low delay associating voice and audio coding (USAC)
KR101525185B1 (en) 2011-02-14 2015-06-02 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. Apparatus and method for coding a portion of an audio signal using a transient detection and a quality result
EP2772910B1 (en) * 2011-10-24 2019-06-19 ZTE Corporation Frame loss compensation method and apparatus for voice frame signal
KR101398189B1 (en) * 2012-03-27 2014-05-22 광주과학기술원 Speech receiving apparatus, and speech receiving method
CN103426441B (en) 2012-05-18 2016-03-02 华为技术有限公司 Detect the method and apparatus of the correctness of pitch period
KR102063902B1 (en) * 2012-06-08 2020-01-08 삼성전자주식회사 Method and apparatus for concealing frame error and method and apparatus for audio decoding
US9129600B2 (en) * 2012-09-26 2015-09-08 Google Technology Holdings LLC Method and apparatus for encoding an audio signal
CN103714821A (en) 2012-09-28 2014-04-09 杜比实验室特许公司 Mixed domain data packet loss concealment based on position
EP2887349B1 (en) * 2012-10-01 2017-11-15 Nippon Telegraph and Telephone Corporation Coding method, coding device, program, and recording medium
CN103854649B (en) * 2012-11-29 2018-08-28 中兴通讯股份有限公司 A kind of frame losing compensation method of transform domain and device
ES2706512T3 (en) * 2013-02-13 2019-03-29 Ericsson Telefon Ab L M Hiding frame errors
CN104240715B (en) * 2013-06-21 2017-08-25 华为技术有限公司 Method and apparatus for recovering loss data
ES2635555T3 (en) 2013-06-21 2017-10-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for improved signal fading in different domains during error concealment
CN104282309A (en) 2013-07-05 2015-01-14 杜比实验室特许公司 Packet loss shielding device and method and audio processing system
CN108364657B (en) 2013-07-16 2020-10-30 超清编解码有限公司 Method and decoder for processing lost frame
CN103489448A (en) * 2013-09-03 2014-01-01 广州日滨科技发展有限公司 Processing method and system of voice data
JP5981408B2 (en) * 2013-10-29 2016-08-31 株式会社Nttドコモ Audio signal processing apparatus, audio signal processing method, and audio signal processing program
MY175460A (en) 2013-10-31 2020-06-29 Fraunhofer Ges Forschung Audio decoder and method for providing a decoded audio information using an error concealment modifying a time domain excitation signal
SG10201609234QA (en) 2013-10-31 2016-12-29 Fraunhofer Ges Forschung Audio decoder and method for providing a decoded audio information using an error concealment based on a time domain excitation signal
CN104751849B (en) 2013-12-31 2017-04-19 华为技术有限公司 Decoding method and device of audio streams
EP2922054A1 (en) * 2014-03-19 2015-09-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and corresponding computer program for generating an error concealment signal using an adaptive noise estimation
EP2922056A1 (en) * 2014-03-19 2015-09-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method and corresponding computer program for generating an error concealment signal using power compensation
CN107369455B (en) * 2014-03-21 2020-12-15 华为技术有限公司 Method and device for decoding voice frequency code stream
FR3020732A1 (en) * 2014-04-30 2015-11-06 Orange PERFECTED FRAME LOSS CORRECTION WITH VOICE INFORMATION
PL3367380T3 (en) * 2014-06-13 2020-06-29 Telefonaktiebolaget Lm Ericsson (Publ) Burst frame error handling
CN105225666B (en) * 2014-06-25 2016-12-28 华为技术有限公司 The method and apparatus processing lost frames
KR102626854B1 (en) * 2014-07-28 2024-01-18 삼성전자주식회사 Packet loss concealment method and apparatus, and decoding method and apparatus employing the same
FR3024582A1 (en) * 2014-07-29 2016-02-05 Orange MANAGING FRAME LOSS IN A FD / LPD TRANSITION CONTEXT
TWI602172B (en) * 2014-08-27 2017-10-11 弗勞恩霍夫爾協會 Encoder, decoder and method for encoding and decoding audio content using parameters for enhancing a concealment
US9978400B2 (en) * 2015-06-11 2018-05-22 Zte Corporation Method and apparatus for frame loss concealment in transform domain
US9837094B2 (en) * 2015-08-18 2017-12-05 Qualcomm Incorporated Signal re-use during bandwidth transition period
WO2017129270A1 (en) * 2016-01-29 2017-08-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for improving a transition from a concealed audio signal portion to a succeeding audio signal portion of an audio signal
CN106291205B (en) * 2016-10-14 2019-04-16 广州视源电子科技股份有限公司 A kind of blood oxygen probe method for diagnosing faults and device
CN108011686B (en) * 2016-10-31 2020-07-14 腾讯科技(深圳)有限公司 Information coding frame loss recovery method and device
CN106898356B (en) * 2017-03-14 2020-04-14 建荣半导体(深圳)有限公司 Packet loss hiding method and device suitable for Bluetooth voice call and Bluetooth voice processing chip
EP3483883A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio coding and decoding with selective postfiltering
EP3483886A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Selecting pitch lag
EP3483880A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Temporal noise shaping
EP3483879A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Analysis/synthesis windowing function for modulated lapped transformation
EP3483882A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Controlling bandwidth in encoders and/or decoders
EP3483884A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Signal filtering
EP3483878A1 (en) 2017-11-10 2019-05-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio decoder supporting a set of different loss concealment tools
WO2019091576A1 (en) 2017-11-10 2019-05-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoders, audio decoders, methods and computer programs adapting an encoding and decoding of least significant bits
CN111383643B (en) * 2018-12-28 2023-07-04 南京中感微电子有限公司 Audio packet loss hiding method and device and Bluetooth receiver
WO2020164752A1 (en) 2019-02-13 2020-08-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio transmitter processor, audio receiver processor and related methods and computer programs
US11646042B2 (en) * 2019-10-29 2023-05-09 Agora Lab, Inc. Digital voice packet loss concealment using deep learning
US11429830B2 (en) 2020-03-05 2022-08-30 Fasteners For Retail, Inc. Security tag holder and assembly for use with package having curved surfaces
USD956607S1 (en) 2020-04-16 2022-07-05 Fasteners For Retail, Inc. Security tag holder
CN113035208B (en) * 2021-03-04 2023-03-28 北京百瑞互联技术有限公司 Hierarchical error concealment method and device for audio decoder and storage medium

Citations (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1130997A (en) 1997-07-11 1999-02-02 Nec Corp Voice coding and decoding device
US5907822A (en) 1997-04-04 1999-05-25 Lincom Corporation Loss tolerant speech decoder for telecommunications
US5943347A (en) 1996-06-07 1999-08-24 Silicon Graphics, Inc. Apparatus and method for error concealment in an audio stream
WO2002058052A1 (en) 2001-01-19 2002-07-25 Koninklijke Philips Electronics N.V. Wideband signal transmission system
US20030036382A1 (en) 2001-08-17 2003-02-20 Broadcom Corporation Bit error concealment methods for speech coding
KR20030044292A (en) 2001-11-29 2003-06-09 주식회사 현대시스콤 Method and apparatus for searching of pitch parameter in voice system
US20030163304A1 (en) 2002-02-28 2003-08-28 Fisseha Mekuria Error concealment for voice transmission system
US20030220787A1 (en) 2002-04-19 2003-11-27 Henrik Svensson Method of and apparatus for pitch period estimation
US20040002856A1 (en) 2002-03-08 2004-01-01 Udaya Bhaskar Multi-rate frequency domain interpolative speech CODEC system
US6691085B1 (en) 2000-10-18 2004-02-10 Nokia Mobile Phones Ltd. Method and system for estimating artificial high band signal in speech codec using voice activity information
CN1489762A (en) 2000-10-31 2004-04-14 ��˹��ŵ�� Method and system for speech frame error concealment in speech decoding
JP2004302259A (en) 2003-03-31 2004-10-28 Matsushita Electric Ind Co Ltd Hierarchical encoding method and hierarchical decoding method for sound signal
US20040250195A1 (en) 2003-06-05 2004-12-09 Nec Corporation Audio decoder and audio decoding method
US20050055204A1 (en) 2003-09-10 2005-03-10 Microsoft Corporation System and method for providing high-quality stretching and compression of a digital audio signal
US20050143985A1 (en) 2003-12-26 2005-06-30 Jongmo Sung Apparatus and method for concealing highband error in spilt-band wideband voice codec and decoding system using the same
US20050154584A1 (en) 2002-05-31 2005-07-14 Milan Jelinek Method and device for efficient frame erasure concealment in linear predictive based speech codecs
US20050246164A1 (en) 2004-04-15 2005-11-03 Nokia Corporation Coding of audio signals
WO2005106850A1 (en) 2004-04-28 2005-11-10 Matsushita Electric Industrial Co., Ltd. Hierarchy encoding apparatus and hierarchy encoding method
WO2005106848A1 (en) 2004-04-30 2005-11-10 Matsushita Electric Industrial Co., Ltd. Scalable decoder and expanded layer disappearance hiding method
WO2005117366A1 (en) 2004-05-26 2005-12-08 Nippon Telegraph And Telephone Corporation Sound packet reproducing method, sound packet reproducing apparatus, sound packet reproducing program, and recording medium
US6985856B2 (en) 2002-12-31 2006-01-10 Nokia Corporation Method and device for compressed-domain packet loss concealment
US7069208B2 (en) 2001-01-24 2006-06-27 Nokia, Corp. System and method for concealment of data loss in digital audio transmission
US7080006B1 (en) 1999-12-08 2006-07-18 Robert Bosch Gmbh Method for decoding digital audio with error recognition
US20060173687A1 (en) 2005-01-31 2006-08-03 Spindola Serafin D Frame erasure concealment in voice communications
US20060184861A1 (en) 2005-01-20 2006-08-17 Stmicroelectronics Asia Pacific Pte. Ltd. (Sg) Method and system for lost packet concealment in high quality audio streaming applications
US20060265216A1 (en) 2005-05-20 2006-11-23 Broadcom Corporation Packet loss concealment for block-independent speech codecs
WO2007000988A1 (en) 2005-06-29 2007-01-04 Matsushita Electric Industrial Co., Ltd. Scalable decoder and disappeared data interpolating method
WO2007000998A1 (en) 2005-06-27 2007-01-04 Tohoku University BIS(ARYLMETHYLIDENE)ACETONE COMPOUND, ANTI-CANCER AGENT, CARCINOGENESIS-PREVENTIVE AGENT, INHIBITOR OF EXPRESSION OF Ki-Ras, ErbB2, c-Myc AND CYCLINE D1, β-CATENIN-DEGRADING AGENT, AND p53 EXPRESSION ENHANCER
CN1930607A (en) 2004-03-05 2007-03-14 松下电器产业株式会社 Error conceal device and error conceal method
US20070078645A1 (en) 2005-09-30 2007-04-05 Nokia Corporation Filterbank-based processing of speech signals
US7233897B2 (en) 1999-04-19 2007-06-19 At&T Corp. Method and apparatus for performing packet loss or frame erasure concealment
EP1801784A1 (en) 2005-12-26 2007-06-27 Sony Corporation Signal encoding device and signal encoding method, signal decoding device and signal decoding method, program, and recording medium
EP1808684A1 (en) 2004-11-05 2007-07-18 Matsushita Electric Industrial Co., Ltd. Scalable decoding apparatus and scalable encoding apparatus
US20070225971A1 (en) 2004-02-18 2007-09-27 Bruno Bessette Methods and devices for low-frequency emphasis during audio compression based on ACELP/TCX
WO2007111647A2 (en) 2006-03-20 2007-10-04 Mindspeed Tech Inc Pitch prediction for packet loss concealment
US20070299669A1 (en) 2004-08-31 2007-12-27 Matsushita Electric Industrial Co., Ltd. Audio Encoding Apparatus, Audio Decoding Apparatus, Communication Apparatus and Audio Encoding Method
US20080027717A1 (en) 2006-07-31 2008-01-31 Vivek Rajendran Systems, methods, and apparatus for wideband encoding and decoding of inactive frames
US20080040122A1 (en) 2006-08-11 2008-02-14 Broadcom Corporation Packet Loss Concealment for a Sub-band Predictive Coder Based on Extrapolation of Excitation Waveform
US20080046236A1 (en) 2006-08-15 2008-02-21 Broadcom Corporation Constrained and Controlled Decoding After Packet Loss
US20080052065A1 (en) 2006-08-22 2008-02-28 Rohit Kapoor Time-warping frames of wideband vocoder
US20080071550A1 (en) 2006-09-18 2008-03-20 Samsung Electronics Co., Ltd. Method and apparatus to encode and decode audio signal by using bandwidth extension technique
US20080126096A1 (en) 2006-11-24 2008-05-29 Samsung Electronics Co., Ltd. Error concealment method and apparatus for audio signal and decoding method and apparatus for audio signal using the same
KR20090076797A (en) 2007-09-15 2009-07-13 후아웨이 테크놀러지 컴퍼니 리미티드 Method and device for performing frame erasure concealment to higher-band signal
CN100524462C (en) 2007-09-15 2009-08-05 华为技术有限公司 Method and apparatus for concealing frame error of high belt signal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3111459B2 (en) * 1990-06-11 2000-11-20 ソニー株式会社 High-efficiency coding of audio data

Patent Citations (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5943347A (en) 1996-06-07 1999-08-24 Silicon Graphics, Inc. Apparatus and method for error concealment in an audio stream
US5907822A (en) 1997-04-04 1999-05-25 Lincom Corporation Loss tolerant speech decoder for telecommunications
JPH1130997A (en) 1997-07-11 1999-02-02 Nec Corp Voice coding and decoding device
US7233897B2 (en) 1999-04-19 2007-06-19 At&T Corp. Method and apparatus for performing packet loss or frame erasure concealment
US7080006B1 (en) 1999-12-08 2006-07-18 Robert Bosch Gmbh Method for decoding digital audio with error recognition
US6691085B1 (en) 2000-10-18 2004-02-10 Nokia Mobile Phones Ltd. Method and system for estimating artificial high band signal in speech codec using voice activity information
CN1484824A (en) 2000-10-18 2004-03-24 ��˹��ŵ�� Method and system for estimating artifcial high band signal in speech codec
CN1489762A (en) 2000-10-31 2004-04-14 ��˹��ŵ�� Method and system for speech frame error concealment in speech decoding
WO2002058052A1 (en) 2001-01-19 2002-07-25 Koninklijke Philips Electronics N.V. Wideband signal transmission system
US20020097807A1 (en) 2001-01-19 2002-07-25 Gerrits Andreas Johannes Wideband signal transmission system
CN1418361A (en) 2001-01-19 2003-05-14 皇家菲利浦电子有限公司 Wideband signal transmission system
US7069208B2 (en) 2001-01-24 2006-06-27 Nokia, Corp. System and method for concealment of data loss in digital audio transmission
US20030036382A1 (en) 2001-08-17 2003-02-20 Broadcom Corporation Bit error concealment methods for speech coding
WO2003017555A2 (en) 2001-08-17 2003-02-27 Broadcom Corporation Improved bit error concealment methods for speech coding
US20030036901A1 (en) 2001-08-17 2003-02-20 Juin-Hwey Chen Bit error concealment methods for speech coding
US20050187764A1 (en) 2001-08-17 2005-08-25 Broadcom Corporation Bit error concealment methods for speech coding
KR20030044292A (en) 2001-11-29 2003-06-09 주식회사 현대시스콤 Method and apparatus for searching of pitch parameter in voice system
US20030163304A1 (en) 2002-02-28 2003-08-28 Fisseha Mekuria Error concealment for voice transmission system
US20040002856A1 (en) 2002-03-08 2004-01-01 Udaya Bhaskar Multi-rate frequency domain interpolative speech CODEC system
US20030220787A1 (en) 2002-04-19 2003-11-27 Henrik Svensson Method of and apparatus for pitch period estimation
US20050154584A1 (en) 2002-05-31 2005-07-14 Milan Jelinek Method and device for efficient frame erasure concealment in linear predictive based speech codecs
US6985856B2 (en) 2002-12-31 2006-01-10 Nokia Corporation Method and device for compressed-domain packet loss concealment
JP2004302259A (en) 2003-03-31 2004-10-28 Matsushita Electric Ind Co Ltd Hierarchical encoding method and hierarchical decoding method for sound signal
US20040250195A1 (en) 2003-06-05 2004-12-09 Nec Corporation Audio decoder and audio decoding method
JP2004361731A (en) 2003-06-05 2004-12-24 Nec Corp Audio decoding system and audio decoding method
US20050055204A1 (en) 2003-09-10 2005-03-10 Microsoft Corporation System and method for providing high-quality stretching and compression of a digital audio signal
JP2005084692A (en) 2003-09-10 2005-03-31 Microsoft Corp System and method for providing high-quality expansion and compression of digital audio signal
US20050143985A1 (en) 2003-12-26 2005-06-30 Jongmo Sung Apparatus and method for concealing highband error in spilt-band wideband voice codec and decoding system using the same
US20070225971A1 (en) 2004-02-18 2007-09-27 Bruno Bessette Methods and devices for low-frequency emphasis during audio compression based on ACELP/TCX
CN1930607A (en) 2004-03-05 2007-03-14 松下电器产业株式会社 Error conceal device and error conceal method
US20050246164A1 (en) 2004-04-15 2005-11-03 Nokia Corporation Coding of audio signals
WO2005106850A1 (en) 2004-04-28 2005-11-10 Matsushita Electric Industrial Co., Ltd. Hierarchy encoding apparatus and hierarchy encoding method
US20070233467A1 (en) 2004-04-28 2007-10-04 Masahiro Oshikiri Hierarchy Encoding Apparatus and Hierarchy Encoding Method
WO2005106848A1 (en) 2004-04-30 2005-11-10 Matsushita Electric Industrial Co., Ltd. Scalable decoder and expanded layer disappearance hiding method
US20080249766A1 (en) 2004-04-30 2008-10-09 Matsushita Electric Industrial Co., Ltd. Scalable Decoder And Expanded Layer Disappearance Hiding Method
US20070177620A1 (en) 2004-05-26 2007-08-02 Nippon Telegraph And Telephone Corporation Sound packet reproducing method, sound packet reproducing apparatus, sound packet reproducing program, and recording medium
WO2005117366A1 (en) 2004-05-26 2005-12-08 Nippon Telegraph And Telephone Corporation Sound packet reproducing method, sound packet reproducing apparatus, sound packet reproducing program, and recording medium
US20070299669A1 (en) 2004-08-31 2007-12-27 Matsushita Electric Industrial Co., Ltd. Audio Encoding Apparatus, Audio Decoding Apparatus, Communication Apparatus and Audio Encoding Method
EP1808684A1 (en) 2004-11-05 2007-07-18 Matsushita Electric Industrial Co., Ltd. Scalable decoding apparatus and scalable encoding apparatus
US20080126082A1 (en) 2004-11-05 2008-05-29 Matsushita Electric Industrial Co., Ltd. Scalable Decoding Apparatus and Scalable Encoding Apparatus
US20060184861A1 (en) 2005-01-20 2006-08-17 Stmicroelectronics Asia Pacific Pte. Ltd. (Sg) Method and system for lost packet concealment in high quality audio streaming applications
US20060173687A1 (en) 2005-01-31 2006-08-03 Spindola Serafin D Frame erasure concealment in voice communications
US20060265216A1 (en) 2005-05-20 2006-11-23 Broadcom Corporation Packet loss concealment for block-independent speech codecs
WO2007000998A1 (en) 2005-06-27 2007-01-04 Tohoku University BIS(ARYLMETHYLIDENE)ACETONE COMPOUND, ANTI-CANCER AGENT, CARCINOGENESIS-PREVENTIVE AGENT, INHIBITOR OF EXPRESSION OF Ki-Ras, ErbB2, c-Myc AND CYCLINE D1, β-CATENIN-DEGRADING AGENT, AND p53 EXPRESSION ENHANCER
US20090141790A1 (en) 2005-06-29 2009-06-04 Matsushita Electric Industrial Co., Ltd. Scalable decoder and disappeared data interpolating method
WO2007000988A1 (en) 2005-06-29 2007-01-04 Matsushita Electric Industrial Co., Ltd. Scalable decoder and disappeared data interpolating method
US20070078645A1 (en) 2005-09-30 2007-04-05 Nokia Corporation Filterbank-based processing of speech signals
EP1801784A1 (en) 2005-12-26 2007-06-27 Sony Corporation Signal encoding device and signal encoding method, signal decoding device and signal decoding method, program, and recording medium
WO2007111647A2 (en) 2006-03-20 2007-10-04 Mindspeed Tech Inc Pitch prediction for packet loss concealment
US20080027717A1 (en) 2006-07-31 2008-01-31 Vivek Rajendran Systems, methods, and apparatus for wideband encoding and decoding of inactive frames
US20080040122A1 (en) 2006-08-11 2008-02-14 Broadcom Corporation Packet Loss Concealment for a Sub-band Predictive Coder Based on Extrapolation of Excitation Waveform
US20080046236A1 (en) 2006-08-15 2008-02-21 Broadcom Corporation Constrained and Controlled Decoding After Packet Loss
US20080052065A1 (en) 2006-08-22 2008-02-28 Rohit Kapoor Time-warping frames of wideband vocoder
US20080071550A1 (en) 2006-09-18 2008-03-20 Samsung Electronics Co., Ltd. Method and apparatus to encode and decode audio signal by using bandwidth extension technique
US20080126096A1 (en) 2006-11-24 2008-05-29 Samsung Electronics Co., Ltd. Error concealment method and apparatus for audio signal and decoding method and apparatus for audio signal using the same
KR20090076797A (en) 2007-09-15 2009-07-13 후아웨이 테크놀러지 컴퍼니 리미티드 Method and device for performing frame erasure concealment to higher-band signal
CN100524462C (en) 2007-09-15 2009-08-05 华为技术有限公司 Method and apparatus for concealing frame error of high belt signal

Non-Patent Citations (12)

* Cited by examiner, † Cited by third party
Title
Goodman et al., "Waveform Substitution Techniques for Recovering Missing Speech Segments in Packet Voice Communications," ICASSP 86, 1986, Institute of Electronic and Electrical Engineers, Tokyo, Japan.
ITU, Appendix IV: A low-complexity algorithm for packet loss concealment with G.722, International Telecommunication Union, Series G: Transmission Systems and Media, Digital Systems and Networks, Nov. 2006, pp. 1-16.
Japanese Office Action (Feb. 16, 2010).
Korean Intellectual Property Office, Examination Report in Korean Patent Application No. 10-2008-0059133 (Mar. 31, 2010).
NTT, "Low-Delay Wideband Extension to G.711 for IP Phone Services," International Telecommunication Union, Telecommunication Standardization Sector, Study Period 2005-2008, ITU-T WP3/16, Document AC-0701-06, English only, Geneva (Jan. 16-19, 2007).
Perkins et al., "A Survey of Packet Loss Recovery Techniques for Streaming Audio," IEEE Network, Sep.-Oct. 2008, Institute of Electronic and Electrical Engineers, Piscataway, New Jersey.
Ramamurthy et al., "Modeling and Analysis of a Variable Bit Rate Video Multiplexer," INFOCOM'92, 1992, Institute of Electronic and Electrical Engineers, Piscataway, New Jersey.
Rapporteur Q10/16, "Q10/16 Rapporteurs' Meeting report," Temporary Document, International Telecommunication Union, Telecommunication Standardization Sector, Study Period 2005-2008, Study Group 16, TD 228 R1 (WP 3/16), English only, Geneva (Mar. 30, 2007).
Sanneck et al., "A New Technique for Audio Packet Loss Concealment," 1996, Institute of Electronic and Electrical Engineers, Piscataway, New Jersey.
Sjoberg et al., "RFC 4352-RTP Payload Foramt for the Extended Adaptive Multi-Rate Wideband (AMR-WB+) Audio Codec," Jan. 2006, FROM??
State Intellectual Property Office of the People's Republic of China, English Translation of Written Opinion of the International Searching Authority in International Patent Application No. PCT/CN2008/070867 (Aug. 21, 2008).
Wah et al., "A Survey of Error-Concealment Schemes for Real-Time Audio and Video Transmissions over the Internet," IEEE International Symposium on Multimedia Software Engineering, Dec. 2000, Institute of Electronic and Electrical Engineers, Piscataway, New Jersey.

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130297322A1 (en) * 2006-11-24 2013-11-07 Samsung Electronics Co., Ltd Error concealment method and apparatus for audio signal and decoding method and apparatus for audio signal using the same
US9373331B2 (en) * 2006-11-24 2016-06-21 Samsung Electronics Co., Ltd. Error concealment method and apparatus for audio signal and decoding method and apparatus for audio signal using the same
US9704492B2 (en) 2006-11-24 2017-07-11 Samsung Electronics Co., Ltd. Error concealment method and apparatus for audio signal and decoding method and apparatus for audio signal using the same
US10283125B2 (en) 2006-11-24 2019-05-07 Samsung Electronics Co., Ltd. Error concealment method and apparatus for audio signal and decoding method and apparatus for audio signal using the same
US20110082575A1 (en) * 2008-06-10 2011-04-07 Dolby Laboratories Licensing Corporation Concealing Audio Artifacts
US8892228B2 (en) * 2008-06-10 2014-11-18 Dolby Laboratories Licensing Corporation Concealing audio artifacts
US10134413B2 (en) 2015-03-13 2018-11-20 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
US10734010B2 (en) 2015-03-13 2020-08-04 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
CN109243474A (en) * 2015-03-13 2019-01-18 杜比国际公司 Decode the audio bit stream in filling element with enhancing frequency spectrum tape copy metadata
CN109509479A (en) * 2015-03-13 2019-03-22 杜比国际公司 Decode the audio bit stream with the frequency spectrum tape copy metadata of enhancing
US10262668B2 (en) 2015-03-13 2019-04-16 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
US10262669B1 (en) 2015-03-13 2019-04-16 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
RU2665887C1 (en) * 2015-03-13 2018-09-04 Долби Интернэшнл Аб Decoding of audio bitstreams with metadata of extended copying of the spectral band in at least one filler
US10453468B2 (en) 2015-03-13 2019-10-22 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
US10553232B2 (en) 2015-03-13 2020-02-04 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
CN109003616A (en) * 2015-03-13 2018-12-14 杜比国际公司 Decode the audio bit stream in filling element with enhancing frequency spectrum tape copy metadata
US10943595B2 (en) 2015-03-13 2021-03-09 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
RU2764186C2 (en) * 2015-03-13 2022-01-14 Долби Интернэшнл Аб Decoding of bit audio streams with metadata of extended copying of spectral band in at least one filling element
US11367455B2 (en) 2015-03-13 2022-06-21 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
US11417350B2 (en) 2015-03-13 2022-08-16 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
CN109509479B (en) * 2015-03-13 2023-05-09 杜比国际公司 Decoding an audio bitstream with enhanced spectral band replication metadata
US11664038B2 (en) 2015-03-13 2023-05-30 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element
CN109243474B (en) * 2015-03-13 2023-06-16 杜比国际公司 Decoding an audio bitstream having enhancement spectrum band replication metadata in filler elements
CN109003616B (en) * 2015-03-13 2023-06-16 杜比国际公司 Decoding an audio bitstream having enhancement spectrum band replication metadata in filler elements
US11842743B2 (en) 2015-03-13 2023-12-12 Dolby International Ab Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element

Also Published As

Publication number Publication date
US7552048B2 (en) 2009-06-23
US20090076808A1 (en) 2009-03-19
EP2068306A1 (en) 2009-06-10
ES2328649T3 (en) 2009-11-16
ATE485581T1 (en) 2010-11-15
CN101231849A (en) 2008-07-30
US20090076805A1 (en) 2009-03-19
CN101542594B (en) 2012-01-25
EP2037450B1 (en) 2009-08-05
ATE438910T1 (en) 2009-08-15
JP4603091B2 (en) 2010-12-22
CN101542594A (en) 2009-09-23
KR100998430B1 (en) 2010-12-03
KR20090028676A (en) 2009-03-19
CN100524462C (en) 2009-08-05
EP2068306A4 (en) 2009-12-02
US20090076807A1 (en) 2009-03-19
DE602008000072D1 (en) 2009-09-17
JP2009109977A (en) 2009-05-21
DE602008003085D1 (en) 2010-12-02
WO2009033375A1 (en) 2009-03-19
JP2009538460A (en) 2009-11-05
EP2068306B1 (en) 2010-10-20
EP2037450A1 (en) 2009-03-18

Similar Documents

Publication Publication Date Title
US8200481B2 (en) Method and device for performing frame erasure concealment to higher-band signal
US9514755B2 (en) Position-dependent hybrid domain packet loss concealment
JP6306175B2 (en) Audio decoder for providing decoded audio information using error concealment based on time domain excitation signal and method for providing decoded audio information
RU2658128C2 (en) Apparatus and method for generating an adaptive spectral shape of comfort noise
JP6306177B2 (en) Audio decoder and decoded audio information providing method using error concealment to modify time domain excitation signal and providing decoded audio information
RU2419891C2 (en) Method and device for efficient masking of deletion of frames in speech codecs
RU2630390C2 (en) Device and method for masking errors in standardized coding of speech and audio with low delay (usac)
US11004458B2 (en) Coding mode determination method and apparatus, audio encoding method and apparatus, and audio decoding method and apparatus
KR102250472B1 (en) Hybrid Concealment Method: Combining Frequency and Time Domain Packet Loss Concealment in Audio Codecs
KR20220045260A (en) Improved frame loss correction with voice information
KR20090076797A (en) Method and device for performing frame erasure concealment to higher-band signal

Legal Events

Date Code Title Description
AS Assignment

Owner name: HUAWEI TECHNOLOGIES CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:XU, JIANFENG;MIAO, LEI;HU, CHEN;AND OTHERS;SIGNING DATES FROM 20080508 TO 20080514;REEL/FRAME:021015/0969

Owner name: HUAWEI TECHNOLOGIES CO., LTD., CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:XU, JIANFENG;MIAO, LEI;HU, CHEN;AND OTHERS;REEL/FRAME:021015/0969;SIGNING DATES FROM 20080508 TO 20080514

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12