WO2015196803A1 - 处理丢失帧的方法和装置 - Google Patents

处理丢失帧的方法和装置 Download PDF

Info

Publication number
WO2015196803A1
WO2015196803A1 PCT/CN2015/071728 CN2015071728W WO2015196803A1 WO 2015196803 A1 WO2015196803 A1 WO 2015196803A1 CN 2015071728 W CN2015071728 W CN 2015071728W WO 2015196803 A1 WO2015196803 A1 WO 2015196803A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame
lost frame
current lost
band signal
energy
Prior art date
Application number
PCT/CN2015/071728
Other languages
English (en)
French (fr)
Inventor
王宾
刘泽新
苗磊
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2016572825A priority Critical patent/JP6439804B2/ja
Priority to EP15811619.4A priority patent/EP3133596B1/en
Priority to MX2016017007A priority patent/MX359500B/es
Priority to RU2016151461A priority patent/RU2666471C2/ru
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to BR112016027113-0A priority patent/BR112016027113B1/pt
Priority to MYPI2016704115A priority patent/MY178408A/en
Priority to KR1020167033869A priority patent/KR101942411B1/ko
Priority to EP18203005.6A priority patent/EP3534366B1/en
Priority to CA2949266A priority patent/CA2949266C/en
Priority to SG11201609526RA priority patent/SG11201609526RA/en
Priority to AU2015281722A priority patent/AU2015281722B2/en
Publication of WO2015196803A1 publication Critical patent/WO2015196803A1/zh
Priority to US15/385,881 priority patent/US9852738B2/en
Priority to US15/817,296 priority patent/US10311885B2/en
Priority to US16/396,253 priority patent/US10529351B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/005—Correction of errors induced by the transmission channel, if related to the coding algorithm
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/083—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being an excitation gain
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques
    • G10L21/0388—Details of processing therefor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/93—Discriminating between voiced and unvoiced parts of speech signals
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/93—Discriminating between voiced and unvoiced parts of speech signals
    • G10L2025/932—Decision in previous or following frames

Definitions

  • Embodiments of the present invention relate to the field of communications technologies, and in particular, to a method and apparatus for processing a lost frame.
  • the main method to improve voice call quality is to increase the bandwidth of voice signals. If the traditional encoding method is used to increase the bandwidth of the speech signal, the bit rate will be greatly increased. However, increasing the bit rate requires a larger network bandwidth to transmit the speech signal. Due to the limitation of the network bandwidth, the speech is simply increased by increasing the bit rate. The method of signal bandwidth is difficult to use in practical applications.
  • the frequency band extension technology In order to encode a wider bandwidth speech signal without changing the code rate or changing, the frequency band extension technology is mainly used, and the frequency band extension technology is divided into a time domain band extension technology and a frequency domain band extension technology.
  • the packet loss rate is a key factor affecting the quality of the voice signal. Therefore, how to recover the lost frame as accurately as possible when the packet loss occurs, so that the signal transition occurs when the frame loss occurs. Being able to be more natural and stable is an important technology for voice signal transmission.
  • the existing frame loss recovery method may cause the recovered lost frame to be discontinuous with the preceding and succeeding frames, resulting in noise of the voice signal.
  • Embodiments of the present invention provide a method and apparatus for processing a lost frame, which are used to improve performance of frame loss recovery of an audio signal.
  • the first aspect provides a method of processing a lost frame, comprising:
  • Gain adjustment information of the current lost frame includes at least one of the following:
  • the type of the frame, the low-band signal spectrum of the frame is tilted, the low-band signal energy of the frame, and the number of consecutive dropped frames, wherein the consecutive dropped frames are consecutively lost frames to the current lost frame;
  • the gain adjustment information includes a low-band signal energy of a frame, and the gain of the current lost frame is adjusted according to the gain correction information Obtaining an adjustment gain of the current lost frame, including:
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames. Adjusting the gain of the current lost frame according to the gain correction information to obtain an adjustment gain of the current lost frame, including:
  • the type of the current lost frame is not unvoiced and the type of the current lost frame is not an unvoiced transition, and the low-band signal spectrum tilt of the previous frame of the current lost frame is less than a first threshold, and the low frequency of the current lost frame When the energy ratio of the signal energy to the low-band signal energy of the previous frame of the current lost frame is within a preset interval,
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, and a low-band signal energy of the frame. And adjusting the gain of the current lost frame according to the gain correction information, to obtain an adjustment gain of the current lost frame, including:
  • the type of the current lost frame is not unvoiced and the type of the current lost frame is not an unvoiced transition, and the low-band signal spectrum tilt of the previous frame of the current lost frame is less than a first threshold, and the low frequency of the current lost frame When the energy ratio of the signal energy to the low-band signal energy of the previous frame of the current lost frame is within a preset interval,
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, and a continuous number of dropped frames, where the information is corrected according to the gain Adjusting the gain of the current lost frame to obtain an adjustment gain of the current lost frame, including:
  • the type of the current lost frame is not unvoiced and the low frequency band signal spectrum of the previous frame of the current lost frame is greater than the first threshold, and the low band signal energy of the current lost frame and the previous one of the current lost frame When the energy ratio of the low-band signal energy of the frame is within a preset interval,
  • the gain adjustment information includes a continuous number of dropped frames, and the gain of the current lost frame is adjusted according to the gain correction information, to obtain
  • the adjustment gain of the current lost frame includes:
  • the gain adjustment information includes a continuous frame loss number and a low frequency band signal spectrum tilt of the frame, where the current correction information is related to the current
  • the gain of the lost frame is adjusted to obtain the adjustment gain of the current lost frame, including:
  • the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame is greater than the gain of the current lost frame and the current
  • the low-band signal spectrum tilt of the lost frame and the low-band signal spectrum of the previous frame of the current lost frame are both greater than the second threshold
  • the adjusting the initial high-band signal according to the adjustment gain to obtain the high-band signal of the current lost frame including:
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame And continuously losing the frame number, wherein the initial excitation adjustment factor is adjusted according to the gain correction information, to obtain an adjusted excitation adjustment factor, including:
  • the high frequency excitation energy of the current lost frame is greater than the high frequency excitation energy of the previous frame of the current lost frame
  • the type of the current lost frame is not unvoiced, and the type of the last normal received frame before the current lost frame is not unvoiced.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of lost frames, Adjusting the initial excitation adjustment factor according to the gain correction information to obtain an adjusted excitation adjustment factor, including:
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames, where Adjusting the initial excitation adjustment factor according to the gain correction information to obtain an adjusted excitation adjustment factor, including:
  • the low-band signal energy adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous The frame number is lost, and the initial excitation adjustment factor is adjusted according to the gain correction information to obtain an adjusted excitation adjustment factor, including:
  • the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame
  • the low band signal energy of the current lost frame When the energy ratio of the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum tilt of the previous frame of the current lost frame is greater than the third threshold
  • the gain adjustment information includes a low frequency band signal energy of the frame and a continuous frame loss number
  • the gain correction information adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor, including:
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames, And adjusting the initial excitation adjustment factor according to the gain correction information to obtain an adjusted excitation adjustment factor, including:
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames, And adjusting the initial excitation adjustment factor according to the gain correction information to obtain an adjusted excitation adjustment factor, including:
  • the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low frequency band signal energy of the current lost frame
  • the energy ratio of the low-band signal energy of the previous frame of the current lost frame is in a preset interval, and the type of the last normal received frame before the current lost frame is unvoiced
  • the gain adjustment information includes a low frequency band signal spectrum tilt of the frame, a low frequency band signal energy of the frame, and a continuous The frame number is lost, and the initial excitation adjustment factor is adjusted according to the gain correction information to obtain an adjusted excitation adjustment factor, including:
  • the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low frequency band signal energy of the current lost frame
  • the energy ratio of the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum tilt of the previous frame of the current lost frame is greater than the third threshold
  • a second aspect provides an apparatus for processing a lost frame, the apparatus for processing a lost frame comprising:
  • a determining module configured to determine an initial high frequency band signal of the current lost frame; determining a gain of the current lost frame; determining gain adjustment information of the current lost frame, the gain adjustment information including at least one of the following: a type of the frame The low-band signal spectrum of the frame is tilted, the low-band signal energy of the frame, and the number of consecutive dropped frames, wherein the consecutive lost frames is the number of consecutively lost frames until the current lost frame;
  • an adjusting module configured to adjust, according to the gain adjustment information, a gain of the current lost frame to obtain an adjustment gain of the current lost frame; and adjust the initial high-band signal according to the adjusted gain to obtain a The high band signal of the current lost frame.
  • the gain adjustment information includes a low-band signal energy of a frame
  • the adjusting module is specifically configured to use a low-band signal according to the current lost frame.
  • the energy obtains an energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame; according to the low-band signal energy of the current lost frame and the current lost frame
  • the energy of the low-band signal energy of one frame is adjusted to the gain of the current lost frame to obtain an adjustment gain of the current lost frame.
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous frame loss number.
  • the adjusting module is specifically configured to: when the consecutive frame loss number is equal to 1, and the type of the current lost frame is not unvoiced and the type of the current lost frame is not an unvoiced transition, and the previous frame of the current lost frame is The low-band signal spectrum is tilted less than the first threshold, and the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, according to the current loss
  • the low-band signal energy of the frame obtains an energy ratio of the high-frequency excitation energy of the previous frame of the current lost frame to the high-frequency excitation energy of the current lost frame; the high-frequency excitation according to the previous frame of the current lost frame The energy of the high frequency excitation energy of the
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames.
  • the adjusting module is specifically configured to: when the consecutive frame loss number is equal to 1, and the type of the current lost frame is not unvoiced, and the type of the current lost frame is not an unvoiced transition, And the low frequency band signal spectrum of the previous frame of the current lost frame is less than the first threshold, and the energy ratio of the low band signal energy of the current lost frame to the low band signal energy of the previous frame of the current lost frame.
  • the gain of the current lost frame is performed according to a preset adjustment factor. Adjusting to obtain the adjustment gain of the current lost frame.
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, and a continuous number of dropped frames
  • the adjustment module is specifically configured to: When the number of consecutive dropped frames is equal to 1, and the type of the current lost frame is not unvoiced and the low frequency band signal spectrum of the previous frame of the current lost frame is greater than the first threshold, and the low frequency band of the current lost frame
  • the energy ratio of the signal energy to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, the high-frequency of the previous frame of the current lost frame is obtained according to the low-band signal energy of the currently lost frame.
  • An energy ratio of the excitation energy to the high frequency excitation energy of the current lost frame comparing the energy of the high frequency excitation energy of the previous frame of the current lost frame with the energy of the high frequency excitation energy of the current lost frame The gain of the lost frame is adjusted to obtain an adjustment gain of the currently lost frame.
  • the gain adjustment information includes a continuous number of dropped frames
  • the adjusting module is specifically configured to obtain, according to the low-band signal energy of the current lost frame.
  • the energy ratio of the frequency excitation energy to the high frequency excitation energy of the current lost frame is greater than the gain of the current lost frame, according to the high frequency excitation energy of the previous frame of the current lost frame and the current lost frame
  • the energy of the frequency excitation energy is adjusted to the gain of the current lost frame to obtain an adjustment gain of the current lost frame.
  • the gain adjustment information includes a continuous frame loss number and a low frequency band signal spectrum tilt of the frame, where the adjusting module is specifically configured to be used according to the current
  • the low-band signal energy of the lost frame is obtained as an energy ratio of the high-frequency excitation energy of the previous frame of the current lost frame to the high-frequency excitation energy of the current lost frame; when the consecutive number of dropped frames is greater than 1, the current The energy ratio of the high frequency excitation energy of the previous frame of the lost frame to the high frequency excitation energy of the current lost frame is greater than the gain of the current lost frame and the low frequency band signal spectrum of the current lost frame is tilted and the current loss Low frequency band signal of the previous frame of the frame When the spectrum is greater than the second threshold, adjusting the gain of the current lost frame according to the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame, The adjustment gain of the current lost frame.
  • the determining module is further configured to determine an initial incentive Adjustment factor
  • the adjusting module is further configured to adjust the initial excitation adjustment factor according to the gain correction information to obtain an adjusted excitation adjustment factor; and to perform the initial according to the adjustment gain and the adjusted excitation adjustment factor
  • the high band signal is adjusted to obtain a high band signal of the currently lost frame.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames.
  • the adjusting module is specifically configured to: when the consecutive frame loss number is equal to 1, the high frequency excitation energy of the current lost frame is greater than the high frequency excitation energy of the previous frame of the current lost frame, and the current lost frame is If the type is not unvoiced and the type of the last normal received frame before the current lost frame is not unvoiced, the low-band signal energy according to the previous frame of the currently lost frame and the low-band signal energy of the currently lost frame are The initial incentive adjustment factor is adjusted to obtain an adjusted incentive adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module is specifically configured to: when the consecutive frame loss number is equal to 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the current And the energy ratio of the low-band signal energy of the lost frame to the low-band signal energy of the previous frame of the current lost frame is in a preset interval, and the type of the previous frame of the current lost frame is unvoiced, according to the current
  • the initial excitation adjustment factor is adjusted by the low frequency band signal energy of the previous frame of the lost frame and the low frequency band signal energy of the current lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module is specifically configured to: when the consecutive number of dropped frames is equal to 1, and The high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low frequency band signal energy of the current lost frame and the low frequency of the previous frame of the current lost frame.
  • the gain adjustment information includes a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous The number of frames lost
  • the adjustment module is specifically configured to: when the consecutive frame loss number is equal to 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame And the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum of the previous frame of the current lost frame
  • the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the currently lost frame, and the adjusted excitation adjustment factor is obtained.
  • the gain adjustment information includes a low frequency band signal energy of the frame and a continuous frame loss number
  • the adjustment module Specifically, when the continuous frame loss number is greater than 1 and the high frequency excitation energy of the current lost frame is greater than the high frequency excitation energy of the previous frame of the current lost frame, according to the previous one of the current lost frame.
  • the initial excitation adjustment factor is adjusted by the low frequency band signal energy of the frame and the low frequency band signal energy of the current lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module is specifically configured to: when the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the When the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame is in a preset interval, and the type of the previous frame of the current lost frame is unvoiced, according to the The low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the currently lost frame are subjected to the initial excitation adjustment factor Adjust to get the adjusted incentive adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module is specifically configured to: when the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the When the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame is in a preset interval, and the type of the last normal received frame before the current lost frame is unvoiced, And adjusting the initial excitation adjustment factor according to the low frequency band signal energy of the previous frame of the current lost frame and the low frequency band signal energy of the current lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a low frequency band signal spectrum tilt of the frame, a low frequency band signal energy of the frame, and a continuous The number of frames lost
  • the adjustment module is specifically configured to: when the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame And the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum of the previous frame of the current lost frame
  • the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the currently lost frame, and the adjusted excitation adjustment factor is obtained.
  • the method and apparatus for processing a lost frame provided by the embodiment of the present invention, when a frame loss occurs in the audio data, the high-band signal of the lost frame is adjusted according to the low-band signal of the lost frame, so that the recovered lost frame high-low frequency band frame is restored.
  • the trend of change is consistent, which improves the performance of frame loss recovery.
  • 1 is a schematic diagram of audio signal coding using a time domain band extension technique
  • FIG. 2 is a schematic diagram of audio signal decoding using a time domain band extension technique
  • FIG. 3 is a flowchart of Embodiment 1 of a method for processing a lost frame according to an embodiment of the present disclosure
  • Embodiment 4 is a flowchart of Embodiment 2 of a method for processing a lost frame according to an embodiment of the present invention
  • FIG. 5 is a flowchart of Embodiment 3 of a method for processing a lost frame according to an embodiment of the present disclosure
  • FIG. 6 is a flowchart of Embodiment 4 of a method for processing a lost frame according to an embodiment of the present disclosure
  • FIG. 7 is a flowchart of Embodiment 5 of a method for processing a lost frame according to an embodiment of the present disclosure
  • FIG. 8 is a flowchart of Embodiment 6 of a method for processing a lost frame according to an embodiment of the present disclosure
  • FIG. 9 is a flowchart of Embodiment 7 of a method for processing a lost frame according to an embodiment of the present disclosure.
  • FIG. 10 is a flowchart of Embodiment 8 of a method for processing a lost frame according to an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of an apparatus for processing a lost frame according to an embodiment of the present invention.
  • a band extension technique is mainly used at present.
  • the principle of the band extension technique is that the transmitting end divides the signal into two parts, a high frequency band and a low frequency band, wherein the low frequency band part is encoded using an encoder, and for the high frequency band part, only partial information and high and low frequency band related parameters are extracted. Information; the receiving end recovers the entire speech signal according to the signal of the low frequency band portion and the related information of the high frequency band portion and the high and low frequency band related parameters.
  • the band extension technique when a frame loss occurs in a voice signal transmission, information of the N frames before the frame loss (N is greater than or equal to 1) is used to recover the lost frame.
  • the low-band portion of the lost frame may be recovered according to the low-band information of the previous frame of the lost frame, and the high-band portion of the lost frame is recovered according to the global gain factor of the speech signal and the subframe gain attenuation factor.
  • both the global gain factor and the subframe gain attenuation factor are based on encoding the high-band portion of the original speech signal at the encoding end, and the low-band portion of the original speech signal is not used for frame loss recovery in the high-band portion. deal with.
  • the low-band energy variation trend of the lost frame is inconsistent with the high-band energy variation trend, the energy transition between the recovered frame and the preceding and succeeding frames may be discontinuous, resulting in noise in the voice signal.
  • FIG. 1 is a schematic diagram of audio signal coding using a time domain band extension technique
  • FIG. 2 is a schematic diagram of audio signal decoding using a time domain band extension technique.
  • the encoding end first acquires an audio signal 101, and the audio signal 101 includes a low frequency band portion and a high frequency band portion, wherein the low frequency band portion and the high frequency band portion are a relative concept as long as
  • the audio signal is divided into a portion from 0 Hz to W1 Hz and a portion from W1 Hz to W2 Hz according to the frequency, a portion from 0 Hz to W1 Hz is a low band portion, and a portion from W1 Hz to W2 Hz is a high band portion.
  • a portion of 0 to 4 kHz may be used as a low frequency band portion, and a portion of 4 kHz to 8 kHz may be used as a high frequency band portion;
  • a portion of 0 to 6 kHz may be used as The low band portion, and the portion from 6k to 16 kHz is taken as the high band portion.
  • the encoding side then calculates the parameters of the low band portion of the audio signal 101, including the pitch period, algebraic number, gain, etc. of the audio signal 101, which may include one or more of the above.
  • the encoding parameter 102 is uniformly represented by the encoding parameter 102. It can be understood that the encoding parameter 102 is only an example made to help understand the embodiment of the present invention, and is not meant to be used for the encoding end. The specific limits of the parameters.
  • the encoding end For the high-band portion of the audio signal 101, the encoding end performs Linear Predictive Coding (LPC) on the high-band portion to obtain a high-band LPC coefficient 103.
  • LPC Linear Predictive Coding
  • the high-band excitation signal 104 is calculated by the encoding parameter 102, the high-band LPC coefficient 103 is used as the filter coefficient of the LPC synthesis filter, and the high-band excitation signal 104 is synthesized into a high-band signal by the LPC synthesis filter, and the audio is compared.
  • the original high frequency band portion of the signal 101 and the synthesized high frequency band signal result in a sub-frame gain (SubGain) 105 and a global gain (FramGain) 106, wherein the global gain 106 is the original high frequency band by comparing each frame of the audio signal 101.
  • SubGain sub-frame gain
  • FramGain global gain
  • the energy of the portion and the energy of the synthesized high-band signal are obtained by comparing the energy of the original high-band portion of each subframe in each frame of the audio signal 101 with the energy of the synthesized high-band signal.
  • the LPC coefficient 103 is converted into a Linear Spectral Frequency (LSF) parameter 107, and the LSF parameter 107, the sub-frame gain 105, and the global gain 106 are quantized and encoded.
  • the final encoding end obtains the encoding code according to the encoding parameter 102, the encoded LSF parameter 107, the subframe gain 105, and the global gain 106.
  • Stream 108 and transmits encoded code stream 108 to the decoding end.
  • the decoding end decodes the received encoded code stream 108 to obtain parameters such as a pitch period, an algebraic number, a gain, and the like of the speech signal, that is, an encoding parameter 102, and the decoding end decodes and dequantizes the received encoded code stream 108.
  • the LSF parameter 107 and the subframe gain 105, the global gain 106 are obtained, and the LSF parameter 107 is converted into the LPC coefficient 103.
  • the high-band excitation signal 104 is calculated by the encoding parameter 102, the LPC parameter 103 is used as the filter coefficient of the LPC synthesis filter, and the high-band excitation signal 104 is synthesized into a high-band signal by the LPC synthesis filter, and the synthesized high
  • the band signal is restored to the high band portion of the audio signal 101 by the adjustment of the sub-frame gain 105 and the global gain 106, and is decoded according to the encoding parameter 102 to obtain a low-band portion of the audio signal 101, and the high-band portion of the audio signal 101 is The low frequency band portion is synthesized to obtain the original audio signal 101.
  • the coding parameters and the LSF parameters of the lost frame are estimated according to the coding parameters and the LSF parameters of the previous frame of the lost frame (for example, the coding parameters and LSF parameters of the previous frame of the lost frame are directly used as the lost frame.
  • the coding parameter and the LSF parameter estimate the global gain and the subframe gain of the lost frame according to the global gain, the subframe gain, and the coding type of the previous frame of the lost frame.
  • the estimated coding parameters of the lost frame can be decoded to recover the low-band portion of the lost frame; and the high-band excitation signal of the lost frame is recovered according to the estimated coding parameters, and the global frame of the lost frame is estimated.
  • the gain and sub-frame gain recover the high-band portion of the lost frame, and the recovered low-band portion and high-band portion are combined into a lost frame signal.
  • the low-band portion of the recovered lost frame uses the encoding parameter of the previous frame of the lost frame, and the encoding parameter of the previous frame of the lost frame is based on the lost frame.
  • the low-band portion of the previous frame is directly obtained by encoding, and the low-band portion of the lost frame can be better recovered according to the encoding parameter.
  • the high-band portion of the recovered lost frame uses the global gain, the subframe gain, and the encoding type of the previous frame of the lost frame, and the global gain and the subframe gain of the previous frame of the lost frame are obtained through encoding, operations, and the like. Therefore, errors may occur in the high-band portion of the lost frame that is recovered.
  • one method of recovering the high-band portion of the lost frame is to adjust the global gain factor and the subframe gain attenuation factor, multiplying the global gain factor and the subframe gain attenuation factor of the previous frame of the lost frame.
  • the fixed attenuation factor is used as the global gain factor and the subframe gain attenuation factor of the lost frame.
  • the coding type of the previous frame of the lost frame is utilized.
  • the factor adaptively estimates the global gain factor and the subframe gain attenuation factor of the lost frame.
  • the global gain factor and the subframe gain attenuation factor are parameters related to the global gain and the subframe gain.
  • the high-band portion of the initial recovered lost frame uses the high-band information and the low-band information of the previous frame of the lost frame, and the adjustment of the high-frequency portion of the initially recovered lost frame involves only the previous frame of the lost frame. In the high-band information, when the energy variation trend of the high-band portion and the low-band portion of the lost frame is inconsistent, the recovered lost frame will cause discontinuity of the overall forward and backward transition of the audio signal, thereby causing noise.
  • Embodiments of the present invention provide a method and apparatus for processing a lost frame. Based on the prior art, a high frequency band portion of an audio signal is used to recover a lost frame, and further, according to a low frequency band portion of the audio signal, a gain and a loss of a lost frame are performed. The frequency excitation is adjusted to maintain the consistent trend of the high and low frequency bands of the lost frame after recovery, thereby improving the performance of the frame loss processing.
  • FIG. 3 is a flowchart of Embodiment 1 of a method for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 3, the method in this embodiment includes:
  • Step S301 determining an initial high frequency band signal of the currently lost frame.
  • the method for processing a lost frame is applied to a receiving end of an audio signal.
  • the receiving end of the audio signal receives the audio data sent by the transmitting end, and the audio data received by the receiving end can be either a data stream or a data packet.
  • the receiving end can detect the lost frame.
  • the method for the receiving end to determine whether the received audio data has lost frames may be any method in the prior art, for example, setting a flag bit in each frame of the audio data, and the flag bit is normally 0. When a frame loss occurs, the flag bit is set to 1.
  • the receiving end detects the flag bit in each frame when receiving the audio data, and when it detects that the flag bit is 1, it can determine that the frame loss occurs;
  • each frame of the audio data may be sequentially numbered. If the number of the current frame received by the decoding end is not continuous with the number of the received previous frame, it may be determined that the frame loss occurs. This embodiment does not limit the method of determining whether or not the received audio data has a lost frame.
  • the lost frame of the audio signal can be divided into two parts, a low frequency band signal and a high frequency band signal, first using the current lost frame.
  • the low frequency band information of the previous frame recovers the low frequency band information of the current lost frame, specifically, the coding parameter of the current lost frame is estimated according to the coding parameters of the previous frame of the current lost frame, thereby estimating the low frequency band portion of the current lost frame.
  • the previous frame of the lost frame referred to herein may be either a normally received frame or a frame recovered according to a normally received frame.
  • the estimated global gain and subframe gain of the current lost frame recovers the high band signal of the currently lost frame.
  • the high-band signal of the current lost frame recovered according to the above method is referred to as an initial high-band signal.
  • the following steps in this embodiment are to adjust the initial high-frequency signal, thereby recovering the current lost frame more accurately.
  • High frequency band signal is referred to as an initial high-band signal.
  • step S302 the gain of the currently lost frame is determined.
  • step S301 it can be known from step S301 that the global gain and the subframe gain of the current lost frame can be estimated according to the global gain, the subframe gain and the coding type of the previous frame of the current lost frame, since this embodiment is the high frequency of the current lost frame.
  • the signal is adjusted, and the direct impact on the current lost frame is the subframe gain. Therefore, the gain of the current lost frame in this step and in the present embodiment is the subframe gain of the currently lost frame.
  • Step S303 determining gain adjustment information of the current lost frame, where the gain adjustment information includes at least one of the following: a type of the frame, a low-band signal spectrum of the frame, a low-band signal energy of the frame, and a continuous number of lost frames, wherein the continuous lost frame The number of frames is the number of consecutive frames lost until the current lost frame.
  • the high-band signal of the current lost frame is adjusted, and the high-band signal is obtained by the high-band excitation signal and the gain, so by adjusting the gain of the lost frame, the current loss can be achieved.
  • the high frequency band of the frame is adjusted. Adjusting the gain requires the use of gain adjustment information, which may include at least one of the following: the type of the frame, the slope of the low-band signal spectrum of the frame, the energy of the low-band signal of the frame, and the number of consecutive dropped frames.
  • the type of the frame may be obtained according to the coding type of the previous frame of the current lost frame, and the type of the frame and the coding type information are carried in the low-band signal portion of the frame.
  • the number of consecutive dropped frames is the number of consecutive frames lost until the current lost frame.
  • the pre-frame loss coding type may refer to the coding mode before the current frame loss event occurs.
  • the encoder can classify the signal before encoding the signal to select the appropriate coding mode.
  • the coding mode may include: INACTIVE mode, UNVOICED mode, VOICED mode, GENERIC mode, and transient frame coding mode (TRANSITION) Mode), audio frame encoding mode (AUDIO mode).
  • the type of the last frame received before the frame loss may be the type of the most recent frame received by the decoder before the frame loss event occurs. For example, suppose the encoding end sends 4 frames to the decoding end, wherein the decoding end correctly receives the first frame and the second frame, and the third frame and the fourth frame are lost, then the last frame received before the frame loss can be Refers to the second frame.
  • the type of frame may include: (1) a frame of one of several characteristics such as unvoiced, mute, noise, or voiced end (UNVOICED_CLAS frame); (2) unvoiced to voiced transition, voiced start but relatively weak frame (UNVOICED_TRANSITION Frame); (3) transition after voiced sound, frame with weak voiced characteristics (VOICED_TRANSITION frame); (4) frame with voiced characteristics, the previous frame is voiced or voiced start frame (VOICED_CLAS frame); (5) obvious The start frame of the voiced sound (ONSET frame); (6) the start frame of the harmonic and noise mixture (SIN_ONSET frame); (7) the inactive feature frame (INACTIVE_CLAS frame).
  • the number of consecutive frames lost can refer to the number of consecutive frames lost in the current frame loss event until the current lost frame.
  • the number of consecutive dropped frames may indicate that the currently lost frame is the first few frames in consecutive lost frames. For example, the encoding end sends 5 frames to the decoding end, and the decoding end correctly receives the first frame and the second frame, and the third frame to the fifth frame are lost. If the current lost frame is the 4th frame, the number of consecutive dropped frames is 2; if the currently lost frame is the 5th frame, the number of consecutive dropped frames is 3.
  • the low-band signal spectrum of the frame is tilted, the low-band signal energy of the frame, and the number of consecutive frame-down gain adjustment information are obtained according to the low-band signal of the frame. Therefore, the gain of the frame is adjusted in this embodiment.
  • the low frequency band signal portion of the signal is used.
  • Step S304 adjusting the gain of the currently lost frame according to the gain adjustment information to obtain an adjustment gain of the current lost frame.
  • the gain of the current lost frame may be adjusted according to the gain adjustment information.
  • the specific adjustment method may be preset at the decoding end of the audio signal, and after the decoding end determines the gain adjustment information, the gain adjustment information is determined, if the Corresponding preset conditions, according to the adjustment method corresponding to the preset condition, the gain of the current lost frame is adjusted, and finally the current The adjusted gain of the lost frame.
  • Step S305 adjusting the initial high frequency band signal according to the adjustment gain to obtain a high frequency band signal of the current lost frame.
  • the initial high-band signal can be adjusted according to the adjustment gain, thereby obtaining the adjusted high-band signal, that is, the high-band signal of the currently lost frame.
  • the high-band signal is the product of the high-band excitation signal and the gain. Therefore, by multiplying the adjustment gain by the initial high-band signal, the high-band signal of the currently lost frame can be obtained.
  • the high-band signal of the current lost frame obtained in step S305 and the low-band signal of the current lost frame recovered by using the encoding parameter of the previous frame of the current lost frame are combined to obtain the current lost frame, thereby completing the pair.
  • Recovery processing of the current lost frame Since the receiving end recovers the current lost frame in addition to the relevant parameters obtained by using the high-band signal when recovering the current lost frame, the low-band signal is also used to recover the currently lost frame, so that the recovered current lost frame is between the high and low frequency frames. The trend of change is consistent, which improves the performance of frame loss recovery.
  • the high-band signal of the lost frame is adjusted according to the low-band signal of the lost frame, so that the changed trend of the recovered high-low frequency band is consistent, and the frame loss recovery is improved. Performance.
  • the foregoing step S304 is to adjust the gain of the current lost frame according to the gain adjustment information, and obtain a specific method for adjusting the gain of the current lost frame, which may be preset at the receiving end of the audio signal, and the current embodiment is used to adjust the current information according to the gain adjustment information.
  • the method of adjusting the gain of the lost frame is further explained.
  • FIG. 4 is a flowchart of Embodiment 2 of a method for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 4, the method in this embodiment includes:
  • Step S401 Obtain an energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame according to the low-band signal energy of the currently lost frame.
  • the gain adjustment information includes a low frequency band signal energy of the frame.
  • the gain of the current lost frame is adjusted according to the gain adjustment information, the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is first acquired.
  • the low-band signal energy of the current lost frame can be obtained according to the recovered low-band signal of the current lost frame, and the low-band signal energy of the previous frame of the currently lost frame can also be obtained according to the low-band signal energy of the previous frame of the currently lost frame. Got it.
  • Step S402 adjusting the gain of the current lost frame according to the energy ratio of the low-band signal energy of the current lost frame to the energy of the low-band signal energy of the previous frame of the current lost frame, to obtain the adjustment gain of the current lost frame.
  • the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame reflects the trend of the low-band signal energy of the currently lost frame, and therefore, according to the low-band of the current lost frame.
  • the energy of the low-band signal energy of the previous frame of the current lost frame is adjusted to the gain of the currently lost frame, and the resulting adjusted gain reflects the trend of the low-band signal of the currently lost frame. Therefore, the adjustment gain obtained by the embodiment is used to adjust the high-band signal of the current lost frame, so that the change trend of the frame of the current lost frame is consistent, and the performance of frame loss recovery is improved.
  • FIG. 5 is a flowchart of Embodiment 3 of a method for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 5, the method in this embodiment includes:
  • Step S501 when the number of consecutive dropped frames is equal to 1, and the type of the currently lost frame is not unvoiced and the type of the currently lost frame is not an unvoiced transition, and the low-band signal spectrum tilt of the previous frame of the currently lost frame is less than the first threshold, and the current
  • the energy ratio of the low-band signal energy of the lost frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, the high-frequency excitation energy of the current lost frame is obtained according to the energy of the low-band signal of the currently lost frame. The energy ratio of the high frequency excitation energy of the previous frame of the frame.
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames.
  • the gain adjustment information is satisfied and the following condition: the number of consecutive dropped frames is equal to 1, and the type of the currently lost frame is not unvoiced (UNVOICED_CLAS) and the type of the currently lost frame Not the unvoiced transition (UNVOICED_TRANSITION), and the low-band signal spectrum of the previous frame of the current lost frame is less than the first threshold, and the energy of the low-band signal energy of the currently lost frame and the energy of the low-band signal energy of the previous frame of the currently lost frame The ratio is in the preset interval.
  • the first threshold may be a preset value.
  • the first threshold may be set to 8.
  • the significance of the low-band signal spectrum tilt of the previous frame of the current lost frame being less than the first threshold is that the current lost frame
  • the low-band signal of the previous frame cannot be changed too fast, otherwise the accuracy of correcting the gain of the currently lost frame using the low-band signal will be reduced.
  • the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is located in the preset interval, and the meaning of the low-band signal energy of the currently lost frame and the low-frequency of the previous frame of the currently lost frame.
  • the signal energy gap should not be too large, otherwise it will affect the accuracy of correcting the current lost frame.
  • the preset interval may be generally set such that the low-band signal energy of the current lost frame is greater than half of the low-band signal energy of the previous frame of the current lost frame, and the low-band signal energy of the currently lost frame is smaller than the previous frame of the currently lost frame. Double the energy of the low band signal.
  • Step S502 adjusting the gain of the current lost frame according to the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame and the high frequency excitation energy of the current lost frame, to obtain the adjustment gain of the current lost frame.
  • the gain of the current lost frame is adjusted according to the energy ratio of the high frequency excitation energy of the current lost frame to the high frequency excitation energy of the previous frame of the current lost frame.
  • prev_ener_ratio denote the ratio of the high frequency excitation energy of the previous frame of the lost frame to the high frequency excitation energy ratio of the lost frame.
  • the gain of the current lost frame is adjusted according to the relationship between the prev_ener_ratio and the gain of the current lost frame. For example, in this embodiment, it is assumed that the gain of the currently lost frame is G, and the adjustment gain of the currently lost frame is G'.
  • FIG. 6 is a flowchart of Embodiment 4 of a method for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 6, the method in this embodiment includes:
  • Step S601 determining that the number of consecutive lost frames is equal to 1, and the type of the currently lost frame is not unvoiced and the type of the currently lost frame is not an unvoiced transition, and the low-band signal spectrum tilt of the previous frame of the current lost frame is less than the first threshold, and the current
  • the energy ratio of the low-band signal energy of the lost frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum of the current lost frame is inclined more than the low-band signal of the previous frame of the lost frame. The spectrum is tilted.
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames.
  • the gain adjustment information is satisfied and the following condition: the number of consecutive dropped frames is equal to 1, and the type of the currently lost frame is not unvoiced (UNVOICED_CLAS) and the type of the currently lost frame Not the unvoiced transition (UNVOICED_TRANSITION), and the low-band signal spectrum of the previous frame of the current lost frame is less than the first threshold, and the energy of the low-band signal energy of the currently lost frame and the energy of the low-band signal energy of the previous frame of the currently lost frame The ratio is in the preset interval.
  • the first threshold may be a preset value.
  • the first threshold may be set to 8.
  • the significance of the low-band signal spectrum tilt of the previous frame of the current lost frame being less than the first threshold is that the low-band signal of the previous frame of the current lost frame cannot be changed too fast, otherwise the gain of the currently lost frame is corrected using the low-band signal. The accuracy will be reduced.
  • the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is located in the preset interval, and the meaning of the low-band signal energy of the currently lost frame and the low-frequency of the previous frame of the currently lost frame. The signal energy gap should not be too large, otherwise it will affect the accuracy of correcting the current lost frame.
  • the preset interval may be generally set such that the low-band signal energy of the current lost frame is greater than half of the low-band signal energy of the previous frame of the current lost frame, and the low-band signal energy of the currently lost frame is smaller than the previous frame of the currently lost frame. Double the energy of the low band signal.
  • Step S602 adjusting the gain of the current lost frame according to a preset adjustment factor, to obtain an adjustment gain of the current lost frame.
  • the gain of the current lost frame is adjusted according to a preset adjustment factor.
  • G' G ⁇ f.
  • f is a preset adjustment factor
  • f is equal to the ratio of the low-band signal spectrum tilt of the current lost frame to the low-band signal spectrum tilt of the previous frame of the current lost frame.
  • FIG. 7 is a flowchart of Embodiment 5 of a method for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 7, the method in this embodiment includes:
  • Step S701 when the number of consecutive dropped frames is equal to 1, and the type of the currently lost frame is not unvoiced and The low-band signal spectrum tilt of the previous frame of the previous lost frame is greater than the first threshold, and the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is located in a preset interval, according to The low-band signal energy of the currently lost frame yields the energy ratio of the high-frequency excitation energy of the previous frame of the current lost frame to the high-frequency excitation energy of the currently lost frame.
  • the gain adjustment information includes a type of the frame, a low-band signal spectrum tilt of the frame, and a continuous number of dropped frames.
  • the gain adjustment information is satisfied and the following condition is: the number of consecutive dropped frames is equal to 1, and the type of the currently lost frame is not unvoiced and the previous frame of the currently lost frame is The low-band signal spectrum is tilted by more than the first threshold, and the energy ratio of the low-band signal energy of the currently lost frame to the low-band signal energy of the previous frame of the currently lost frame is located in a preset interval.
  • the first threshold may be a preset value.
  • the first threshold may be set to 8.
  • the significance of the low-band signal spectrum tilt of the previous frame of the current lost frame being greater than the first threshold is that the low-band signal of the previous frame of the current lost frame changes faster, and the gain of the currently lost frame using the low-band signal is reduced.
  • the weight of the correction is located in the preset interval, and the meaning of the low-band signal energy of the currently lost frame and the low-frequency of the previous frame of the currently lost frame.
  • the signal energy gap should not be too large, otherwise it will affect the accuracy of correcting the current lost frame.
  • the preset interval may be generally set such that the low-band signal energy of the current lost frame is greater than half of the low-band signal energy of the previous frame of the current lost frame, and the low-band signal energy of the currently lost frame is smaller than the previous frame of the currently lost frame. Double the energy of the low band signal.
  • Step S702 adjusting the gain of the current lost frame according to the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame, to obtain the adjustment gain of the current lost frame.
  • FIG. 8 is a flowchart of Embodiment 6 of a method for processing a lost frame according to an embodiment of the present invention, such as As shown in FIG. 8, the method of this embodiment includes:
  • Step S801 obtaining an energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame according to the low frequency band signal energy of the currently lost frame.
  • the gain adjustment information includes consecutive frames lost. First, according to the low-band signal energy of the current lost frame, the energy ratio of the high-frequency excitation energy of the previous frame of the current lost frame to the high-frequency excitation energy of the currently lost frame is obtained.
  • Step S802 when the continuous frame loss number is greater than 1 and the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame is greater than the gain of the current lost frame, according to the previous one of the current lost frame.
  • the energy of the high frequency excitation energy of the frame and the energy of the high frequency excitation energy of the currently lost frame are adjusted to the gain of the current lost frame, and the adjustment gain of the current lost frame is obtained.
  • the gain of the current lost frame is adjusted according to the gain adjustment information, it is first determined whether the gain adjustment information is satisfied, and the following condition is: the continuous frame loss number is greater than 1 and the high frequency excitation energy of the previous frame of the current lost frame is current The energy ratio of the high frequency excitation energy of the lost frame is greater than the gain of the current lost frame.
  • the second threshold may be a preset one.
  • the threshold is, for example, 10.
  • FIG. 9 is a flowchart of Embodiment 7 of a method for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 9, the method in this embodiment includes:
  • Step S901 Obtain an energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame according to the low frequency band signal energy of the currently lost frame.
  • the gain adjustment information includes a continuous frame loss number and a low frequency band signal spectrum tilt of the frame.
  • Step S902 when the number of consecutive lost frames is greater than 1, the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame is greater than the gain of the current lost frame and the low frequency band signal spectrum of the current lost frame.
  • the slope and the low-band signal spectrum of the previous frame of the currently lost frame are both greater than the second threshold, the current lost frame is compared with the energy of the high-frequency excitation energy of the previous frame of the current lost frame and the energy of the high-frequency excitation energy of the currently lost frame. The gain is adjusted to obtain the adjustment gain of the currently lost frame.
  • the gain of the current lost frame is adjusted according to the gain adjustment information, it is first determined whether the gain adjustment information is satisfied, and the following condition is: the continuous frame loss number is greater than 1 and the high frequency excitation energy of the previous frame of the current lost frame is current The energy ratio of the high frequency excitation energy of the lost frame is greater than the gain of the current lost frame.
  • the second threshold may be a preset threshold. , for example, 10.
  • FIG. 10 is a flowchart of Embodiment 8 of a method for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 10, the method in this embodiment includes:
  • Step S1001 determining an initial high frequency band signal of the currently lost frame.
  • step S1002 the gain of the currently lost frame is determined.
  • Step S1003 determining gain adjustment information of the currently lost frame, the gain adjustment information packet At least one of the following types: the type of the frame, the slope of the low-band signal spectrum of the frame, the energy of the low-band signal of the frame, and the number of consecutive dropped frames, wherein the number of consecutive dropped frames is the number of consecutively lost frames until the current lost frame.
  • step S1004 an initial incentive adjustment factor is determined.
  • the present embodiment further adjusts the high-band excitation signal of the currently lost frame on the basis of the embodiment shown in FIG. 3, so as to more accurately adjust the currently lost frame.
  • the excitation adjustment factor is a factor used to adjust the high-band excitation signal of the currently lost frame, and the initial excitation adjustment factor is derived from the subframe gain and global gain of the lost frame.
  • step S1005 the initial excitation adjustment factor is adjusted according to the gain correction information to obtain an adjusted excitation adjustment factor.
  • the initial excitation adjustment factor may be adjusted according to the gain adjustment information
  • the specific adjustment method may be preset at the decoding end of the audio signal, and after the decoding end determines the gain adjustment information, the gain adjustment information is determined, and if the corresponding The preset condition is adjusted according to the adjustment method corresponding to the preset condition, and finally the adjusted excitation adjustment factor is obtained.
  • Step S1006 Adjust the gain of the current lost frame according to the gain adjustment information to obtain an adjustment gain of the current lost frame.
  • Step S1007 Adjust the initial high frequency band signal according to the adjusted gain and the adjusted excitation adjustment factor to obtain a high frequency band signal of the current lost frame.
  • the high-band signal is a product of the high-band excitation signal and the gain. Therefore, the high-band excitation signal can be adjusted according to the excitation adjustment factor, and the high-band excitation signal is also performed according to the adjustment gain. Adjust, and finally get the high frequency band signal of the current lost frame.
  • step S1005 the initial excitation adjustment factor is adjusted according to the gain correction information, and the specific method for obtaining the adjusted excitation adjustment factor may be as shown in the following implementation manners.
  • step S1005 includes: when the number of consecutive dropped frames is equal to 1, the high frequency excitation energy of the current lost frame is greater than the high frequency excitation energy of the previous frame of the current lost frame, and the type of the currently lost frame is not
  • the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame.
  • the excitation adjustment factor includes the type of the frame, the low-band signal energy of the frame, and the number of consecutive dropped frames.
  • the gain adjustment information includes the type of the frame, the low-band signal energy of the frame, and the number of consecutive dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition is: the number of consecutive lost frames is equal to 1, and the high frequency excitation energy of the current lost frame is greater than the height of the previous frame of the current lost frame.
  • the frequency is energized, and the type of the currently lost frame is not unvoiced and the type of the last normal received frame before the current lost frame is not unvoiced.
  • the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame.
  • the last normal received frame before the current lost frame indicates the last frame that was not lost before the current lost frame. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame.
  • step S1005 includes: when the number of consecutive dropped frames is equal to 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and is currently lost.
  • the energy ratio of the low-band signal energy of the frame to the low-band signal energy of the previous frame of the current lost frame is in a preset interval, and the type of the previous frame of the current lost frame is unvoiced, according to the previous frame of the currently lost frame.
  • the low-band signal energy is adjusted with the low-band signal energy of the currently lost frame to adjust the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes the type of the frame, the low-band signal energy of the frame, and the number of consecutive dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition: the number of consecutive lost frames is equal to 1, and the high frequency excitation energy of the current lost frame is smaller than the previous frame of the current lost frame.
  • the energy ratio is in the preset interval, and the type of the previous frame of the currently lost frame is unvoiced.
  • the preset interval may be set to be that the low-band signal energy of the current lost frame is greater than half of the low-band signal energy of the previous frame of the current lost frame, and the low-band signal energy of the currently lost frame is smaller than the previous one of the currently lost frame.
  • the frame's low-band signal energy is twice. If it is judged that the above condition is satisfied at the same time, the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame.
  • step S1005 includes: when the number of consecutive dropped frames is equal to 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and is currently lost.
  • the energy ratio of the low-band signal energy of the frame to the low-band signal energy of the previous frame of the currently lost frame is in a preset interval, and the type of the last normal received frame before the current lost frame is unvoiced, according to the current lost frame.
  • the initial excitation adjustment factor is adjusted by the low-band signal energy of one frame and the low-band signal energy of the currently lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes the type of the frame, the low-band signal energy of the frame, and the number of consecutive dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition: the number of consecutive lost frames is equal to 1, and the high frequency excitation energy of the current lost frame is smaller than the previous frame of the current lost frame.
  • Half of the high-frequency excitation energy, and the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is in a preset interval, and the type of the last normal received frame before the current lost frame It is unvoiced.
  • the last normal received frame before the current lost frame indicates the last frame that is not lost before the current lost frame; the preset interval may be generally set to the low frequency band signal energy of the current lost frame is greater than the low frequency of the previous frame of the current lost frame. Half of the signal energy is present, and the low band signal energy of the currently lost frame is less than twice the energy of the low band signal of the previous frame of the current lost frame. If it is judged that the above condition is satisfied at the same time, the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame.
  • step S1005 includes: when the number of consecutive dropped frames is equal to 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and is currently lost.
  • the energy ratio of the low-band signal energy of the frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum tilt of the previous frame of the current lost frame is greater than the third threshold, according to the current loss
  • the initial excitation adjustment factor is adjusted by the low-band signal energy of the previous frame of the frame and the low-band signal energy of the currently lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition: the number of consecutive lost frames is equal to 1, and the high frequency excitation energy of the current lost frame is smaller than the previous frame of the current lost frame.
  • Half of the high-frequency excitation energy, and the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is in a preset interval, and the low-band signal spectrum of the previous frame of the currently lost frame
  • the tilt is greater than the third threshold.
  • the preset interval may be set to be that the low-band signal energy of the current lost frame is greater than half of the low-band signal energy of the previous frame of the current lost frame, and the low-band signal energy of the currently lost frame is smaller than the previous one of the currently lost frame.
  • the energy of the low-band signal of the frame is twice; the third threshold may be a preset threshold, for example, 5. If it is judged that the above condition is satisfied at the same time, the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame.
  • step S1005 includes: when the consecutive frame loss number is greater than 1 and the high frequency excitation energy of the current lost frame is greater than the high frequency excitation energy of the previous frame of the current lost frame, according to the current lost frame
  • the initial excitation adjustment factor is adjusted by the low-band signal energy of the previous frame and the low-band signal energy of the currently lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a low band signal energy of the frame and a continuous number of dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition is: the number of consecutive lost frames is greater than 1 and the high frequency excitation energy of the current lost frame is greater than the height of the previous frame of the current lost frame. Frequency excitation energy. If it is judged that the above conditions are satisfied at the same time, the low-band signal energy of the previous frame of the current lost frame and the low-band signal of the lost frame are The energy of the initial adjustment factor is adjusted. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame.
  • step S1005 includes: when the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and is currently lost.
  • the energy ratio of the low-band signal energy of the frame to the low-band signal energy of the previous frame of the current lost frame is in a preset interval, and the type of the previous frame of the current lost frame is unvoiced, according to the previous frame of the currently lost frame.
  • the low-band signal energy is adjusted with the low-band signal energy of the currently lost frame to adjust the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes the type of the frame, the low-band signal energy of the frame, and the number of consecutive dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition is: the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is smaller than the previous frame of the current lost frame.
  • the energy of the high frequency excitation energy is half, and the energy ratio of the low frequency band signal energy of the current lost frame to the low frequency band signal energy of the previous frame of the current lost frame is in a preset interval, and the type of the previous frame of the current lost frame is unvoiced.
  • the preset interval may be set to be that the low-band signal energy of the current lost frame is greater than half of the low-band signal energy of the previous frame of the current lost frame, and the low-band signal energy of the currently lost frame is smaller than the previous one of the currently lost frame.
  • the frame's low-band signal energy is twice. If it is judged that the above condition is satisfied at the same time, the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame, and the smaller of 3.
  • step S1005 includes: when the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and is currently lost.
  • the energy ratio of the low-band signal energy of the frame to the low-band signal energy of the previous frame of the currently lost frame is in a preset interval, and the type of the last normal received frame before the current lost frame is unvoiced, according to the current lost frame.
  • the initial excitation adjustment factor is adjusted by the low-band signal energy of one frame and the low-band signal energy of the currently lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes the type of the frame, the low-band signal energy of the frame, and the number of consecutive dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition is: the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is smaller than the previous frame of the current lost frame.
  • Half of the high-frequency excitation energy, and the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is in a preset interval, and the type of the last normal received frame before the current lost frame It is unvoiced.
  • the last normal received frame before the current lost frame indicates the last frame that is not lost before the current lost frame; the preset interval may be generally set to the low frequency band signal energy of the current lost frame is greater than the low frequency of the previous frame of the current lost frame. Half of the signal energy is present, and the low band signal energy of the currently lost frame is less than twice the energy of the low band signal of the previous frame of the current lost frame. If it is judged that the above condition is satisfied at the same time, the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame, and the smaller of 3.
  • step S1005 includes: when the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and is currently lost.
  • the energy ratio of the low-band signal energy of the frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum tilt of the previous frame of the current lost frame is greater than the third threshold, according to the current loss
  • the initial excitation adjustment factor is adjusted by the low-band signal energy of the previous frame of the frame and the low-band signal energy of the currently lost frame to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames.
  • the initial excitation adjustment factor is adjusted according to the gain correction information, it is first determined whether the gain adjustment information is satisfied and the following condition is: the consecutive frame loss number is greater than 1, and the high frequency excitation energy of the current lost frame is smaller than the previous frame of the current lost frame.
  • Half of the high-frequency excitation energy, and the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the currently lost frame is in a preset interval, and the low-band signal spectrum of the previous frame of the currently lost frame
  • the tilt is greater than the third threshold.
  • the preset interval may be generally set to be one of the low-band signal energy of the current lost frame is greater than the low-band signal energy of the previous frame of the currently lost frame.
  • Half, and the low-band signal energy of the currently lost frame is less than twice the energy of the low-band signal of the previous frame of the currently lost frame;
  • the third threshold may be a preset threshold, for example, 5. If it is judged that the above condition is satisfied at the same time, the initial excitation adjustment factor is adjusted according to the low-band signal energy of the previous frame of the current lost frame and the low-band signal energy of the lost frame. For example, let the initial excitation adjustment factor be scale and the adjusted excitation adjustment factor be scale'. Then, scale' is equal to the ratio of the low band energy of the previous frame of the current lost frame to the low band energy of the currently lost frame, and the smaller of 3.
  • the method for processing a lost frame provided by this embodiment, only the low-band signal spectrum tilt, the low-band signal energy ratio, the high-frequency excitation energy ratio, the frame type of the lost frame, and the like of the lost frame and the previous frame of the lost frame are shown.
  • a specific method for correcting the lost frame gain and the excitation adjustment factor but the method for processing the lost frame provided by the present invention is not limited thereto, as long as the loss is corrected according to the low frequency band information and the coding type information of the lost frame and the at least one frame before the lost frame.
  • the frame loss processing method of the high frequency band information of the frame is within the protection scope of the present invention.
  • the method for processing a lost frame provided by the embodiment of the present invention can guide the recovery of a lost frame in a high frequency band based on the relationship between the low frequency bands of the preceding and succeeding frames, and the method can restore the lost frame high frequency energy in the case where the information recovery in the low frequency band is accurate. It is more continuous, solves the situation that the energy recovery in the high frequency band is discontinuous, and improves the performance of the lost frame high frequency band.
  • FIG. 11 is a schematic structural diagram of an apparatus for processing a lost frame according to an embodiment of the present invention. As shown in FIG. 11, the apparatus for processing a lost frame in this embodiment includes:
  • a determining module 111 configured to determine an initial high frequency band signal of the current lost frame; determining a gain of the current lost frame; determining gain adjustment information of the current lost frame, the gain adjustment information including at least one of the following: a frame Type, the low-band signal spectrum of the frame is tilted, the low-band signal energy of the frame, the number of consecutive dropped frames, wherein the consecutive lost frames is the number of consecutively lost frames until the current lost frame;
  • the adjusting module 112 is configured to adjust the gain of the current lost frame according to the gain adjustment information to obtain an adjustment gain of the current lost frame, and adjust the initial high frequency band signal according to the adjusted gain to obtain The high band signal of the currently lost frame.
  • the device for processing a lost frame provided in this embodiment is used to perform the technical solution of the method embodiment shown in FIG. 3, and the implementation principle and the technical effect are similar, and details are not described herein again.
  • the gain adjustment information includes a low-band signal energy of a frame
  • the adjusting module 112 is configured to obtain a low frequency of the current lost frame according to the low-band signal energy of the current lost frame.
  • An energy ratio of the signal energy to the low-band signal energy of the previous frame of the current lost frame; the energy of the low-band signal energy of the previous frame of the current lost frame and the energy of the low-band signal energy of the previous frame of the currently lost frame Adjusting the gain of the current lost frame to obtain an adjustment gain of the current lost frame.
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjustment module 112 is specifically configured to be used in the The number of consecutive lost frames is equal to 1, and the type of the current lost frame is not unvoiced and the type of the current lost frame is not an unvoiced transition, and the low-band signal spectrum tilt of the previous frame of the current lost frame is less than the first threshold.
  • the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the energy is obtained according to the low-band signal energy of the current lost frame.
  • the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame; the high frequency excitation energy of the previous frame of the current lost frame and the height of the current lost frame The energy of the frequency excitation energy is adjusted to the gain of the current lost frame to obtain an adjustment gain of the current lost frame.
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjustment module 112 is specifically configured to be used in the The number of consecutive lost frames is equal to 1, and the type of the current lost frame is not unvoiced and the type of the current lost frame is not an unvoiced transition, and the low-band signal spectrum tilt of the previous frame of the current lost frame is less than the first threshold.
  • the energy ratio of the low-band signal energy of the current lost frame to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, and the low-band signal spectrum of the current lost frame is inclined more than When the low-band signal spectrum of the previous frame of the lost frame is tilted, the gain of the current lost frame is adjusted according to a preset adjustment factor to obtain an adjustment gain of the current lost frame.
  • the gain adjustment information includes a type of a frame, a low-band signal spectrum tilt of the frame, and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive lost frames is equal to 1 And the type of the current lost frame is not unvoiced and the low frequency band signal spectrum of the previous frame of the current lost frame is greater than a first threshold, and the low frequency band of the current lost frame
  • the energy ratio of the signal energy to the low-band signal energy of the previous frame of the current lost frame is located in a preset interval, the high-frequency of the previous frame of the current lost frame is obtained according to the low-band signal energy of the currently lost frame.
  • An energy ratio of the excitation energy to the high frequency excitation energy of the current lost frame comparing the energy of the high frequency excitation energy of the previous frame of the current lost frame with the energy of the high frequency excitation energy of the current lost frame The gain of the lost frame is adjusted to obtain an adjustment gain of the currently lost frame.
  • the gain adjustment information includes a continuous number of dropped frames
  • the adjusting module 112 is configured to obtain a previous frame of the current lost frame according to the low-band signal energy of the currently lost frame.
  • Energy ratio of the high frequency excitation energy to the high frequency excitation energy of the current lost frame when the consecutive frame loss number is greater than 1 and the high frequency excitation energy of the previous frame of the current lost frame and the current lost frame
  • the energy ratio of the high frequency excitation energy is greater than the gain of the current lost frame
  • the energy is compared with the energy of the high frequency excitation energy of the previous frame of the current lost frame and the high frequency excitation energy of the current lost frame.
  • the gain of the currently lost frame is adjusted to obtain an adjustment gain of the current lost frame.
  • the gain adjustment information includes a continuous frame loss number and a low frequency band signal spectrum tilt of the frame
  • the adjustment module 112 is specifically configured to obtain the energy according to the low frequency band signal energy of the current lost frame.
  • An energy ratio of the excitation energy to the high frequency excitation energy of the current lost frame is greater than a gain of the current lost frame and a low frequency band signal spectrum tilt of the current lost frame and a low frequency band signal of a previous frame of the current lost frame
  • the gain of the current lost frame according to the energy ratio of the high frequency excitation energy of the previous frame of the current lost frame to the high frequency excitation energy of the current lost frame, The adjustment gain of the current lost frame.
  • the determining module 111 is further configured to determine an initial excitation adjustment factor, and the adjusting module 111 is further configured to adjust the initial excitation adjustment factor according to the gain correction information, and obtain the adjusted And an excitation adjustment factor; adjusting the initial high frequency band signal according to the adjusted gain and the adjusted excitation adjustment factor to obtain a high frequency band signal of the current lost frame.
  • the gain adjustment information includes a type of a frame, The low-band signal energy of the frame and the continuous number of dropped frames, the adjusting module 112 is specifically configured to: when the consecutive number of dropped frames is equal to 1, the high-frequency excitation energy of the current lost frame is greater than the previous frame of the current lost frame High frequency excitation energy, and the type of the current lost frame is not unvoiced and the type of the last normal received frame before the current lost frame is not unvoiced, according to the low frequency band signal energy of the previous frame of the current lost frame The low frequency band signal energy of the current lost frame adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive number of dropped frames is equal to 1, And the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low frequency band signal energy of the current lost frame and the previous frame of the current lost frame
  • the energy ratio of the low-band signal energy is in a preset interval, and the type of the previous frame of the current lost frame is unvoiced, according to the low-band signal energy of the previous frame of the current lost frame and the current lost frame.
  • the low-band signal energy adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive number of dropped frames is equal to 1, And the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low frequency band signal energy of the current lost frame and the previous frame of the current lost frame
  • the energy ratio of the low-band signal energy is in a preset interval, and the type of the last normal received frame before the current lost frame is unvoiced, according to the low-band signal energy of the previous frame of the current lost frame and the The low-band signal energy of the currently lost frame adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive frame-dropping The number is equal to 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low band signal energy of the current lost frame and the current lost frame
  • the energy ratio of the low-band signal energy of the previous frame is located in a preset interval, and the slope of the low-band signal spectrum of the previous frame of the current lost frame is greater than the third threshold, according to the previous frame of the current lost frame Adjusting the initial excitation adjustment factor by the low-band signal energy and the low-band signal energy of the current lost frame to obtain an adjusted Incentive adjustment factor.
  • the gain adjustment information includes a low-band signal energy of the frame and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive dropped frames is greater than 1 and the current lost When the high frequency excitation energy of the frame is greater than the high frequency excitation energy of the previous frame of the current lost frame, the energy of the low frequency band signal energy of the previous frame of the current lost frame and the low frequency band signal energy of the current lost frame
  • the initial excitation adjustment factor is adjusted to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive lost frames is greater than 1, And the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low frequency band signal energy of the current lost frame and the previous frame of the current lost frame
  • the energy ratio of the low-band signal energy is in a preset interval, and the type of the previous frame of the current lost frame is unvoiced, according to the low-band signal energy of the previous frame of the current lost frame and the current lost frame.
  • the low-band signal energy adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a type of a frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive lost frames is greater than 1, And the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low frequency band signal energy of the current lost frame and the previous frame of the current lost frame
  • the energy ratio of the low-band signal energy is in a preset interval, and the type of the last normal received frame before the current lost frame is unvoiced, according to the low-band signal energy of the previous frame of the current lost frame and the The low-band signal energy of the currently lost frame adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the gain adjustment information includes a low-band signal spectrum tilt of the frame, a low-band signal energy of the frame, and a continuous number of dropped frames
  • the adjusting module 112 is specifically configured to: when the consecutive frame-dropping The number is greater than 1, and the high frequency excitation energy of the current lost frame is less than half of the high frequency excitation energy of the previous frame of the current lost frame, and the low band signal energy of the current lost frame and the current lost frame
  • the energy ratio of the low-band signal energy of the previous frame is located in a preset interval, and the slope of the low-band signal spectrum of the previous frame of the current lost frame is greater than the third threshold, according to the previous frame of the current lost frame Low band signal energy and the current loss
  • the low-band signal energy of the frame adjusts the initial excitation adjustment factor to obtain an adjusted excitation adjustment factor.
  • the aforementioned program can be stored in a computer readable storage medium.
  • the program when executed, performs the steps including the foregoing method embodiments; and the foregoing storage medium includes various media that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Telephone Function (AREA)
  • Tone Control, Compression And Expansion, Limiting Amplitude (AREA)
  • Circuits Of Receivers In General (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例提供一种处理丢失帧的方法和装置，一种处理丢失帧的方法包括：确定当前丢失帧的初始高频带信号；确定所述当前丢失帧的增益；确定所述当前丢失帧的增益调整信息，所述增益调整信息包括以下至少一种：帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中所述连续丢帧数为到所述当前丢失帧为止连续丢失的帧数；根据所述增益调整信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益；根据所述调整增益对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。本发明实施例提供的处理丢失帧的方法和装置，用于提高音频信号丢帧恢复的性能。

Description

处理丢失帧的方法和装置 技术领域
本发明实施例涉及通信技术领域，尤其涉及一种处理丢失帧的方法和装置。
背景技术
随着通信技术的发展，用户对于语音通话质量的要求越来越高，提高语音通话质量的主要方法是提高语音信号的带宽。若采用传统的编码方式进行编码来增加语音信号的带宽会大大提高码率，但提高码率则需要更大的网络带宽来传输该语音信号，由于网络带宽的限制，单纯以提高码率增加语音信号带宽的方法很难在实际应用中使用。
为了在码率不变或变化不大的情况下编码带宽更宽的语音信号，目前主要采用频带扩展技术，频带扩展技术分为时域频带扩展技术和频域频带扩展技术。另外，在语音信号进行传输的过程中，丢包率是影响语音信号质量的关键因素，因此，如何在丢包发生时尽可能正确地恢复出丢失的帧，使得当发生丢帧时信号的过渡能够更加自然平稳是语音信号传输的重要技术。
但是在采用频带扩展技术时，若语音信号出现丢帧，现有的丢帧恢复方法可能导致恢复出的丢失帧与前后帧的过渡不连续，从而导致语音信号出现杂音。
发明内容
本发明实施例提供一种处理丢失帧的方法和装置，用于提高音频信号丢帧恢复的性能。
第一方面提供一种处理丢失帧的方法，包括：
确定当前丢失帧的初始高频带信号；
确定所述当前丢失帧的增益；
确定所述当前丢失帧的增益调整信息，所述增益调整信息包括以下至少一种：
帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中所述连续丢帧数为到所述当前丢失帧为止连续丢失的帧数；
根据所述增益调整信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益；
根据所述调整增益对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
结合第一方面，在第一方面的第一种可能的实现方式中，所述增益调整信息包括帧的低频带信号能量，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比；
根据所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第一方面，在第一方面的第二种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
当所述连续丢帧数等于1，且
所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，
根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第一方面，在第一方面的第三种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量 和连续丢帧数，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
当所述连续丢帧数等于1，且
所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，
且所述当前丢失帧的低频带信号谱倾斜大于所述丢失帧的前一帧的低频带信号谱倾斜时，
根据预设的调整因子对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第一方面，在第一方面的第四种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜和连续丢帧数，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
当所述连续丢帧数等于1，且
所述当前丢失帧的类型不是清音且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，
根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第一方面，在第一方面的第五种可能的实现方式中，所述增益调整信息包括连续丢帧数，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
当所述连续丢帧数大于1且所述当前丢失帧的前一帧的高频激励能量 与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益时，
根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第一方面，在第一方面的第六种可能的实现方式中，所述增益调整信息包括连续丢帧数和帧的低频带信号谱倾斜，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
当所述连续丢帧数大于1、所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益且所述当前丢失帧的低频带信号谱倾斜和所述当前丢失帧的前一帧的低频带信号谱都大于第二阈值时，
根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第一方面至第一方面的第六种可能的实现方式中任一种可能的实现方式，在第一方面的第七种可能的实现方式中，所述确定所述当前丢失帧的增益调整信息之后，还包括：
确定初始激励调整因子；
根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子；
所述根据所述调整增益对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号，包括：
根据所述调整增益和所述调整后的激励调整因子对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
结合第一方面的第七种可能的实现方式，在第一方面的第八种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量 和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数等于1，所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量，且
所述当前丢失帧的类型不是清音且所述当前丢失帧前的最后一个正常接收帧的类型不是清音时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第一方面的第七种可能的实现方式，在第一方面的第九种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第一方面的第七种可能的实现方式，在第一方面的第十种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧 的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第一方面的第七种可能的实现方式，在第一方面的第十一种可能的实现方式中，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第一方面的第七种可能的实现方式，在第一方面的第十二种可能的实现方式中，所述增益调整信息包括帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数大于1且所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第一方面的第七种可能的实现方式，在第一方面的第十三种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位 于预设区间，且所述当前丢失帧的前一帧的类型是清音时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第一方面的第七种可能的实现方式，在第一方面的第十四种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第一方面的第七种可能的实现方式，在第一方面的第十五种可能的实现方式中，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，
根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
第二方面提供一种处理丢失帧的装置，所述处理丢失帧的装置包括：
确定模块，用于确定当前丢失帧的初始高频带信号；确定所述当前丢失帧的增益；确定所述当前丢失帧的增益调整信息，所述增益调整信息包括以下至少一种：帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中所述连续丢帧数为到所述当前丢失帧为止连续丢失的帧数；
调整模块，用于根据所述增益调整信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益；根据所述调整增益对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
结合第二方面，在第二方面的第一种可能的实现方式中，所述增益调整信息包括帧的低频带信号能量，所述调整模块，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比；根据所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第二方面，在第二方面的第二种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第二方面，在第二方面的第三种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、 且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，且所述当前丢失帧的低频带信号谱倾斜大于所述丢失帧的前一帧的低频带信号谱倾斜时，根据预设的调整因子对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第二方面，在第二方面的第四种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第二方面，在第二方面的第五种可能的实现方式中，所述增益调整信息包括连续丢帧数，所述调整模块，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；当所述连续丢帧数大于1且所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益时，根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第二方面，在第二方面的第六种可能的实现方式中，所述增益调整信息包括连续丢帧数和帧的低频带信号谱倾斜，所述调整模块，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；当所述连续丢帧数大于1、所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益且所述当前丢失帧的低频带信号谱倾斜和所述当前丢失帧的前一帧的低频带信号 谱都大于第二阈值时，根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
结合第二方面至第二方面的第六种可能的实现方式中任一种可能的实现方式，在第二方面的第七种可能的实现方式中，所述确定模块，还用于确定初始激励调整因子；
所述调整模块，还用于根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子；根据所述调整增益和所述调整后的激励调整因子对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
结合第二方面的第七种可能的实现方式，在第二方面的第八种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数等于1，所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量，且所述当前丢失帧的类型不是清音且所述当前丢失帧前的最后一个正常接收帧的类型不是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第二方面的第七种可能的实现方式，在第二方面的第九种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第二方面的第七种可能的实现方式，在第二方面的第十种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数等于1，且所 述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第二方面的第七种可能的实现方式，在第二方面的第十一种可能的实现方式中，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第二方面的第七种可能的实现方式，在第二方面的第十二种可能的实现方式中，所述增益调整信息包括帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数大于1且所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第二方面的第七种可能的实现方式，在第二方面的第十三种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行 调整，得到调整后的激励调整因子。
结合第二方面的第七种可能的实现方式，在第二方面的第十四种可能的实现方式中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
结合第二方面的第七种可能的实现方式，在第二方面的第十五种可能的实现方式中，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，所述调整模块，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
本发明实施例提供的处理丢失帧的方法和装置，在音频数据发生丢帧时，根据丢失帧的低频带信号对丢失帧的高频带信号进行了调整，从而使恢复的丢失帧高低频段帧间变化趋势一致，提高了丢帧恢复的性能。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为采用时域频带扩展技术进行音频信号编码的原理图；
图2为采用时域频带扩展技术进行音频信号解码的原理图；
图3为本发明实施例提供的处理丢失帧的方法实施例一的流程图；
图4为本发明实施例提供的处理丢失帧的方法实施例二的流程图；
图5为本发明实施例提供的处理丢失帧的方法实施例三的流程图；
图6为本发明实施例提供的处理丢失帧的方法实施例四的流程图；
图7为本发明实施例提供的处理丢失帧的方法实施例五的流程图；
图8为本发明实施例提供的处理丢失帧的方法实施例六的流程图；
图9为本发明实施例提供的处理丢失帧的方法实施例七的流程图；
图10为本发明实施例提供的处理丢失帧的方法实施例八的流程图；
图11为本发明实施例提供的处理丢失帧的装置的结构示意图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
为了在码率不变或变化不大的情况下编码带宽更宽的语音信号，目前主要采用频带扩展技术。频带扩展技术的原理是：发送端将信号分割为高频带和低频带两个部分，其中将低频带部分使用编码器进行编码，而对于高频带部分仅提取部分信息以及高低频带相关参数等信息；接收端根据低频带部分的信号和高频带部分的相关信息以及高低频带相关参数将整个语音信号恢复。
一般来说，在频带扩展技术中，当语音信号传输出现丢帧时，使用丢失帧前N帧(N大于等于1)的信息来恢复丢失帧。其中丢失帧的低频带部分可以根据丢失帧前一帧的低频带信息进行恢复，丢失帧的高频带部分是根据语音信号的全局增益因子和子帧增益衰减因子进行恢复。但全局增益因子和子帧增益衰减因子都是基于在编码端对原始语音信号的高频带部分进行编码得到的，并没有使用原始语音信号的低频带部分进行高频带部分的丢帧恢复 处理。而当丢帧发生时，如果丢失帧的低频带能量变化趋势与高频带能量变化趋势不一致，则会导致恢复出的帧与前后帧的能量过渡不连续，从而导致语音信号中出现杂音。
图1为采用时域频带扩展技术进行音频信号编码的原理图，图2为采用时域频带扩展技术进行音频信号解码的原理图。如图1和图2所示，在编码端，首先编码端采集音频信号101，音频信号101包括低频带部分和高频带部分，其中低频带部分和高频带部分是一个相对的概念，只要将音频信号按照频率划分为从0Hz到W1Hz的部分和从W1Hz到W2Hz的部分，从0Hz到W1Hz的部分即为低频带部分，从W1Hz到W2Hz的部分则为高频带部分。例如对于8kHz采样频率的音频信号，可以将0到4kHz的部分作为低频带部分，而将4kHz到8kHz的部分作为高频带部分；对于16kHz采样频率的音频信号，可以将0到6kHz的部分作为低频带部分，而将6k到16kHz的部分作为高频带部分。然后编码端计算得到音频信号101的低频带部分的参数，这些参数包括音频信号101的基音周期、代数码数、增益等，可以包括上述的一种或多种。为了方便描述本发明的技术方案，统一用编码参数102来表示，可以理解的是，编码参数102只是为了帮助理解本发明实施例而做出的一种示例，而不意味着对编码端使用的参数的具体限制。对于音频信号101的高频带部分，编码端对高频带部分做线性预测编码(Linear Predictive Coding，LPC)，得到高频带LPC系数103。由编码参数102计算得到高频带激励信号104，将高频带LPC系数103作为LPC合成滤波器的滤波系数，将高频带激励信号104经过LPC合成滤波器合成为高频带信号，比较音频信号101的原始高频带部分和合成的高频带信号得到子帧增益(SubGain)105和全局增益(FramGain)106，其中全局增益106是通过比较音频信号101每一帧的的原始高频带部分的能量和合成的高频带信号的能量得出的，子帧增益105是通过比较音频信号101每一帧中各子帧的原始高频带部分的能量和合成的高频带信号的能量得出的。将LPC系数103转化为线谱对频率(Linear Spectral Frequency，LSF)参数107，并将LSF参数107和子帧增益105、全局增益106量化后进行编码。最终编码端根据编码参数102、编码后的LSF参数107、子帧增益105和全局增益106得到编码码 流108，并将编码码流108发送给解码端。
在解码端，解码端解码接收到的编码码流108得到语音信号的基音周期、代数码数、增益等参数，即编码参数102，并且解码端将接收到的编码码流108进行解码及反量化，得到LSF参数107和子帧增益105、全局增益106，并将LSF参数107转化为LPC系数103。由编码参数102计算得到高频带激励信号104，将LPC参数103作为LPC合成滤波器的滤波系数，将高频带激励信号104经过LPC合成滤波器合成为高频带信号，并将合成的高频带信号经过子帧增益105和全局增益106的调整恢复成音频信号101的高频带部分，根据编码参数102进行解码得到音频信号101的低频带部分，将音频信号101的高频带部分和低频带部分合成得到原始的音频信号101。
当音频信号的传输出现丢帧时，根据丢失帧前一帧的编码参数和LSF参数估计丢失帧的编码参数和LSF参数(例如将丢失帧前一帧的编码参数和LSF参数直接作为丢失帧的编码参数和LSF参数)，根据丢失帧前一帧的全局增益、子帧增益和编码类型估计丢失帧的全局增益和子帧增益。这样就可以对估计出的丢失帧的编码参数进行解码从而恢复出丢失帧的低频带部分；并根据估计出的编码参数恢复出丢失帧的高频带激励信号，通过估计出的丢失帧的全局增益和子帧增益恢复出丢失帧的高频带部分，将恢复的低频带部分和高频带部分合成为丢失帧的信号。
根据图1和图2所示的音频信号的编码和解码原理可知，恢复丢失帧的低频带部分使用的是丢失帧前一帧的编码参数，而丢失帧前一帧的编码参数是根据丢失帧前一帧的低频带部分经过编码直接得到的，根据该编码参数可以较好地恢复丢失帧的低频带部分。而恢复丢失帧的高频带部分使用的是丢失帧前一帧的全局增益、子帧增益和编码类型，并且由于丢失帧前一帧的全局增益和子帧增益是通过编码、运算等处理得出的，因此恢复出的丢失帧的高频带部分可能出现误差。
在一种可能的解决方案中，一种恢复丢失帧的高频带部分的方法是对全局增益因子和子帧增益衰减因子进行调整，将丢失帧前一帧的全局增益因子和子帧增益衰减因子乘以固定的衰减因子后作为丢失帧的全局增益因子和子帧增益衰减因子。
在另外一种可能的解决方案中，利用丢失帧前一帧的编码类型、发生丢失帧前最后一个正常帧的编码类型、连续丢帧数、丢失帧前一帧的全局增益因子和子帧增益衰减因子自适应估计丢失帧的全局增益因子和子帧增益衰减因子。其中全局增益因子和子帧增益衰减因子是与全局增益和子帧增益相关的参数。初步恢复丢失帧的高频带部分使用了丢失帧前一帧的高频带信息和低频带信息，而在对初步恢复的丢失帧的高频带部分进行调整时只涉及丢失帧前一帧的高频带信息，当丢失帧的高频带部分和低频带部分的能量变化趋势不一致时，恢复后的丢失帧将导致音频信号整体前后过渡的不连续，从而出现杂音。
本发明实施例提供一种处理丢失帧的方法和装置，在现有技术使用音频信号的高频带部分恢复丢失帧的基础上，进一步地根据音频信号的低频带部分对丢失帧的增益和高频激励进行调整，从而使恢复后的丢失帧高低频段变化趋势保持一致，从而提升丢帧处理的性能。
图3为本发明实施例提供的处理丢失帧的方法实施例一的流程图，如图3所示，本实施例的方法包括：
步骤S301，确定当前丢失帧的初始高频带信号。
具体地，本实施例提供的处理丢失帧的方法应用于音频信号的接收端。首先，音频信号的接收端会接收到发送端发送的音频数据，接收端接收到的音频数据既可以是数据流的方式，也可以是数据包的方式。当接收端接收到的音频数据发生丢帧时，接收端可以侦测到该丢失帧。接收端判断接收到的音频数据是否发生丢帧的方法可以是现有技术的任一种方法，例如在音频数据的每个帧中都设置一个标志位，正常情况下该标志位为0，在发生丢帧时，该标志位会被置为1，接收端在接收到音频数据时对每个帧中的该标志位进行检测，当检测到标志位为1时则可以确定发生丢帧；在另一种可能的方法中，例如可以对音频数据的每一帧依次编号，若解码端接收到的当前帧的编号与接收到的前一帧的编号不连续，则可以确定发生丢帧。本实施例不对确定接收到的音频数据是否出现丢失帧的方法做限制。
确定音频信号出现丢失帧后，需要对丢失帧进行恢复。音频信号的丢失帧可以分为低频带信号和高频带信号两部分，首先使用当前丢失帧 前一帧的低频带信息恢复当前丢失帧的低频带信息，具体地是根据当前丢失帧前一帧的编码参数估计当前丢失帧的编码参数，从而估计出当前丢失帧的低频带部分。可以理解的是，此处所指的丢失帧的前一帧既可以是正常接收到的帧，也可以是根据正常接收到的帧所恢复的帧。然后根据估计的当前丢失帧的编码参数恢复当前丢失帧的高频带激励信号，根据当前丢失帧前一帧的全局增益、子帧增益和编码类型估计当前丢失帧的全局增益和子帧增益，通过估计出的当前丢失帧的全局增益和子帧增益恢复出当前丢失帧的高频带信号。
将按照上述方法恢复出的当前丢失帧的高频带信号称为初始高频带信号，本实施例下述各步骤是对该初始高频信号进行调整，从而恢复出当前丢失帧更为准确的高频带信号。
步骤S302，确定当前丢失帧的增益。
具体地，从步骤S301中可知，根据当前丢失帧前一帧的全局增益、子帧增益和编码类型可以估计当前丢失帧的全局增益和子帧增益，由于本实施例是对当前丢失帧的高频带信号进行调整，而对当前丢失帧产生直接影响的是子帧增益，因此，本步骤中以及本实施例下述当前丢失帧的增益为当前丢失帧的子帧增益。
步骤S303，确定当前丢失帧的增益调整信息，所述增益调整信息包括以下至少一种：帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中连续丢帧数为到当前丢失帧为止连续丢失的帧数。
具体地，本实施例是对当前丢失帧的高频带信号进行调整，而高频带信号是通过高频带激励信号和增益得到的，因此通过调整丢失帧的增益，则可以达到对当前丢失帧的高频带进行进行调整的目的。调整增益需要使用增益调整信息，该增益调整信息可以包括以下至少一种：帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数。
其中，帧的类型可以根据当前丢失帧的前一帧的编码类型获得，帧的类型以及编码类型信息都是携带在帧的低频带信号部分。连续丢帧数为到当前丢失帧为止连续丢失的帧数。
丢帧前编码类型可以是指本次丢帧事件发生前的编码模式。通常，为了 达到更好的编码性能，编码端在对信号编码前可以对信号分类，从而选择合适的编码模式。目前，编码模式可以包括：静音帧编码模式(INACTIVE mode)，清音帧编码模式(UNVOICED mode)，浊音帧编码模式(VOICED mode)，普通帧编码模式(GENERIC mode)，瞬态帧编码模式(TRANSITION mode)，音频帧编码模式(AUDIO mode)。
丢帧前所接收到的最后一个帧的类型可以是指本次丢帧事件发生前解码端接收到的最近的一个帧的类型。例如，假设编码端向解码端发送了4帧，其中解码端正确地接收了第1帧和第2帧，而第3帧和第4帧丢失，那么丢帧前所接收到的最后一个帧可以指第2帧。通常，帧的类型可以包括：(1)清音、静音、噪声或浊音结尾等几种特性之一的帧(UNVOICED_CLAS frame)；(2)清音到浊音过渡，浊音开始但还比较微弱的帧(UNVOICED_TRANSITION frame)；(3)浊音之后的过渡，浊音特性已经很弱的帧(VOICED_TRANSITION frame)；(4)浊音特性的帧，其之前的帧为浊音或者浊音开始帧(VOICED_CLAS frame)；(5)明显浊音的开始帧(ONSET frame)；(6)谐波和噪声混合的开始帧(SIN_ONSET frame)；(7)非活动特性帧(INACTIVE_CLAS frame)。
连续丢帧数可以是指本次丢帧事件中到当前丢失帧为止连续丢失的帧数。实质上，连续丢帧数可以指示当前丢失帧是连续丢失的帧中的第几帧。例如，编码端向解码端发送了5帧，解码端正确接收了第1帧和第2帧，第3帧至第5帧均丢失。如果当前丢失帧为第4帧，那么连续丢帧数就是2；如果当前丢失帧为第5帧，那么连续丢帧数为3。
由于帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数几个增益调整信息都是根据帧的低频带信号获得的，因此本实施例对帧的增益进行调整使用的是信号的低频带信号部分。
步骤S304，根据增益调整信息对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
具体地，根据增益调整信息即可对当前丢失帧的增益进行调整，具体地调整方法可以预设在音频信号的解码端，解码端确定了增益调整信息后，对增益调整信息进行判断，若满足相应的预设条件，则根据该预设条件所对应的调整方法对当前丢失帧的增益进行调整，最终得到当前 丢失帧的调整增益。
步骤S305，根据调整增益对初始高频带信号进行调整，得到当前丢失帧的高频带信号。
具体地，根据调整增益即可对初始高频带信号进行调整，从而得到调整后的高频带信号，即当前丢失帧的高频带信号。一般而言，高频带信号为高频带激励信号与增益之积，因此，将调整增益与初始高频带信号相乘，即可得到当前丢失帧的高频带信号。
进一步地，将步骤S305得到的当前丢失帧的高频带信号和使用当前丢失帧前一帧的编码参数恢复的当前丢失帧的低频带信号进行合成，即可得到当前丢失帧，从而完成了对当前丢失帧的恢复处理。由于接收端在恢复当前丢失帧时除了使用高频带信号得到的相关参数进行当前丢失帧的恢复，还使用了低频带信号进行当前丢失帧的恢复，从而使恢复的当前丢失帧高低频段帧间变化趋势一致，提升了丢帧恢复的性能。
本实施例，在音频数据发生丢帧时，根据丢失帧的低频带信号对丢失帧的高频带信号进行了调整，从而使恢复的丢失帧高低频段帧间变化趋势一致，提高了丢帧恢复的性能。
上述步骤S304根据增益调整信息对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益的具体方法，可以预设在音频信号的接收端，下面以具体的实施例对根据增益调整信息对当前丢失帧的增益进行调整的方法进行进一步地说明。
图4为本发明实施例提供的处理丢失帧的方实施例二的流程图，如图4所示，本实施例的方法包括：
步骤S401，根据当前丢失帧的低频带信号能量得到当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比。
具体地，本实施例是对步骤S304进行的进一步地说明。其中，增益调整信息包括帧的低频带信号能量。在根据增益调整信息对当前丢失帧的增益进行调整时，首先获取当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比。当前丢失帧的低频带信号能量可以根据恢复出的当前丢失帧的低频带信号获得，当前丢失帧的前一帧的低频带信号能量同样可以根据当前丢失帧前一帧的低频带信号能量获 得。
步骤S402，根据当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
具体地，当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比反映了当前丢失帧的低频带信号能量的变化趋势，因此，根据当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比对当前丢失帧的增益进行调整，则得到的调整增益反应了当前丢失帧的低频带信号的变化趋势。因此使用本实施例得到的调整增益对当前丢失帧的高频带信号进行调整，可以使当前丢失帧高低频段帧间变化趋势一致，提升了丢帧恢复的性能。
图5为本发明实施例提供的处理丢失帧的方法实施例三的流程图，如图5所示，本实施例的方法包括：
步骤S501，当连续丢帧数等于1，且当前丢失帧的类型不是清音且当前丢失帧的类型不是清音过渡、且当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据当前丢失帧的低频带信号能量得到当前丢失帧的高频激励能量与当前丢失帧的前一帧的高频激励能量的能量比。
具体地，本实施例是对步骤S304进行的进一步地说明。其中，增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数。在根据增益调整信息对当前丢失帧的增益进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数等于1，且当前丢失帧的类型不是清音(UNVOICED_CLAS)且当前丢失帧的类型不是清音过渡(UNVOICED_TRANSITION)、且当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间。
其中，低频带信号谱倾斜为低频带信号谱的斜率，第一阈值可以为一个预设的取值，例如在本实施例中，第一阈值可以设置为8。当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值的意义在于，当前丢失帧 的前一帧的低频带信号变化不能过快，否则使用低频带信号对当前丢失帧的增益进行修正的精度将降低。当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间的意义在于，当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量差距不能过大，否则将影响对当前丢失帧进行修正的精度。上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍。另外，还需要增加一个判断条件，当前丢失帧的低频带信号谱倾斜小于等于当前丢失帧的前一帧的低频带信号谱倾斜。
步骤S502，根据当前丢失帧的前一帧高频激励能量与当前丢失帧的高频激励能量的能量比对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
具体地，若判断增益调整信息满足步骤S501中的条件，则根据当前丢失帧的高频激励能量与当前丢失帧的前一帧的高频激励能量的能量比对当前丢失帧的增益进行调整。设prev_ener_ratio表示丢失帧前一帧的高频激励能量与丢失帧的高频激励能量比的比值，此时再次根据prev_ener_ratio与当前丢失帧的增益的关系对当前丢失帧的增益进行调整。例如，在本实施例中，设当前丢失帧的增益为G，当前丢失帧的调整增益为G'。当prev_ener_ratio大于G的4倍时，则G'＝0.4×prev_ener_ratio+0.6×G，当prev_ener_ratio大于G的2倍但小于等于G的4倍时，则G'＝0.8×prev_ener_ratio+0.2×G，当prev_ener_ratio小于等于G的2倍时，G'＝0.2×prev_ener_ratio+0.8×G。
图6为本发明实施例提供的处理丢失帧的方法实施例四的流程图，如图6所示，本实施例的方法包括：
步骤S601，判断连续丢帧数等于1，且当前丢失帧的类型不是清音且当前丢失帧的类型不是清音过渡、且当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，且当前丢失帧的低频带信号谱倾斜大于丢失帧的前一帧的低频带信号谱倾斜。
具体地，本实施例是对步骤S304进行的进一步地说明。其中，增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数。在根据增益调整信息对当前丢失帧的增益进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数等于1，且当前丢失帧的类型不是清音(UNVOICED_CLAS)且当前丢失帧的类型不是清音过渡(UNVOICED_TRANSITION)、且当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间。
其中，低频带信号谱倾斜为低频带信号谱的斜率，第一阈值可以为一个预设的取值，例如在本实施例中，第一阈值可以设置为8。当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值的意义在于，当前丢失帧的前一帧的低频带信号变化不能过快，否则使用低频带信号对当前丢失帧的增益进行修正的精度将降低。当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间的意义在于，当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量差距不能过大，否则将影响对当前丢失帧进行修正的精度。上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍。另外，还需要增加一个判断条件，当前丢失帧的低频带信号谱倾斜大于当前丢失帧的前一帧的低频带信号谱倾斜。
步骤S602，根据预设的调整因子对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
具体地，若判断增益调整信息满足步骤S601中的条件，则根据一个预设的调整因子对当前丢失帧的增益进行调整。G'＝G×f。其中f为预设的调整因子，f等于当前丢失帧的低频带信号谱倾斜与当前丢失帧前一帧的低频带信号谱倾斜的比。
图7为本发明实施例提供的处理丢失帧的方法实施例五的流程图，如图7所示，本实施例的方法包括：
步骤S701，当连续丢帧数等于1，且当前丢失帧的类型不是清音且当 前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值、且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据当前丢失帧的低频带信号能量得到当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比。
具体地，本实施例是对步骤S304进行的进一步地说明。其中，增益调整信息包括帧的类型、帧的低频带信号谱倾斜和连续丢帧数。在根据增益调整信息对当前丢失帧的增益进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数等于1，且当前丢失帧的类型不是清音且当前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值、且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间。
其中，低频带信号谱倾斜为低频带信号谱的斜率，第一阈值可以为一个预设的取值，例如在本实施例中，第一阈值可以设置为8。当前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值的意义在于，当前丢失帧的前一帧的低频带信号变化较快，此时将减少使用低频带信号对当前丢失帧的增益进行修正的权重。当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间的意义在于，当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量差距不能过大，否则将影响对当前丢失帧进行修正的精度。上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍。
步骤S702，根据当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
具体地，若判断增益调整信息满足步骤S701中的条件，则根据当前丢失帧的高频激励能量与当前丢失帧的前一帧的高频激励能量的能量比对当前丢失帧的增益进行调整。例如，在本实施例中，G'＝0.2×prev_ener_ratio+0.8×G。
图8为本发明实施例提供的处理丢失帧的方法实施例六的流程图，如 图8所示，本实施例的方法包括：
步骤S801，根据当前丢失帧的低频带信号能量得到当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比。
具体地，本实施例是对步骤S304进行的进一步地说明。其中，增益调整信息包括连续丢帧数。首先根据当前丢失帧的低频带信号能量得到当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比。
步骤S802，当连续丢帧数大于1且当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比大于当前丢失帧的增益时，根据当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
具体地，在根据增益调整信息对当前丢失帧的增益进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数大于1且当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比大于当前丢失帧的增益。同时，还需要判断另一个条件，当前丢失帧的低频带信号谱倾斜和所述当前丢失帧的前一帧的低频带信号谱是否都小于等于第二阈值，第二阈值可以是预设的一个阈值，例如为10。若同时满足上述条件，则根据当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比对当前丢失帧的增益进行调整。例如，当prev_ener_ratio>4G时，则G'＝min((0.5×prev_ener_ratio+0.5×G),4×G)，这里表示G'等于0.5×prev_ener_ratio+0.5×G和4×G中较小的一个；当4G>prev_ener_ratio>G时，0.8×prev_ener_ratio+0.2×G。
图9为本发明实施例提供的处理丢失帧的方法实施例七的流程图，如图9所示，本实施例的方法包括：
步骤S901，根据当前丢失帧的低频带信号能量得到当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比。
具体地，本实施例是对步骤S304进行的进一步地说明。其中，增益调整信息包括连续丢帧数和帧的低频带信号谱倾斜。首先根据当前丢失帧的低频带信号能量得到当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比。
步骤S902，当连续丢帧数大于1、当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比大于当前丢失帧的增益且当前丢失帧的低频带信号谱倾斜和当前丢失帧的前一帧的低频带信号谱都大于第二阈值时，根据当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
具体地，在根据增益调整信息对当前丢失帧的增益进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数大于1且当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比大于当前丢失帧的增益。同时，还需要判断另一个条件，当前丢失帧的低频带信号谱倾斜和所述当前丢失帧的前一帧的低频带信号谱是否都大于第二阈值，第二阈值可以是预设的一个阈值，例如为10。若同时满足上述条件，则根据当前丢失帧的前一帧的高频激励能量与当前丢失帧的高频激励能量的能量比对当前丢失帧的增益进行调整。例如，当prev_ener_ratio>4G时，则G'＝min((0.8×prev_ener_ratio+0.2×G),4×G)，这里表示G'等于0.8×prev_ener_ratio+0.2×G和4×G中较小的一个；当4G>prev_ener_ratio>G时，0.5×prev_ener_ratio+0.5×G。
在Windows 7平台下，使用Microsoft Visual Studio 2008编译环境，图5至图9所示实施例的处理丢失帧的方法可以采用如下代码实现。
Figure PCTCN2015071728-appb-000001
Figure PCTCN2015071728-appb-000002
Figure PCTCN2015071728-appb-000003
图10为本发明实施例提供的处理丢失帧的方法实施例八的流程图，如图10所示，本实施例的方法包括：
步骤S1001，确定当前丢失帧的初始高频带信号。
步骤S1002，确定当前丢失帧的增益。
步骤S1003，确定当前丢失帧的增益调整信息，所述增益调整信息包 括以下至少一种：帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中连续丢帧数为到当前丢失帧为止连续丢失的帧数。
步骤S1004，确定初始激励调整因子。
具体地，本实施例在图3所示实施例的基础上，进一步地对当前丢失帧的高频带激励信号进行调整，从而对当前丢失帧进行更精确地调整。激励调整因子是指对当前丢失帧的高频带激励信号进行调整所使用的一个因子，初始激励调整因子是根据丢失帧的子帧增益和全局增益得出的。
步骤S1005，根据增益修正信息对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，根据增益调整信息即可对初始激励调整因子进行调整，具体地调整方法可以预设在音频信号的解码端，解码端确定了增益调整信息后，对增益调整信息进行判断，若满足相应的预设条件，则根据该预设条件所对应的调整方法对初始激励调整因子进行调整，最终得到调整后的激励调整因子。
需要说明的是，为了保证丢帧情况帧间能量连续性，需要对调整后的激励调整因子进行平滑渐进处理，例如，可以使用公式：scale'＝pow(scale',0.125)计算。即取scale'的0.125次幂。
步骤S1006，根据增益调整信息对当前丢失帧的增益进行调整，得到当前丢失帧的调整增益。
步骤S1007，根据调整增益和调整后的激励调整因子对初始高频带信号进行调整，得到当前丢失帧的高频带信号。
具体地，一般而言，高频带信号为高频带激励信号与增益之积，因此，根据激励调整因子可以对高频带激励信号进行调整，根据调整增益同样是对高频带激励信号进行调整，最终得到当前丢失帧的高频带信号。
进一步地，在步骤S1005中，根据增益修正信息对初始激励调整因子进行调整，得到调整后的激励调整因子的具体方法可以如下述各实现方式所示。
在一种可能的实现方式中，步骤S1005包括：当连续丢帧数等于1，当前丢失帧的高频激励能量大于当前丢失帧的前一帧的高频激励能量，且当前丢失帧的类型不是清音且当前丢失帧前的最后一个正常接收帧的类型不是清音时，根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子，增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数。
具体地，增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数等于1，当前丢失帧的高频激励能量大于当前丢失帧的前一帧的高频激励能量，且当前丢失帧的类型不是清音且当前丢失帧前的最后一个正常接收帧的类型不是清音。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整。其中，当前丢失帧前的最后一个正常接收帧表示当前丢失帧前最后一个没有丢失的帧。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比。
在另一种可能的实现方式中，步骤S1005包括：当连续丢帧数等于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧的前一帧的类型是清音时，根据当前丢失帧的前一帧的低频带信号能量与当前丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数等于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量 的能量比位于预设区间，且当前丢失帧的前一帧的类型是清音。其中，上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比。
在另一种可能的实现方式中，步骤S1005包括：当连续丢帧数等于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧前的最后一个正常接收帧的类型是清音时，根据当前丢失帧的前一帧的低频带信号能量与当前丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数等于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧前的最后一个正常接收帧的类型是清音。其中，当前丢失帧前的最后一个正常接收帧表示当前丢失帧前最后一个没有丢失的帧；上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比。
在另一种可能的实现方式中，步骤S1005包括：当连续丢帧数等于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据当前丢失帧的前一帧的低频带信号能量与当前丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数等于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值。其中，上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍；第三阈值可以是预设的一个阈值，例如为5。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比。
在另一种可能的实现方式中，步骤S1005包括：当连续丢帧数大于1且当前丢失帧的高频激励能量大于当前丢失帧的前一帧的高频激励能量时，根据当前丢失帧的前一帧的低频带信号能量与当前丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，增益调整信息包括帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数大于1且当前丢失帧的高频激励能量大于当前丢失帧的前一帧的高频激励能量。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信 号能量对初始激励调整因子进行调整。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比。
在另一种可能的实现方式中，步骤S1005包括：当连续丢帧数大于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧的前一帧的类型是清音时，根据当前丢失帧的前一帧的低频带信号能量与当前丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数大于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧的前一帧的类型是清音。其中，上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比、3中较小的一个。
在另一种可能的实现方式中，步骤S1005包括：当连续丢帧数大于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧前的最后一个正常接收帧的类型是清音时，根据当前丢失帧的前一帧的低频带信号能量与当前丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数大于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧前的最后一个正常接收帧的类型是清音。其中，当前丢失帧前的最后一个正常接收帧表示当前丢失帧前最后一个没有丢失的帧；上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比、3中较小的一个。
在另一种可能的实现方式中，步骤S1005包括：当连续丢帧数大于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据当前丢失帧的前一帧的低频带信号能量与当前丢失帧的低频带信号能量对初始激励调整因子进行调整，得到调整后的激励调整因子。
具体地，增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数。在根据增益修正信息对初始激励调整因子进行调整时，首先判断增益调整信息是否满足同时如下条件：连续丢帧数大于1，且当前丢失帧的高频激励能量小于当前丢失帧的前一帧的高频激励能量的一半，且当前丢失帧的低频带信号能量与当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值。其中，上述预设区间一般可以设置为当前丢失帧的低频带信号能量大于当前丢失帧的前一帧的低频带信号能量的一 半，且当前丢失帧的低频带信号能量小于当前丢失帧的前一帧的低频带信号能量的两倍；第三阈值可以是预设的一个阈值，例如为5。若判断同时满足上述条件，则根据当前丢失帧的前一帧的低频带信号能量与丢失帧的低频带信号能量对初始激励调整因子进行调整。例如，设初始激励调整因子为scale，调整后的激励调整因子为scale'。则，scale'等于当前丢失帧前一帧的低频带能量与当前丢失帧的低频带能量的比、3中较小的一个。
在Windows 7平台下，使用Microsoft Visual Studio 2008编译环境，图10所示实施例及图10所示实施例的各种实现方式的处理丢失帧的方法可以采用如下代码实现。
Figure PCTCN2015071728-appb-000004
Figure PCTCN2015071728-appb-000005
Figure PCTCN2015071728-appb-000006
本实施例提供的处理丢失帧的方法中，仅示出以丢失帧与丢失帧前一帧的低频带信号谱倾斜、低频带信号能量比、高频激励能量比、丢失帧的帧类型等信息对丢失帧增益和激励调整因子进行修正的具体方法，但本发明提供的处理丢失帧的方法不限于此，只要是根据丢失帧与丢失帧前至少一帧的低频带信息和编码类型信息修正丢失帧的高频带信息的丢帧处理方法都在本发明的保护范围之内。
本发明实施例提供的处理丢失帧的方法，由于基于前后帧低频段相互关系来指导高频段丢失帧的恢复，这种方法在低频段信息恢复准确的情况下能够使得恢复的丢失帧高频段能量更加连续，解决了高频段能量恢复不连续的情况，提高了丢失帧高频段性能。
图11为本发明实施例提供的处理丢失帧的装置的结构示意图，如图11所示，本实施例的处理丢失帧的装置包括：
确定模块111，用于确定当前丢失帧的初始高频带信号；确定所述当前丢失帧的增益；确定所述当前丢失帧的增益调整信息，所述增益调整信息包括以下至少一种：帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中所述连续丢帧数为到所述当前丢失帧为止连续丢失的帧数；
调整模块112，用于根据所述增益调整信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益；根据所述调整增益对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
本实施提供的处理丢失帧的装置用于执行图3所示的方法实施例的技术方案，其实现原理和技术效果类似，此处不再赘述。
进一步地，图11所示实施例中，所述增益调整信息包括帧的低频带信号能量，调整模块112，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比；根据所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，且所述当前丢失帧的低频带信号谱倾斜大于所述丢失帧的前一帧的低频带信号谱倾斜时，根据预设的调整因子对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜和连续丢帧数，调整模块112，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值、且所述当前丢失帧的低频带 信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
进一步地，图11所示实施例中，所述增益调整信息包括连续丢帧数，调整模块112，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；当所述连续丢帧数大于1且所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益时，根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
进一步地，图11所示实施例中，所述增益调整信息包括连续丢帧数和帧的低频带信号谱倾斜，调整模块112，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；当所述连续丢帧数大于1、所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益且所述当前丢失帧的低频带信号谱倾斜和所述当前丢失帧的前一帧的低频带信号谱都大于第二阈值时，根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
进一步地，图11所示实施例中，确定模块111，还用于确定初始激励调整因子；调整模块111，还用于根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子；根据所述调整增益和所述调整后的激励调整因子对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、 帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数等于1，所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量，且所述当前丢失帧的类型不是清音且所述当前丢失帧前的最后一个正常接收帧的类型不是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
进一步地，图11所示实施例中，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的 激励调整因子。
进一步地，图11所示实施例中，所述增益调整信息包括帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数大于1且所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
进一步地，图11所示实施例中，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
进一步地，图11所示实施例中，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，调整模块112，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失 帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
本领域普通技术人员可以理解：实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时，执行包括上述各方法实施例的步骤；而前述的存储介质包括：ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。

Claims (32)

  1. 一种处理丢失帧的方法，其特征在于，所述方法包括：
    确定当前丢失帧的初始高频带信号；
    确定所述当前丢失帧的增益；
    确定所述当前丢失帧的增益调整信息，所述增益调整信息包括以下至少一种：
    帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中所述连续丢帧数为到所述当前丢失帧为止连续丢失的帧数；
    根据所述增益调整信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益；
    根据所述调整增益对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
  2. 根据权利要求1所述的方法，所述增益调整信息包括帧的低频带信号能量，其特征在于，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
    根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比；
    根据所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  3. 根据权利要求1所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
    当所述连续丢帧数等于1，且
    所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，
    根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一 帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
    根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  4. 根据权利要求1所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
    当所述连续丢帧数等于1，且
    所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，
    且所述当前丢失帧的低频带信号谱倾斜大于所述丢失帧的前一帧的低频带信号谱倾斜时，
    根据预设的调整因子对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  5. 根据权利要求1所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
    当所述连续丢帧数等于1，且
    所述当前丢失帧的类型不是清音且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，
    根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
    根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  6. 根据权利要求1所述的方法，所述增益调整信息包括连续丢帧数，其特征在于，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
    根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
    当所述连续丢帧数大于1且所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益时，
    根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  7. 根据权利要求1所述的方法，所述增益调整信息包括连续丢帧数和帧的低频带信号谱倾斜，其特征在于，所述根据所述增益修正信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益，包括：
    根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；
    当所述连续丢帧数大于1、所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益且所述当前丢失帧的低频带信号谱倾斜和所述当前丢失帧的前一帧的低频带信号谱都大于第二阈值时，
    根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  8. 根据权利要求1～7任一项所述的方法，其特征在于，所述确定所述当前丢失帧的增益调整信息之后，还包括：
    确定初始激励调整因子；
    根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子；
    所述根据所述调整增益对所述初始高频带信号进行调整，得到所述 当前丢失帧的高频带信号，包括：
    根据所述调整增益和所述调整后的激励调整因子对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
  9. 根据权利要求8所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
    当所述连续丢帧数等于1，所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量，且
    所述当前丢失帧的类型不是清音且所述当前丢失帧前的最后一个正常接收帧的类型不是清音时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  10. 根据权利要求8所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
    当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  11. 根据权利要求8所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
    当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所 述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  12. 根据权利要求8所述的方法，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
    当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  13. 根据权利要求8所述的方法，所述增益调整信息包括帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
    当所述连续丢帧数大于1且所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  14. 根据权利要求8所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因 子，包括：
    当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  15. 根据权利要求8所述的方法，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
    当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  16. 根据权利要求8所述的方法，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子，包括：
    当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，
    根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧 的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  17. 一种处理丢失帧的装置，其特征在于，所述处理丢失帧的装置包括：
    确定模块，用于确定当前丢失帧的初始高频带信号；确定所述当前丢失帧的增益；确定所述当前丢失帧的增益调整信息，所述增益调整信息包括以下至少一种：帧的类型，帧的低频带信号谱倾斜，帧的低频带信号能量，连续丢帧数，其中所述连续丢帧数为到所述当前丢失帧为止连续丢失的帧数；
    调整模块，用于根据所述增益调整信息对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益；根据所述调整增益对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
  18. 根据权利要求17所述的处理丢失帧的装置，所述增益调整信息包括帧的低频带信号能量，其特征在于，所述调整模块，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比；根据所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  19. 根据权利要求17所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  20. 根据权利要求17所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的类型不是清音过渡、且所述当前丢失帧的前一帧的低频带信号谱倾斜小于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，且所述当前丢失帧的低频带信号谱倾斜大于所述丢失帧的前一帧的低频带信号谱倾斜时，根据预设的调整因子对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  21. 根据权利要求17所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号谱倾斜和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的类型不是清音且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第一阈值、且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间时，根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  22. 根据权利要求17所述的处理丢失帧的装置，所述增益调整信息包括连续丢帧数，其特征在于，所述调整模块，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；当所述连续丢帧数大于1且所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益时，根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  23. 根据权利要求17所述的处理丢失帧的装置，所述增益调整信息包括连续丢帧数和帧的低频带信号谱倾斜，其特征在于，所述调整模 块，具体用于根据所述当前丢失帧的低频带信号能量得到所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比；当所述连续丢帧数大于1、所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比大于所述当前丢失帧的增益且所述当前丢失帧的低频带信号谱倾斜和所述当前丢失帧的前一帧的低频带信号谱都大于第二阈值时，根据所述当前丢失帧的前一帧的高频激励能量与所述当前丢失帧的高频激励能量的能量比对所述当前丢失帧的增益进行调整，得到所述当前丢失帧的调整增益。
  24. 根据权利要求17～23任一项所述的处理丢失帧的装置，其特征在于，所述确定模块，还用于确定初始激励调整因子；
    所述调整模块，还用于根据所述增益修正信息对所述初始激励调整因子进行调整，得到调整后的激励调整因子；根据所述调整增益和所述调整后的激励调整因子对所述初始高频带信号进行调整，得到所述当前丢失帧的高频带信号。
  25. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数等于1，所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量，且所述当前丢失帧的类型不是清音且所述当前丢失帧前的最后一个正常接收帧的类型不是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  26. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激 励调整因子。
  27. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  28. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数等于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  29. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数大于1且所述当前丢失帧的高频激励能量大于所述当前丢失帧的前一帧的高频激励能量时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  30. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号 能量的能量比位于预设区间，且所述当前丢失帧的前一帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  31. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的类型、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧前的最后一个正常接收帧的类型是清音时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
  32. 根据权利要求24所述的处理丢失帧的装置，所述增益调整信息包括帧的低频带信号谱倾斜、帧的低频带信号能量和连续丢帧数，其特征在于，所述调整模块，具体用于当所述连续丢帧数大于1，且所述当前丢失帧的高频激励能量小于所述当前丢失帧的前一帧的高频激励能量的一半，且所述当前丢失帧的低频带信号能量与所述当前丢失帧的前一帧的低频带信号能量的能量比位于预设区间，且所述当前丢失帧的前一帧的低频带信号谱倾斜大于第三阈值时，根据所述当前丢失帧的前一帧的低频带信号能量与所述当前丢失帧的低频带信号能量对所述初始激励调整因子进行调整，得到调整后的激励调整因子。
PCT/CN2015/071728 2014-06-25 2015-01-28 处理丢失帧的方法和装置 WO2015196803A1 (zh)

Priority Applications (14)

Application Number Priority Date Filing Date Title
MYPI2016704115A MY178408A (en) 2014-06-25 2015-01-28 Method and apparatus for processing lost frame
MX2016017007A MX359500B (es) 2014-06-25 2015-01-28 Metodo y aparato para procesar trama perdida.
RU2016151461A RU2666471C2 (ru) 2014-06-25 2015-01-28 Способ и устройство для обработки потери кадра
EP18203005.6A EP3534366B1 (en) 2014-06-25 2015-01-28 Method and apparatus for processing lost frame
BR112016027113-0A BR112016027113B1 (pt) 2014-06-25 2015-01-28 Método e aparelho para processar quadro perdido
EP15811619.4A EP3133596B1 (en) 2014-06-25 2015-01-28 Dropped frame processing method and device
KR1020167033869A KR101942411B1 (ko) 2014-06-25 2015-01-28 손실 프레임을 처리하는 방법 및 장치
JP2016572825A JP6439804B2 (ja) 2014-06-25 2015-01-28 損失フレームを処理するための方法および装置
CA2949266A CA2949266C (en) 2014-06-25 2015-01-28 Method and apparatus for processing lost frame
SG11201609526RA SG11201609526RA (en) 2014-06-25 2015-01-28 Method and apparatus for processing lost frame
AU2015281722A AU2015281722B2 (en) 2014-06-25 2015-01-28 Method and apparatus for processing lost frame
US15/385,881 US9852738B2 (en) 2014-06-25 2016-12-21 Method and apparatus for processing lost frame
US15/817,296 US10311885B2 (en) 2014-06-25 2017-11-20 Method and apparatus for recovering lost frames
US16/396,253 US10529351B2 (en) 2014-06-25 2019-04-26 Method and apparatus for recovering lost frames

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410291123.5 2014-06-25
CN201410291123.5A CN105225666B (zh) 2014-06-25 2014-06-25 处理丢失帧的方法和装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/385,881 Continuation US9852738B2 (en) 2014-06-25 2016-12-21 Method and apparatus for processing lost frame

Publications (1)

Publication Number Publication Date
WO2015196803A1 true WO2015196803A1 (zh) 2015-12-30

Family

ID=54936693

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/071728 WO2015196803A1 (zh) 2014-06-25 2015-01-28 处理丢失帧的方法和装置

Country Status (14)

Country Link
US (3) US9852738B2 (zh)
EP (2) EP3133596B1 (zh)
JP (1) JP6439804B2 (zh)
KR (1) KR101942411B1 (zh)
CN (2) CN106683681B (zh)
AU (1) AU2015281722B2 (zh)
BR (1) BR112016027113B1 (zh)
CA (1) CA2949266C (zh)
HK (1) HK1219801A1 (zh)
MX (1) MX359500B (zh)
MY (1) MY178408A (zh)
RU (1) RU2666471C2 (zh)
SG (1) SG11201609526RA (zh)
WO (1) WO2015196803A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102423753B1 (ko) * 2015-08-20 2022-07-21 삼성전자주식회사 스피커 위치 정보에 기초하여, 오디오 신호를 처리하는 방법 및 장치
CN108922551B (zh) * 2017-05-16 2021-02-05 博通集成电路（上海）股份有限公司 用于补偿丢失帧的电路及方法
WO2020014517A1 (en) * 2018-07-12 2020-01-16 Dolby International Ab Dynamic eq
JP7130878B2 (ja) * 2019-01-13 2022-09-05 華為技術有限公司 高分解能オーディオコーディング

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1984203A (zh) * 2006-04-18 2007-06-20 华为技术有限公司 对丢失的语音业务数据帧进行补偿的方法
CN101325537A (zh) * 2007-06-15 2008-12-17 华为技术有限公司 一种丢帧隐藏的方法和设备
CN103854649A (zh) * 2012-11-29 2014-06-11 中兴通讯股份有限公司 一种变换域的丢帧补偿方法及装置

Family Cites Families (88)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5450449A (en) * 1994-03-14 1995-09-12 At&T Ipm Corp. Linear prediction coefficient generation during frame erasure or packet loss
US5699485A (en) * 1995-06-07 1997-12-16 Lucent Technologies Inc. Pitch delay modification during frame erasures
JP3616432B2 (ja) * 1995-07-27 2005-02-02 日本電気株式会社 音声符号化装置
JP3308783B2 (ja) 1995-11-10 2002-07-29 日本電気株式会社 音声復号化装置
US5819217A (en) * 1995-12-21 1998-10-06 Nynex Science & Technology, Inc. Method and system for differentiating between speech and noise
FR2765715B1 (fr) * 1997-07-04 1999-09-17 Sextant Avionique Procede de recherche d'un modele de bruit dans des signaux sonores bruites
FR2774827B1 (fr) * 1998-02-06 2000-04-14 France Telecom Procede de decodage d'un flux binaire representatif d'un signal audio
US6260010B1 (en) * 1998-08-24 2001-07-10 Conexant Systems, Inc. Speech encoder using gain normalization that combines open and closed loop gains
AU4072400A (en) * 1999-04-05 2000-10-23 Hughes Electronics Corporation A voicing measure as an estimate of signal periodicity for frequency domain interpolative speech codec system
JP2000305599A (ja) * 1999-04-22 2000-11-02 Sony Corp 音声合成装置及び方法、電話装置並びにプログラム提供媒体
US6636829B1 (en) 1999-09-22 2003-10-21 Mindspeed Technologies, Inc. Speech communication system and method for handling lost frames
US6574593B1 (en) * 1999-09-22 2003-06-03 Conexant Systems, Inc. Codebook tables for encoding and decoding
US6604070B1 (en) 1999-09-22 2003-08-05 Conexant Systems, Inc. System of encoding and decoding speech signals
DE60117471T2 (de) * 2001-01-19 2006-09-21 Koninklijke Philips Electronics N.V. Breitband-signalübertragungssystem
SE521693C3 (sv) * 2001-03-30 2004-02-04 Ericsson Telefon Ab L M En metod och anordning för brusundertryckning
CN1235192C (zh) * 2001-06-28 2006-01-04 皇家菲利浦电子有限公司 传输系统以及用于接收窄带音频信号的接收机和方法
US6895375B2 (en) 2001-10-04 2005-05-17 At&T Corp. System for bandwidth extension of Narrow-band speech
US7457757B1 (en) * 2002-05-30 2008-11-25 Plantronics, Inc. Intelligibility control for speech communications systems
CA2388439A1 (en) * 2002-05-31 2003-11-30 Voiceage Corporation A method and device for efficient frame erasure concealment in linear predictive based speech codecs
WO2003107591A1 (en) * 2002-06-14 2003-12-24 Nokia Corporation Enhanced error concealment for spatial audio
KR100728428B1 (ko) * 2002-09-19 2007-06-13 마츠시타 덴끼 산교 가부시키가이샤 오디오 디코딩 장치 및 오디오 디코딩 방법
US20040064308A1 (en) * 2002-09-30 2004-04-01 Intel Corporation Method and apparatus for speech packet loss recovery
US7330812B2 (en) * 2002-10-04 2008-02-12 National Research Council Of Canada Method and apparatus for transmitting an audio stream having additional payload in a hidden sub-channel
KR100501930B1 (ko) * 2002-11-29 2005-07-18 삼성전자주식회사 적은 계산량으로 고주파수 성분을 복원하는 오디오 디코딩방법 및 장치
US6985856B2 (en) 2002-12-31 2006-01-10 Nokia Corporation Method and device for compressed-domain packet loss concealment
WO2004090870A1 (ja) * 2003-04-04 2004-10-21 Kabushiki Kaisha Toshiba 広帯域音声を符号化または復号化するための方法及び装置
US20050004793A1 (en) * 2003-07-03 2005-01-06 Pasi Ojala Signal adaptation for higher band coding in a codec utilizing band split coding
CN1989548B (zh) 2004-07-20 2010-12-08 松下电器产业株式会社 语音解码装置及补偿帧生成方法
JP4977472B2 (ja) * 2004-11-05 2012-07-18 パナソニック株式会社 スケーラブル復号化装置
JP4846712B2 (ja) 2005-03-14 2011-12-28 パナソニック株式会社 スケーラブル復号化装置およびスケーラブル復号化方法
DK1875463T3 (en) * 2005-04-22 2019-01-28 Qualcomm Inc SYSTEMS, PROCEDURES AND APPARATUS FOR AMPLIFIER FACTOR GLOSSARY
US20060262851A1 (en) * 2005-05-19 2006-11-23 Celtro Ltd. Method and system for efficient transmission of communication traffic
EP1727131A2 (en) * 2005-05-26 2006-11-29 Yamaha Hatsudoki Kabushiki Kaisha Noise cancellation helmet, motor vehicle system including the noise cancellation helmet and method of canceling noise in helmet
US7831421B2 (en) * 2005-05-31 2010-11-09 Microsoft Corporation Robust decoder
EP1898397B1 (en) 2005-06-29 2009-10-21 Panasonic Corporation Scalable decoder and disappeared data interpolating method
US7734462B2 (en) * 2005-09-02 2010-06-08 Nortel Networks Limited Method and apparatus for extending the bandwidth of a speech signal
US8255207B2 (en) * 2005-12-28 2012-08-28 Voiceage Corporation Method and device for efficient frame erasure concealment in speech codecs
CN1983909B (zh) 2006-06-08 2010-07-28 华为技术有限公司 一种丢帧隐藏装置和方法
US8532984B2 (en) * 2006-07-31 2013-09-10 Qualcomm Incorporated Systems, methods, and apparatus for wideband encoding and decoding of active frames
TWI343560B (en) * 2006-07-31 2011-06-11 Qualcomm Inc Systems, methods, and apparatus for wideband encoding and decoding of active frames
US8015000B2 (en) * 2006-08-03 2011-09-06 Broadcom Corporation Classification-based frame loss concealment for audio signals
US8374857B2 (en) 2006-08-08 2013-02-12 Stmicroelectronics Asia Pacific Pte, Ltd. Estimating rate controlling parameters in perceptual audio encoders
US8024192B2 (en) 2006-08-15 2011-09-20 Broadcom Corporation Time-warping of decoded audio signal after packet loss
JP5224666B2 (ja) * 2006-09-08 2013-07-03 株式会社東芝 オーディオ符号化装置
JP4827675B2 (ja) * 2006-09-25 2011-11-30 三洋電機株式会社 低周波帯域音声復元装置、音声信号処理装置および録音機器
CN101155140A (zh) 2006-10-01 2008-04-02 华为技术有限公司 音频流错误隐藏的方法、装置和系统
PT2102619T (pt) * 2006-10-24 2017-05-25 Voiceage Corp Método e dispositivo para codificação de tramas de transição em sinais de voz
CN101286319B (zh) 2006-12-26 2013-05-01 华为技术有限公司 改进语音丢包修补质量的语音编码方法
US8010351B2 (en) * 2006-12-26 2011-08-30 Yang Gao Speech coding system to improve packet loss concealment
US20080208575A1 (en) * 2007-02-27 2008-08-28 Nokia Corporation Split-band encoding and decoding of an audio signal
CN101321033B (zh) 2007-06-10 2011-08-10 华为技术有限公司 帧补偿方法及系统
US9653088B2 (en) 2007-06-13 2017-05-16 Qualcomm Incorporated Systems, methods, and apparatus for signal encoding using pitch-regularizing and non-pitch-regularizing coding
EP2162880B1 (en) * 2007-06-22 2014-12-24 VoiceAge Corporation Method and device for estimating the tonality of a sound signal
US8185388B2 (en) 2007-07-30 2012-05-22 Huawei Technologies Co., Ltd. Apparatus for improving packet loss, frame erasure, or jitter concealment
CN100524462C (zh) * 2007-09-15 2009-08-05 华为技术有限公司 对高带信号进行帧错误隐藏的方法及装置
CN101335003B (zh) * 2007-09-28 2010-07-07 华为技术有限公司 噪声生成装置、及方法
CN101207665B (zh) 2007-11-05 2010-12-08 华为技术有限公司 一种衰减因子的获取方法
KR101235830B1 (ko) * 2007-12-06 2013-02-21 한국전자통신연구원 음성코덱의 품질향상장치 및 그 방법
US8180064B1 (en) * 2007-12-21 2012-05-15 Audience, Inc. System and method for providing voice equalization
FR2929466A1 (fr) * 2008-03-28 2009-10-02 France Telecom Dissimulation d'erreur de transmission dans un signal numerique dans une structure de decodage hierarchique
CN101588341B (zh) 2008-05-22 2012-07-04 华为技术有限公司 一种丢帧隐藏的方法及装置
EP2410522B1 (en) * 2008-07-11 2017-10-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio signal encoder, method for encoding an audio signal and computer program
US8718804B2 (en) * 2009-05-05 2014-05-06 Huawei Technologies Co., Ltd. System and method for correcting for lost data in a digital audio signal
US8660851B2 (en) * 2009-05-26 2014-02-25 Panasonic Corporation Stereo signal decoding device and stereo signal decoding method
US8428938B2 (en) * 2009-06-04 2013-04-23 Qualcomm Incorporated Systems and methods for reconstructing an erased speech frame
CN101958119B (zh) 2009-07-16 2012-02-29 中兴通讯股份有限公司 一种改进的离散余弦变换域音频丢帧补偿器和补偿方法
GB0919673D0 (en) * 2009-11-10 2009-12-23 Skype Ltd Gain control for an audio signal
WO2011141772A1 (en) * 2010-05-12 2011-11-17 Nokia Corporation Method and apparatus for processing an audio signal based on an estimated loudness
US8744091B2 (en) * 2010-11-12 2014-06-03 Apple Inc. Intelligibility control using ambient noise detection
WO2012070370A1 (ja) * 2010-11-22 2012-05-31 株式会社エヌ・ティ・ティ・ドコモ 音声符号化装置、方法およびプログラム、並びに、音声復号装置、方法およびプログラム
BR112013020324B8 (pt) * 2011-02-14 2022-02-08 Fraunhofer Ges Forschung Aparelho e método para supressão de erro em fala unificada de baixo atraso e codificação de áudio
AU2012218778B2 (en) * 2011-02-15 2016-10-20 Voiceage Evs Llc Device and method for quantizing the gains of the adaptive and fixed contributions of the excitation in a celp codec
EP2681734B1 (en) * 2011-03-04 2017-06-21 Telefonaktiebolaget LM Ericsson (publ) Post-quantization gain correction in audio coding
CN102915737B (zh) 2011-07-31 2018-01-19 中兴通讯股份有限公司 一种浊音起始帧后丢帧的补偿方法和装置
EP3537436B1 (en) * 2011-10-24 2023-12-20 ZTE Corporation Frame loss compensation method and apparatus for voice frame signal
CN104254886B (zh) * 2011-12-21 2018-08-14 华为技术有限公司 自适应编码浊音语音的基音周期
CN103295578B (zh) 2012-03-01 2016-05-18 华为技术有限公司 一种语音频信号处理方法和装置
CN103325373A (zh) * 2012-03-23 2013-09-25 杜比实验室特许公司 用于传送和接收音频信号的方法和设备
CN102833037B (zh) * 2012-07-18 2015-04-29 华为技术有限公司 一种语音数据丢包的补偿方法及装置
WO2014042439A1 (ko) * 2012-09-13 2014-03-20 엘지전자 주식회사 손실 프레임 복원 방법 및 오디오 복호화 방법과 이를 이용하는 장치
CN107481725B (zh) * 2012-09-24 2020-11-06 三星电子株式会社 时域帧错误隐藏设备和时域帧错误隐藏方法
US9123328B2 (en) * 2012-09-26 2015-09-01 Google Technology Holdings LLC Apparatus and method for audio frame loss recovery
EP2757558A1 (en) * 2013-01-18 2014-07-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Time domain level adjustment for audio signal decoding or encoding
US9711156B2 (en) * 2013-02-08 2017-07-18 Qualcomm Incorporated Systems and methods of performing filtering for gain determination
US9208775B2 (en) * 2013-02-21 2015-12-08 Qualcomm Incorporated Systems and methods for determining pitch pulse period signal boundaries
US20150170655A1 (en) * 2013-12-15 2015-06-18 Qualcomm Incorporated Systems and methods of blind bandwidth extension
JP6318621B2 (ja) * 2014-01-06 2018-05-09 株式会社デンソー 音声処理装置、音声処理システム、音声処理方法、音声処理プログラム
US9697843B2 (en) * 2014-04-30 2017-07-04 Qualcomm Incorporated High band excitation signal generation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1984203A (zh) * 2006-04-18 2007-06-20 华为技术有限公司 对丢失的语音业务数据帧进行补偿的方法
CN101325537A (zh) * 2007-06-15 2008-12-17 华为技术有限公司 一种丢帧隐藏的方法和设备
CN103854649A (zh) * 2012-11-29 2014-06-11 中兴通讯股份有限公司 一种变换域的丢帧补偿方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3133596A4 *

Also Published As

Publication number Publication date
CN106683681B (zh) 2020-09-25
RU2666471C2 (ru) 2018-09-07
CN106683681A (zh) 2017-05-17
RU2016151461A3 (zh) 2018-07-27
BR112016027113B1 (pt) 2023-01-31
EP3534366A1 (en) 2019-09-04
US20180075853A1 (en) 2018-03-15
MY178408A (en) 2020-10-12
MX2016017007A (es) 2017-05-12
RU2016151461A (ru) 2018-07-27
US20190251980A1 (en) 2019-08-15
MX359500B (es) 2018-09-26
JP2017524972A (ja) 2017-08-31
HK1219801A1 (zh) 2017-04-13
EP3133596B1 (en) 2019-01-09
SG11201609526RA (en) 2016-12-29
AU2015281722B2 (en) 2018-02-01
EP3133596A1 (en) 2017-02-22
US20170103764A1 (en) 2017-04-13
EP3133596A4 (en) 2017-05-17
CN105225666A (zh) 2016-01-06
AU2015281722A1 (en) 2016-12-01
CA2949266A1 (en) 2015-12-30
JP6439804B2 (ja) 2018-12-19
US9852738B2 (en) 2017-12-26
US10311885B2 (en) 2019-06-04
EP3534366B1 (en) 2022-01-26
US10529351B2 (en) 2020-01-07
KR101942411B1 (ko) 2019-04-11
CN105225666B (zh) 2016-12-28
KR20160148021A (ko) 2016-12-23
CA2949266C (en) 2019-10-22
BR112016027113A2 (zh) 2017-08-15

Similar Documents

Publication Publication Date Title
KR102367538B1 (ko) 다중 채널 신호 인코딩 방법 및 인코더
EP3010018B1 (en) Device and method for bandwidth extension for acoustic signals
US8976971B2 (en) Method and apparatus for adjusting channel delay parameter of multi-channel signal
US10529351B2 (en) Method and apparatus for recovering lost frames
KR20110084962A (ko) 과도 신호 부호화 방법 및 장치, 과도 신호 복호화 방법 및 장치, 및 과도 신호 처리 시스템
EP2983171B1 (en) Decoding method and decoding device
KR101787497B1 (ko) 향상 신호의 성형을 이용하여 주파수 향상 신호를 발생시키는 장치 및 방법
WO2015196837A1 (zh) 一种音频编码方法和装置
EP3595211B1 (en) Method for processing lost frame, and decoder
US9354957B2 (en) Method and apparatus for concealing error in communication system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15811619

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2949266

Country of ref document: CA

REEP Request for entry into the european phase

Ref document number: 2015811619

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015811619

Country of ref document: EP

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112016027113

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2015281722

Country of ref document: AU

Date of ref document: 20150128

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 20167033869

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2016572825

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: MX/A/2016/017007

Country of ref document: MX

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2016151461

Country of ref document: RU

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 112016027113

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20161118