CN112992160B - Audio error concealment method and device - Google Patents
Audio error concealment method and device Download PDFInfo
- Publication number
- CN112992160B CN112992160B CN202110497715.2A CN202110497715A CN112992160B CN 112992160 B CN112992160 B CN 112992160B CN 202110497715 A CN202110497715 A CN 202110497715A CN 112992160 B CN112992160 B CN 112992160B
- Authority
- CN
- China
- Prior art keywords
- frame
- current frame
- error concealment
- current
- previous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/005—Correction of errors induced by the transmission channel, if related to the coding algorithm
Abstract
The invention discloses an audio error concealment method and device, and belongs to the technical field of audio coding and decoding and error concealment. The method mainly comprises the steps of judging whether a current frame is a tone signal according to a pitch detection parameter value when LC3 audio coding is carried out; if the current frame is a tone signal, calculating to obtain a pseudo spectrum of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame; extracting all or partial symbols of the spectral coefficient value in the pseudo spectrum of the current frame, and simultaneously transmitting the symbols and the next frame of the current frame; and if the current frame has errors during decoding, generating an error concealment frame of the current frame by interpolation according to the spectral coefficients and the symbols of the previous frame and the next frame of the current frame. The invention can improve the tone quality of the error concealment signal of the tone signal and provide better use experience for users.
Description
Technical Field
The present invention relates to the field of audio encoding and decoding and error concealment, and in particular, to an audio error concealment method and apparatus.
Background
Bluetooth transmission belongs to typical short-distance wireless communication, the error rate is high due to a complex communication environment, although error correction can be achieved through retransmission, the burden of a system is increased due to excessive retransmission, end-to-end delay is increased, and user experience is affected.
In the prior art, the amplitude of the spectral coefficient of the current frame is replaced by the spectral coefficient of the previous frame of the current frame, and then the error concealment frame of the current frame is generated by using the randomly generated symbol and the amplitude of the spectral coefficient. However, the symbols for generating the current frame spectral coefficients are randomly generated, and although the error concealment method is simple in algorithm, the error compensation effect is general, and the sound quality of tone signals is affected, so that poor use experience is brought to users.
Disclosure of Invention
Aiming at the problems in the prior art, the invention mainly provides an audio error concealment method and device.
In order to achieve the above purpose, the invention adopts a technical scheme that: there is provided an audio error concealment method, comprising: when LC3 audio coding is carried out, whether the current frame is a tone signal is judged according to the pitch detection parameter value; if the current frame is a tone signal, calculating to obtain a pseudo spectrum of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame; extracting all or partial symbols of the spectral coefficient value in the pseudo spectrum of the current frame, and simultaneously transmitting the symbols and the next frame of the current frame; and if the current frame has errors during decoding, generating an error concealment frame of the current frame by interpolation according to the spectral coefficients and the symbols of the previous frame and the next frame of the current frame.
The invention adopts another technical scheme that: there is provided an audio error concealment apparatus comprising: the pitch signal detection module is used for judging whether the current frame is a pitch signal or not according to the pitch detection parameter value when LC3 audio coding is carried out; the pseudo-spectrum calculation module is used for calculating the pseudo-spectrum of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame if the current frame is a tone signal; the symbol extraction and transmission module is used for extracting symbols of all or part of the spectral coefficient values in the pseudo spectrum of the current frame and simultaneously transmitting the symbols and the next frame of the current frame; and the tone signal error concealment module is used for generating an error concealment frame of the current frame by interpolation according to the spectral coefficients and the symbols of the previous frame and the next frame of the current frame if the current frame has errors during decoding.
The technical scheme of the invention can achieve the following beneficial effects: the invention designs an audio error concealment method and device. The method can hide errors aiming at tone signals under the condition of ensuring tone quality, and provides better experience for users.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a diagram of an embodiment of an audio error concealment method according to the present invention;
FIG. 2 is a schematic diagram of another embodiment of an audio error concealment apparatus according to the present invention;
FIG. 3 is a schematic diagram of another embodiment of an audio error concealment apparatus of the present invention;
FIG. 4 is a diagram of an embodiment of a code stream format for storing symbols and positions according to an audio error concealment method of the present invention.
Embodiments of the present invention have been illustrated by the above-described drawings and will be described in more detail hereinafter. The drawings and the description are not intended to limit the scope of the inventive concept in any way, but rather to illustrate it by those skilled in the art with reference to specific embodiments.
Detailed Description
The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention easier to understand by those skilled in the art, and thus will clearly and clearly define the scope of the invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The audio error concealment method provided by the invention is applicable in the following scenes: classical bluetooth, bluetooth low energy, audio codec and error concealment.
Background art: in the LC3 standard specification, the error concealment is performed by first determining the packet loss status of the bluetooth signal according to whether the LC3 decoder receives an external error frame indicator or according to whether the LC3 decoder detects an error bit in the decoding process. When the external error frame indicator is 1 or the LC3 decoder detects a bit error in the decoding process, indicating that a packet loss phenomenon occurs in the Bluetooth signal, and starting an error concealment algorithm; and when the packet loss does not occur in the last frame of the packet loss frame, generating an error concealment frame by using the spectral coefficient of the last frame of the packet loss frame and the symbol corresponding to each randomly generated spectral coefficient.
The symbol corresponding to each randomly generated spectral coefficient is obtained by a random generation algorithm.
The error concealment method adopted by the prior art performs error concealment based on the short-time stationarity of a voice signal. In general, the spectral coefficient of the current frame has strong correlation with the spectral coefficient of the previous frame, so there is a certain reason to use the amplitude of the spectral coefficient of the previous frame to replace the amplitude of the spectral coefficient of the current frame, but the symbol corresponding to the randomly generated spectral coefficient of the current frame greatly deviates from the actual situation. Therefore, although the error concealment method adopted in the prior art has a simple algorithm, the error compensation effect is general, and the generated error-concealed audio signal has poor tone quality and can bring a user with poor use experience.
Generally, audio signals are classified into tonal signals and non-tonal signals from whether they have tonal components or not. Wherein, the frequency spectrum of the tone signal has strong harmonic components; the spectral characteristics of the non-tonal signal resemble noise or silence.
The error concealment method given in the LC3 standard uses the estimated spectral coefficients and randomly generated symbols to compute the error concealment frame. This method is effective for non-tonal signals, but for tonal signals, due to the fact that the spectral coefficients are phase sensitive, if random symbols are used to generate error concealment frames, the quality of the error concealed audio signal will be poor.
Based on the above problem, the present invention provides an audio error concealment method as shown in fig. 1 to solve the above problem. S101, when carrying out LC3 audio coding, judging whether the current frame is a tone signal according to a pitch detection parameter value;
s102, if the current frame is a tone signal, calculating to obtain a pseudo spectrum of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame;
s103, extracting all or partial signs of the spectral coefficient values in the pseudo spectrum of the current frame, and simultaneously transmitting the signs and the next frame of the current frame;
and S104, if the current frame has errors during decoding, interpolating to generate an error concealment frame of the current frame according to the spectral coefficients and the symbols of the previous frame and the next frame of the current frame.
According to the specific implementation mode, the encoding end and the decoding end are used for error concealment, so that the generated error concealment frame is closer to a real current frame, the tone quality of a concealment result is better, and the user experience is improved.
In the embodiment shown in fig. 1, the audio error concealment method mainly includes step S101, when performing LC3 audio coding, determining whether the current frame is a pitch signal according to the pitch detection parameter value.
In one embodiment of the present invention, when encoding is performed by using LC3, the LTPF module in LC3 is used to detect the pitch _ present state of the pitch detection parameter value of the current frame, and the state of pitch _ present is used to determine whether the current frame is a pitch signal. If the pitch _ present is 0, the current frame is a noise-like signal, and if the pitch _ present is 1, the current frame is a pitch signal.
In the embodiment, the current frames are classified, so that a foundation is laid for different processing on different types of current frames, and the calculation amount in the error concealment calculation process can be reduced.
In the embodiment shown in fig. 1, the audio error concealment method further includes step S102, if the current frame is a pitch signal, calculating to obtain a pseudo spectrum of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame.
In one embodiment of the present invention, if pitch _ present of the pitch detection parameter value of the current frame detected by the LTPF module in LC3 is 1, and the previous frame and the next frame of the current frame exist, the pseudo-spectrum calculation is performed on the current frame.
In the embodiment, the pseudo spectrum of the current frame is calculated, so that a foundation is laid for obtaining the actual symbol and the symbol position of the current frame.
In an embodiment of the invention, step S102 further includes obtaining each spectral coefficient in the corresponding current frame according to each spectral coefficient in the previous frame of the current frame and the spectral coefficient in the next frame of the corresponding current frame.
In one embodiment of the present invention, it is first necessary to calculate each spectral coefficient in the previous frame of the current frame and each spectral coefficient in the next frame of the current frame by using a formula.
Which has the formula of
Wherein k =0,1.
. Wherein
，n=0,1...
And is
，n=0,1...
，
，n=0,1...
. Wherein the content of the first and second substances,
is all the spectral coefficients of the sought frame,
is the length of a frame as specified in the LC3 standard specification, n represents the number of samples in a frame,
when the method is used for waveform coding, aliasing is prevented, and m represents the current frame which is obtained.
After each spectral coefficient in the previous frame of the current frame and each spectral coefficient in the next frame of the current frame are calculated and obtained by the formula, each spectral coefficient in the previous frame of the current frame and each spectral coefficient in the next frame of the current frame are utilized
，k=0,1...
And calculating to obtain each spectral coefficient in the corresponding current frame, namely calculating to obtain the corresponding pseudo spectrum. Wherein the content of the first and second substances,
is the spectral coefficient of the previous frame of the current frame,
is the spectral coefficient of the next frame of the current frame,
is the pseudo-spectrum of the current frame.
According to the specific embodiment, the pseudo spectrum of the current frame is calculated by fully utilizing the calculation formula in the LC3 standard specification, so that the introduction of external calculation equipment is avoided, and the cost is saved.
In the embodiment shown in fig. 1, the audio error concealment method further includes step S103, extracting symbols of all or part of the spectral coefficient values in the pseudo spectrum of the current frame, and transmitting the symbols and the next frame of the current frame at the same time.
In a specific embodiment of the present invention, step S103 further includes obtaining an absolute value of each spectral coefficient value in the pseudo spectrum of the current frame and sorting the absolute values from large to small; extracting symbols and corresponding positions of a predetermined number of frequency spectrum coefficient values ranked in the pseudo spectrum; and (4) putting the corresponding positions and symbols of the spectral coefficient values in the pseudo spectrum in the code stream of the next frame of the current frame in sequence and transmitting the code stream.
In a specific example of the present invention, the absolute values of the computed pseudo-spectrum of the current frame are taken and sorted in descending order. And determining a preset range of the spectral coefficient values to be extracted according to the sequencing result obtained by sequencing according to the precision requirement, and extracting the positions and symbols of the spectral coefficient values in all pseudo-spectra in the preset range. And the more positions and signs of the spectral coefficient values in the extracted pseudo spectrum are, the better the error concealment result of the tone signal is, but the larger the bandwidth required by the extracted pseudo spectrum is, so that the preset range of the spectral coefficient values to be extracted needs to be reasonably set according to the precision requirement.
In the specific embodiment, the symbol and the position in the pseudo spectrum are extracted, so that a foundation is laid for accurately restoring the current frame audio signal.
In one embodiment of the present invention, the positions and signs of the spectral coefficient values extracted in the pseudo-spectrum are sequentially placed in the code stream of the next frame of the current frame and transmitted to the decoding side using the next frame of the previous frame.
For example, when two sets of data are included in a predetermined range of positions and signs at which spectral coefficient values are extracted in the pseudo spectrum, the two sets of data are stored using a code stream of a frame next to the current frame in a manner as shown in fig. 4. When the code stream of the next frame is used for storing data, the frame type indication is stored firstly. The frame type indication occupies one bit, and when the bit corresponding to the frame type indication is 0, the current frame is a non-tone signal, and a randomly generated symbol is used for generating an error concealment frame when a decoding end decodes; when the frame type indicates that the corresponding bit is 1, the current frame is a tone signal, and an error concealment frame is generated at a decoding end by using the sign of the pseudo spectrum.
After the indication of the frame type, the symbol positions are stored, the positions of the spectral coefficient values extracted in the pseudo spectrum as shown in fig. 4 occupy 9 bits, for example, when the frame length is 10ms and the sampling rate is 48kHz, the total number of the spectral coefficients of each frame signal is 480, so that the 9 bits can represent 0 to 511 positions in total, and the requirement of 0 to 479 spectral coefficients can be met.
A specific symbol is stored behind the symbol position in fig. 4, the symbol occupies one bit, and when the bit corresponding to the symbol is 0, the symbol is a positive sign; the sign is a negative sign when the bit corresponding to the sign is 1.
In the specific embodiment, the next frame code stream of the current frame is used for transmitting the symbols and the positions, so that the data of the current frame are prevented from being lost completely when the current frame is lost.
In the embodiment shown in fig. 1, the audio error concealment method further includes step S104, if an error occurs in the current frame during decoding, generating an error concealment frame of the current frame by interpolation according to the spectral coefficients and signs of the previous frame and the next frame of the current frame.
In an embodiment of the present invention, if an error occurs during decoding of the current frame, the gain of the current frame is calculated by using the previous frame and the next frame of the current frame, and the spectral coefficient of the current frame is calculated by using the gain of the current frame and the spectral coefficient of the previous frame of the current frame.
According to the specific embodiment, the generated error concealment frame is closer to the real current frame, the tone quality of the error concealment frame is improved, and the user experience is improved.
In a specific embodiment of the present invention, step S104 further includes calculating a gain of the current frame according to a previous frame and a next frame of the current frame; calculating to obtain a spectral coefficient value of the current frame according to the gain of the current frame and the previous frame of the current frame; and generating an error concealment frame of the current frame according to the spectral coefficient value and the symbol of the current frame.
In one embodiment of the invention, the current frame is based on a previous frame and a next frame of the current frameBy the formula
Calculating gain of current frame, and k =
. Wherein the content of the first and second substances,
representing the energy of the kth spectral coefficient of the next frame of the current frame,
representing the energy of the kth spectral coefficient of the previous frame of the current frame,
represents the sum of the energies of the next frame of the current frame within a certain frequency band,
the total energy of the previous frame of the current frame in a certain frequency band is represented, and g (k) is obtained by the ratio of the total energy of the next frame of the current frame in the certain frequency band to the total energy of the previous frame of the current frame in the corresponding frequency band.
In the embodiment, the gain of the current frame is calculated, so that a foundation is laid for obtaining the current frame by calculation at a decoding end.
In a specific embodiment of the present invention, step S104 further includes obtaining a symbol and a corresponding position of a pseudo spectrum of the current frame from a next frame code stream of the current frame; and adding the symbol to the spectral coefficient value of the corresponding position in the current frame to obtain the error concealment frame of the current frame.
In an embodiment of the present invention, when a symbol and a corresponding position of a pseudo spectrum of a current frame are obtained from a next frame code stream of the current frame, if a frame type obtained from the code stream indicates 1, that is, the current frame is a tone signal, the current frame corresponding to the position of the current frame in the next frame code stream at a decoder end is utilized
And calculating to obtain the final product, wherein,
the sign representing the spectral coefficient extracted by the decoder from the next frame code stream. And calculating the current frame spectral coefficient which does not correspond to the position of the current frame spectral coefficient in the next frame code stream at the decoder end by using a non-tonal signal spectral coefficient generation method to obtain the corresponding error concealment frame spectral coefficient.
This embodiment has solved among the prior art and has carried out the relatively poor problem of tone quality after the error concealment to the tone signal, has strengthened the tone quality experience of user when insensitive to delay.
In an embodiment of the invention, the audio error concealment method further includes, if the current frame is a non-tonal signal and an error occurs during decoding of the current frame, interpolating to generate an error concealment frame of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame and the random symbol.
In an embodiment of the present invention, when obtaining the symbol and the corresponding position of the pseudo spectrum of the current frame in the next frame code stream of the current frame, if the frame type obtained from the code stream indicates 0, that is, the current frame is a non-tonal signal, a formula is used
And adding random symbols to the calculated current frame spectral coefficients at the decoder end. Wherein the content of the first and second substances,
representing a randomly generated sign.
According to the specific embodiment, the tone quality in error concealment is improved, and the user experience is improved.
In a specific embodiment of the present invention, the audio error concealment method further includes, if an error occurs in the current frame audio signal decoding process, determining whether a previous frame of the current frame is a pitch signal according to the pitch detection parameter value; and if the previous frame of the current frame is a tone signal, performing error concealment by using the time domain signal of the previous frame, and if the previous frame of the current frame is a non-tone signal, performing error concealment by using the frequency domain signal of the previous frame.
In one embodiment of the present invention, if an error occurs in the current frame and the pitch detection parameter value pitch _ present of the previous frame of the current frame is 1 at the decoder side, that is, the previous frame of the current frame is a pitch signal, the previous frame of the current frame is used to perform error concealment based on the time domain, and the waveform of an integer number of pitch periods is substantially copied from the previous frame of the current frame and error concealment is performed by combining a phase matching technique. If an error occurs in the current frame at the decoder side and the pitch detection parameter value pitch _ present of the previous frame of the current frame is 0, that is, the previous frame is a non-pitch signal, the previous frame of the current frame is utilized to perform error concealment based on the frequency domain.
According to the specific embodiment, whether the previous frame of the current frame is a tone signal is judged at the decoder side and processed according to the judgment result, so that delay in error concealment is reduced, and meanwhile, switching is performed between error concealment at the decoder side and error concealment by using the decoder and the encoder simultaneously according to requirements, so that flexibility is higher.
Fig. 2 shows an embodiment of the audio error concealment apparatus of the present invention.
In this embodiment, the audio error concealment apparatus mainly includes: a pitch signal detection module 201, configured to determine whether the current frame is a pitch signal according to a pitch detection parameter value when performing LC3 audio coding;
a pseudo-spectrum calculating module 202, configured to calculate a pseudo-spectrum of the current frame according to spectral coefficients of a previous frame and a next frame of the current frame if the current frame is a tone signal;
a symbol extraction and transmission module 203, configured to extract symbols of all or part of the spectral coefficient values in the pseudo spectrum of the current frame, and transmit the symbols and a next frame of the current frame at the same time;
the tone signal error concealment module 204 is configured to interpolate and generate an error concealment frame of the current frame according to the spectral coefficients and symbols of the previous frame and the next frame of the current frame if the current frame is in error during decoding.
In an embodiment of the invention, the audio error concealment apparatus further includes a non-tonal signal error concealment module, configured to interpolate and generate an error concealment frame of the current frame according to a previous frame and a next frame of the current frame and a random symbol if the current frame is a non-tonal signal and an error occurs during decoding of the current frame.
In the specific embodiment, the non-tone signal error concealment module is used for processing the non-tone signal during error concealment, so that the problem which can be solved by the audio error concealment device is more comprehensive and better meets the requirements of customers.
In an embodiment of the present invention, the audio error concealment apparatus further includes a previous frame tone signal detection module, configured to determine whether a previous frame of the current frame is a tone signal according to the pitch detection parameter value;
and the tone signal error concealment module is used for carrying out error concealment by using the time domain signal of the previous frame if the audio signal of the current frame is in error in the decoding process, and carrying out error concealment by using the frequency domain signal of the previous frame if the previous frame of the current frame is a tone signal.
In the embodiment, the previous frame of audio signal is judged by using the previous frame of tone signal detection module and the tone signal error concealment module, so that the effect of reducing delay during error concealment is realized, and the flexibility and the application range of the audio error concealment device are improved.
In an embodiment of the present invention, the functional modules in the audio error concealment apparatus of the present invention may be directly in hardware, in a software module executed by a processor, or in a combination of the two.
A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium.
The Processor may be a Central Processing Unit (CPU), other general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), other Programmable logic devices, discrete Gate or transistor logic, discrete hardware components, or any combination thereof. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.
The audio error concealment apparatus provided by the present invention can be used to perform the audio error concealment method described in any of the above embodiments, and the implementation principle and technical effect are similar, which are not described herein again.
Fig. 3 shows a specific embodiment of the audio error concealment device of the present invention.
In this embodiment, the audio error concealment apparatus mainly includes: last frame pitch signal detection means 301, high sound quality error concealment means 302, low delay error concealment means 303 and switching means 304.
The previous frame tone signal detection module 301 is configured to determine whether a previous frame of the current frame is a tone signal according to the pitch detection parameter value;
high sound quality error concealment means 302;
the low-delay error concealment apparatus 303 includes a low-delay tone signal error concealment module, and a low-delay non-tone signal error concealment module,
the low-delay tone signal error concealment module is used for concealing errors by using a time domain signal of a previous frame when the current frame audio signal is subjected to errors in the decoding process and the previous frame of the current frame is judged to be a tone signal by using the previous frame tone signal detection device;
the low-delay non-tone signal error concealment module is used for concealing errors by using a frequency domain signal of a previous frame when the current frame audio signal is subjected to errors in the decoding process and the previous frame of the current frame is judged to be a non-tone signal by using a previous frame tone signal detection device;
the switching means is used to select the high-sound quality error concealment means or the low-delay error concealment means for error concealment according to the usage scenario 304.
In an embodiment of the present invention, the high sound quality error concealment apparatus is characterized in that an encoder is combined with a decoder to perform error concealment based on parameters of a previous frame audio signal and a next frame audio signal of a current frame audio signal. The low-delay error concealment apparatus is characterized in that an error concealment process based on parameters of a previous frame audio signal of a current frame audio signal is separately performed at a decoder side.
In practical application, in the process of establishing a link by Bluetooth pairing according to application requirements, a switching device is used for autonomously selecting and switching two error concealment devices according to the application requirements, for example, a user is sensitive to delay in game playing, and the switching device can be used for switching to a low-delay error concealment device. When listening to music, which is more interesting for sound quality but less sensitive to delay, a switching means may be used to switch to a high sound quality error concealment means.
According to the specific embodiment, by switching between the high-tone-quality error concealment device and the low-delay error concealment device, the error concealment can be flexibly performed according to the requirements of users, and better use experience is provided for the users.
In another embodiment of the present invention, a computer-readable storage medium stores computer instructions operable to perform the audio error concealment method of scheme one.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent structural changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An audio error concealment method, comprising,
when LC3 audio coding is carried out, whether the current frame is a tone signal is judged according to the pitch detection parameter value;
if the current frame is a tone signal, calculating to obtain a pseudo spectrum of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame;
extracting symbols of all or part of the spectral coefficient values in the pseudo spectrum of the current frame, and simultaneously transmitting the symbols and the next frame of the current frame;
and if the current frame has errors during decoding, generating an error concealment frame of the current frame by interpolation according to the spectral coefficients and the symbols of the previous frame and the next frame of the current frame.
2. The audio error concealment method of claim 1,
and if the current frame is a non-tonal signal and the current frame is wrong during decoding, interpolating and generating the error concealment frame of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame and a random symbol.
3. The audio error concealment method of claim 1, wherein said calculating the pseudo spectrum of the current frame based on the spectral coefficients of the previous frame and the next frame of the current frame comprises,
and obtaining each spectral coefficient in the corresponding current frame according to each spectral coefficient in the previous frame of the current frame and the spectral coefficient in the next frame corresponding to the current frame.
4. The audio error concealment method of claim 1, wherein said process of generating an error concealment frame for a current frame by interpolation based on the spectral coefficients of said previous frame and said next frame of said current frame and said symbols comprises,
calculating gain of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame;
calculating the spectral coefficient value of the current frame according to the gain of the current frame and the spectral coefficient of the previous frame of the current frame;
and generating an error concealment frame of the current frame according to the spectral coefficient value of the current frame and the symbol.
5. The audio error concealment method of claim 4, wherein said process of extracting the signs of all or part of the spectral coefficient values in the pseudospectrum of the current frame comprises,
calculating absolute values of all spectral coefficient values in the pseudo spectrum of the current frame and sorting the absolute values from large to small;
extracting the signs and the corresponding positions of a predetermined number of the values of the spectral coefficients ranked first in the pseudo-spectrum;
the process of simultaneously transmitting the symbol and the next frame of the current frame comprises the steps of sequentially placing the corresponding positions of the spectral coefficient values in the pseudo spectrum and the symbol on a code stream of the next frame of the current frame and transmitting the code stream;
the generating of the error concealment frame of the current frame according to the spectral coefficient value of the current frame and the symbol includes generating the error concealment frame of the current frame according to the spectral coefficient value of the current frame, the symbol and the corresponding position interpolation.
6. The audio error concealment method of claim 5, wherein said process of generating an error concealment frame for said current frame by interpolating based on said spectral coefficient values of said current frame and said symbols and said corresponding positions comprises,
obtaining the symbol and the corresponding position of the pseudo-spectrum of the current frame from the next frame code stream of the current frame;
and adding the symbol to the spectral coefficient value of the corresponding position in the current frame to obtain the error concealment frame of the current frame.
7. The audio error concealment method of claim 1, further comprising,
if the decoding process of the current frame audio signal is wrong, judging whether the previous frame of the current frame is a tone signal according to the pitch detection parameter value;
and if the previous frame of the current frame is a tone signal, performing error concealment by using the time domain signal of the previous frame, and if the previous frame of the current frame is a non-tone signal, performing error concealment by using the frequency domain signal of the previous frame.
8. An audio error concealment apparatus, comprising:
the pitch signal detection module is used for judging whether the current frame is a pitch signal or not according to the pitch detection parameter value when LC3 audio coding is carried out;
the pseudo-spectrum calculation module is used for calculating the pseudo-spectrum of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame if the current frame is a tone signal;
a symbol extraction and transmission module, configured to extract symbols of all or part of spectral coefficient values in the pseudo spectrum of the current frame, and transmit the symbols and the next frame of the current frame at the same time;
and the tone signal error concealment module is used for generating an error concealment frame of the current frame by interpolation according to the spectral coefficients and the symbols of the previous frame and the next frame of the current frame if the current frame has errors during decoding.
9. The audio error concealment apparatus of claim 8, further comprising,
a non-tonal signal error concealment module, configured to interpolate and generate the error concealment frame of the current frame according to the spectral coefficients of the previous frame and the next frame of the current frame and a random symbol if the current frame is a non-tonal signal and an error occurs during decoding of the current frame.
10. The audio error concealment apparatus of claim 8, further comprising,
the previous frame tone signal detection module is used for judging whether the previous frame of the current frame is a tone signal according to the pitch detection parameter value;
the tone signal error concealment module is configured to perform error concealment by using the time domain signal of the previous frame if an error occurs in the current frame audio signal decoding process and the previous frame of the current frame is a tone signal, and perform error concealment by using the frequency domain signal of the previous frame if the previous frame of the current frame is a non-tone signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110497715.2A CN112992160B (en) | 2021-05-08 | 2021-05-08 | Audio error concealment method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110497715.2A CN112992160B (en) | 2021-05-08 | 2021-05-08 | Audio error concealment method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112992160A CN112992160A (en) | 2021-06-18 |
| CN112992160B true CN112992160B (en) | 2021-07-27 |
Family
ID=76337261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110497715.2A Active CN112992160B (en) | 2021-05-08 | 2021-05-08 | Audio error concealment method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112992160B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113724725B (en) * | 2021-11-04 | 2022-01-18 | 北京百瑞互联技术有限公司 | Bluetooth audio squeal detection suppression method, device, medium and Bluetooth device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103620672A (en) * | 2011-02-14 | 2014-03-05 | 弗兰霍菲尔运输应用研究公司 | Apparatus and method for error concealment in low-delay unified speech and audio coding (usac) |
| WO2020164751A1 (en) * | 2019-02-13 | 2020-08-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Decoder and decoding method for lc3 concealment including full frame loss concealment and partial frame loss concealment |
| CN111833891A (en) * | 2020-07-21 | 2020-10-27 | 北京百瑞互联技术有限公司 | LC3 encoding and decoding system, LC3 encoder and optimization method thereof |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9020812B2 (en) * | 2009-11-24 | 2015-04-28 | Lg Electronics Inc. | Audio signal processing method and device |
| EP3288026B1 (en) * | 2013-10-31 | 2020-04-29 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder and method for providing a decoded audio information using an error concealment based on a time domain excitation signal |
-
2021
- 2021-05-08 CN CN202110497715.2A patent/CN112992160B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103620672A (en) * | 2011-02-14 | 2014-03-05 | 弗兰霍菲尔运输应用研究公司 | Apparatus and method for error concealment in low-delay unified speech and audio coding (usac) |
| WO2020164751A1 (en) * | 2019-02-13 | 2020-08-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Decoder and decoding method for lc3 concealment including full frame loss concealment and partial frame loss concealment |
| TW202044779A (en) * | 2019-02-13 | 2020-12-01 | 弗勞恩霍夫爾協會 | Multi-mode channel coding |
| CN111833891A (en) * | 2020-07-21 | 2020-10-27 | 北京百瑞互联技术有限公司 | LC3 encoding and decoding system, LC3 encoder and optimization method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 一种小波域音频信息隐藏方法;李倩等;《宁波大学学报(理工版)》;20040930(第03期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112992160A (en) | 2021-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11256740B2 (en) | Methods and apparatus to perform audio watermarking and watermark detection and extraction | |
| US11386908B2 (en) | Methods and apparatus to perform audio watermarking and watermark detection and extraction | |
| BRPI0913228B1 (en) | METHOD OF RECOVERING A MESSAGE OF DATA INCORPORATED IN AN AUDIO SIGNAL AND RECEIVING APPARATUS | |
| BRPI0812029B1 (en) | method of recovering hidden data, telecommunication device, data hiding device, data hiding method and upper set box | |
| CN114550732B (en) | Coding and decoding method and related device for high-frequency audio signal | |
| CN112992160B (en) | Audio error concealment method and device | |
| CN107452391B (en) | Audio coding method and related device | |
| CN113035208B (en) | Hierarchical error concealment method and device for audio decoder and storage medium | |
| US20230162744A1 (en) | Methods and apparatus to perform audio watermarking and watermark detection and extraction | |
| US11121721B2 (en) | Method of error concealment, and associated device | |
| AU2013203674B2 (en) | Methods and apparatus to perform audio watermarking and watermark detection and extraction | |
| AU2013203838B2 (en) | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: A1009, floor 9, block a, No. 9, Shangdi Third Street, Haidian District, Beijing 100085 Patentee after: Beijing Bairui Internet Technology Co.,Ltd. Address before: 7-1-1, building C, 7 / F, building 2-1, No.2, Shangdi Information Road, Haidian District, Beijing 100085 Patentee before: BARROT WIRELESS Co.,Ltd. |