WO2008066265A1 - Frame error concealment method and apparatus and error concealment scheme construction method and apparatus - Google Patents

Frame error concealment method and apparatus and error concealment scheme construction method and apparatus Download PDF

Info

Publication number
WO2008066265A1
WO2008066265A1 PCT/KR2007/005694 KR2007005694W WO2008066265A1 WO 2008066265 A1 WO2008066265 A1 WO 2008066265A1 KR 2007005694 W KR2007005694 W KR 2007005694W WO 2008066265 A1 WO2008066265 A1 WO 2008066265A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
frame
block
error concealment
previous
Prior art date
Application number
PCT/KR2007/005694
Other languages
French (fr)
Inventor
Ho-Sang Sung
Ki-Hyun Choo
Jung-Hoe Kim
Eun-Mi Oh
Chang-Yong Son
Kang-Eun Lee
Original Assignee
Samsung Electronics Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co., Ltd. filed Critical Samsung Electronics Co., Ltd.
Publication of WO2008066265A1 publication Critical patent/WO2008066265A1/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/0017Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H04N19/895Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/005Correction of errors induced by the transmission channel, if related to the coding algorithm
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/022Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring

Definitions

  • the present invention relates to a method of and apparatus for concealing an error of a frame in the time domain, and more particularly, to a frame error concealment method and apparatus, in which an error of a frame, i.e., a frame error, is concealed by reconstructing a signal of the frame using a signal of a previous frame preceding the error frame and/or a signal of a next frame following the error frame.
  • a frame error concealment method and apparatus in which an error of a frame, i.e., a frame error, is concealed by reconstructing a signal of the frame using a signal of a previous frame preceding the error frame and/or a signal of a next frame following the error frame.
  • an error may be generated in a frame of a decoded audio signal due to a transmission error.
  • Error concealment may be classified into a frequency-domain error concealment scheme and a time-domain error concealment scheme.
  • the frequency-domain error concealment scheme may be divided into a repetition method that reconstructs a signal of an error frame by reusing spectrum coefficients of a previous frame in the error frame and an interpolation method that reconstructs spectrum coefficients of an error frame by interpolating spectrum coefficients of a previous frame and a next frame.
  • MDCT Modulated Discrete Cosine Transformation
  • the time-domain error concealment scheme can also be divided into a repetition method that repetitively reproduces a time-domain sample of a previous frame in an error frame, an interpolation method that reconstructs a time-domain sample of an error frame by interpolating time-domain samples of a previous frame and a next frame, and other methods that reconstruct a signal of an error frame by analyzing a signal of a previous frame.
  • a repetition method that repetitively reproduces a time-domain sample of a previous frame in an error frame
  • an interpolation method that reconstructs a time-domain sample of an error frame by interpolating time-domain samples of a previous frame and a next frame
  • other methods that reconstruct a signal of an error frame by analyzing a signal of a previous frame.
  • the repetition method in the time domain when an error occurs over a long interval, the same spectrum signal of a previous frame is repeated over the long interval, causing modulation noise.
  • the present invention provides a frame error concealment method and apparatus using an overlapping method that prevents modulation noise from occurring by synthesizing a plurality of previous signals to reconstruct a signal of an error frame.
  • the present invention also provides an error concealment scheme construction method and apparatus, in which a plurality of time-domain frame error concealment methods including the overlapping method are properly combined in order to construct an error concealment scheme for concealing frame errors occurring in a plurality of frames in the time domain, thereby maximizing the sound quality of reconstructed signals of the error frames.
  • the present invention also provides an adaptive frame error concealment method and apparatus, in which an error concealment scheme for concealing frame errors occurring in a plurality of frames is constructed using the frame error concealment scheme construction method and the frame errors are concealed using the constructed error concealment scheme, thereby maximizing the sound quality of reconstructed signals of the error frames.
  • the present invention also provides a computer-readable recording medium having recorded thereon a program for implementing one of the frame error concealment method using the overlapping method, the error concealment scheme construction method, and the adaptive frame error concealment method.
  • a frame error concealment method including (a) extracting a first signal and a second signal that are similar to a signal of a current frame having an error from a previous frame preceding the current frame, (b) generating a synthetic signal for reconstructing the signal of the current frame using the extracted first signal and second signal, and (c) reconstructing the signal of the current frame using the generated synthetic signal.
  • (a) may include (al) searching in the previous frame for a first block and a second block that are similar to a previous block located immediately previous to the current frame and (a2) extracting the first signal and the second signal by referring to the positions of the found first block and second block.
  • (b) may include (bl) windowing the extracted first signal and second signal and (b2) overlapping and adding the windowed first signal and second signal.
  • (bl) may include (bl 1) determining a first window function for windowing the first signal based on correlation between the first block and the previous block and de- termining a second window function for windowing the second signal based on correlation between the second block and the previous block and (bl2) windowing the first signal and the second signal by multiplying the first signal by the determined first window function and multiplying the second signal by the determined second window function.
  • (bl 1) may include determining the first window function and the second window function so that the first window function and the second window function are summed as 1.
  • (bl 1) may include determining the first window function based on the correlation between the first block and the previous block and determining the second window function based on the correlation between the second block and the previous block,
  • (bl 1) may include determining the first window function and the second window function so that the greater weight is applied to one of the first signal and the second signal whose block has the higher correlation with the previous block,
  • (bl 1) may include determining the first window function and the second window function so that one of the first signal and the second signal whose block has the higher correlation with the previous block is faded out and the other is faded in.
  • [13] (c) may include repeating the synthetic signal at least once in the current frame.
  • a frame error concealment method including extracting a plurality of signals that are similar to a signal of a current frame having an error from a previous frame preceding the current frame, generating a synthetic signal for reconstructing the signal of the current frame using the extracted plurality of signals, and reconstructing the signal of the current frame using the generated synthetic signal.
  • a n error concealment scheme construction method including (a) analyzing error concealment conditions of a previous frame preceding and a next frame following a current frame having an error and (b) selecting an error concealment scheme for the current frame from among an overlapping method, a repetition method, and an interpolation method in a time domain based on the analysis result.
  • [16] (a) may include analyzing at least one of whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, whether an error occurs in the next frame, and whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
  • an adaptive frame error concealment method including selecting one of an overlapping method, a repetition method, and an interpolation method in a time domain as an error concealment scheme for a current frame having an error based on error concealment conditions of a previous frame preceding and a next frame following the current frame and concealing the error using the selected error concealment scheme.
  • a frame error concealment apparatus including a similar signal extraction unit, a synthetic signal generation unit, and a reconstruction unit.
  • the similar signal extraction unit extracts a first signal and a second signal that are similar to a signal of a current frame having an error from a previous frame preceding the current frame.
  • the synthetic signal generation unit generates a synthetic signal for reconstructing the signal of the current frame using the extracted first signal and second signal.
  • the reconstruction unit reconstructs the signal of the current frame using the generated synthetic signal.
  • the similar signal extraction unit may search in the previous frame for a first block and a second block that are similar to a previous block located immediately previous to the current frame and extracts the first signal and the second signal by referring to the positions of the found first block and second block.
  • the first block and the second block may have the highest correlation with the previous block.
  • the synthetic signal generation unit may include a windowing unit windowing the extracted first signal and second signal and a synthesis unit overlapping and adding the windowed first signal and second signal.
  • the windowing unit may include a window function determination unit and a multiplication unit.
  • the window function determination unit determines a first window function for windowing the first signal based on correlation between the first block and the previous block and determines a second window function for windowing the second signal based on correlation between the second block and the previous block.
  • the multiplication unit windows the first signal and the second signal by multiplying the first signal by the determined first window function and multiplying the second signal by the determined second window function.
  • the window function determination unit may determine the first window function and the second window function so that the first window function and the second window function are summed as 1.
  • the window function determination unit may determine the first window function based on the correlation between the first block and the previous block and determine the second window function based on the correlation between the second block and the previous block.
  • the window function determination unit may determine the first window function and the second window function so that the greater weight is applied to one of the first signal and the second signal whose block has the higher correlation with the previous block.
  • the window function determination unit may determine the first window function and the second window function so that one of the first signal and the second signal whose block has the higher correlation with the previous block is faded out and the other is faded in.
  • the reconstruction unit may repeat the synthetic signal at least once in the current frame.
  • a frame error concealment apparatus including a similar signal extraction unit, a synthetic signal generation unit, and a reconstruction unit.
  • the similar signal extraction unit extracts a plurality of signals that are similar to a signal of a current frame having an error from a previous frame preceding the current frame.
  • the synthetic signal generation unit generates a synthetic signal for reconstructing the signal of the current frame using the extracted plurality of signals.
  • the reconstruction unit reconstructs the signal of the current frame using the generated synthetic signal.
  • a n error concealment scheme construction apparatus including an analysis unit and a selection unit.
  • the analysis unit analyzes error concealment conditions of a previous frame preceding and a next frame following a current frame having an error.
  • the selection unit selects an error concealment scheme for the current frame from among an overlapping method, a repetition method, and an interpolation method in a time domain based on the analysis result.
  • the analysis unit may analyze at least one of whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, whether an error occurs in the next frame, and whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
  • an adaptive frame error concealment apparatus including an error concealment scheme selection unit and an error concealment unit.
  • the error concealment scheme selection unit selects one of an overlapping method, a repetition method, and an interpolation method in a time domain as an error concealment scheme for a current frame having an error based on error concealment conditions of a previous frame preceding and a next frame following the current frame.
  • the error concealment unit conceals the error using the selected error concealment scheme.
  • FIG. 1 is a reference diagram for explaining a frame error concealment method using a repetition method according to an exemplary embodiment of the present invention
  • FIG. 2 is a flowchart illustrating a frame error concealment method using an overlapping method according to an exemplary embodiment of the present invention
  • FIG. 3 is a reference diagram for explaining a frame error concealment method using an overlapping method according to an exemplary embodiment of the present in vention
  • FIGS. 4A, 4B and 4C are reference diagrams for explaining the determination of a first window function and a second window function illustrated in FIG.
  • FIG. 5 is a block diagram of a frame error concealment apparatus using an overlapping method according to an exemplary embodiment of the present invention
  • FIG. 6 is a reference diagram for explaining a frame error concealment method using an interpolation method according to an exemplary embodiment of the present invention
  • FIG. 7 is a flowchart illustrating an adaptive frame error concealment method using an error concealment scheme construction method according to an exemplary embodiment of the present invention
  • FIG. 8 is a reference diagram for explaining the influence of a frame error in a frequency domain upon a frame in a time domain; [40] FIGS.
  • FIG. 10 is a block diagram of an adaptive frame error concealment apparatus including an error concealment scheme construction apparatus according to an exemplary embodiment of the present invention.
  • FIG. 1 is a reference diagram for explaining the repetition method according to an exemplary embodiment of the present invention. The repetition method searches in a previous frame for a signal that is similar to a signal of the current frame having an error and copies the found signal to the current frame, thereby reconstructing a signal of the current frame.
  • the correlation can be calculated as follows:
  • R(d) is a correlation
  • S ⁇ ) is a signal of a previous frame
  • d is the position of a sample in a search region.
  • the reason why the similar block 120 and the overlapping block 140, together with the signal 130, are copied to the n frame 100 is to prevent a discontinuous signal from being output at a boundary between an (n-1) frame and the n frame by overlapping and adding the previous block 110 at the boundary of the (n-1) frame to the similar block 120 copied to the n frame.
  • the reason why the overlapping block 140, together with the signal 130, is copied to the n frame is to prevent discontinuity at the boundary between the (n-1) frame and the n frame by overlapping and adding the overlapping block 140 copied to the n frame to a start portion of an (n+1) frame when the n frame and the (n+1) frame are good frames.
  • the size of the window function may be determined using a linear function, a polynomial function, or a trigonometric function in the similar block 120 or the overlapping block 140 where overlapping occurs and a rectangular window may be used in the signal 130 where overlapping does not occur.
  • weights applied to two functions in the overlapping of two blocks are summed as 1. Therefore, for using a window function on a block that overlaps the similar block 120 or the overlapping block 140, it is desirable to use a window that is out of phase with a window used for the similar block 120 or the overlapping block 140.
  • FIG. 2 is a flowchart illustrating an overlapping method according to an exemplary embodiment of the present invention
  • FIG. 3 is a reference diagram for explaining the overlapping method according to an exemplary embodiment of the present invention.
  • the overlapping method searches in a previous frame for a plurality of signals that are similar to a signal of the current error frame, generates a new signal by synthesizing the found signals, and copies the generated new signal to the current error frame, thereby reconstructing the signal of the current error frame.
  • a first previous signal 350 including the found first similar block 320 and its following first next signal 330 of a predetermined length and a second previous signal 355 including the found second similar block 325 and its following second next signal 335 of a predetermined length are synthesized in order to generate a synthetic signal 360 for reconstructing the n frame 300.
  • the synthetic signal 360 includes a similar block 370, a portion 380 that is directly used for reconstructing a signal of the n frame 300, and an overlapping block 390.
  • consecutive next signals 330 and 340 following the first similar block 320 and consecutive next signals 335 and 345 following the second similar block 325 may be similar to the signal of the n frame 300.
  • the first similar block 320 and the first overlapping (OV) block 340 are included in the first previous signal 350
  • the second similar block 325 and the second overlapping block 345 are included in the second overlapping (OV) block 345, so as to cause the synthetic signal 360 to include the similar block 370 and the overlapping block 390, thereby preventing the occurrence of discontinuity at the boundary between the synthetic signal 360 and a signal that has been output before or is to be output after the synthetic signal 360 when the synthetic signal 360 is copied to the current frame.
  • the synthetic signal 360 can be smoothed by overlapping and adding the similar block 370 to the signal preceding the synthetic signal 360 or overlapping and adding the overlapping block 390 to the signal following the synthetic signal 360.
  • a first window function for windowing the first previous signal 350 and a second window function for windowing the second previous signal 355 are determined based on a correlation between the first similar block 320 and the previous block 310 and based on a correlation between the second similar block 325 and the previous block 310, respectively.
  • the first window function and the second window function be summed as 1. It is also desirable to determine the first window function and the second window function so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310.
  • a previous signal which is more similar to a signal of an error frame than the other previous signal, is used as the larger part of the synthetic signal 360 generated by sy nthesizing the first previous signal 350 and the second previous signal 355 that are windowed by being multiplied by window functions, thereby generating the synthetic signal 360 that more approximates the signal of the error frame.
  • the first window function and the second window function may also be determined so that in the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355, one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is faded out and the other previous signal is faded in.
  • FIGS. 4A, 4B and 4C are reference diagrams for explaining the determination of the first window function and the second window function based on a correlation between the first similar block 320 with the previous block 310 and a correlation between the second similar block 325 with the previous block 310.
  • the first window function and the second window function are determined as follows: [58]
  • F(x) is a linear function 410 that reduces from 1 to 0 for
  • F(x) ranges between the linear function 410 and the constant function 430. [60] As illustrated in FIGS. 4A, 4B and 4C , the first window function
  • 5Cl is a correlation between the first similar block 320 and the previous block 310
  • BC 2 is a correlation between the second similar block 325 and the previous block 310
  • m is the number of time-domain samples included in the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
  • the first window function and the second window function are determined so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310. Additionally, the first window function and the second window function are determined so that one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is output prior to the other previous signal, thereby causing the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 that are windowed by the first window function and the second window function, so as to more approximate the signal of the current n frame.
  • the first previous signal 350 and the second previous signal 355 are windowed by being multiplied by the determined first window function and the determined second window function, respectively, in operation 230, and then are overlapped and added to each other, thereby generating the synthetic signal 360 in operation 240.
  • the generated synthetic signal 360 is copied to the n frame at least once.
  • the start portion of the synthetic signal 360 is smoothed by overlapping and adding the similar block 370 of the synthetic signal 360 to the previous block 310 of the previous (n-1) frame, so as to prevent discontinuity at a boundary between the synthetic signal 360 and another signal.
  • the end portion of the synthetic signal 360 is smoothed by overlapping and adding the overlapping block 390 of the synthetic signal 360 to a block of the start portion of the next (n+1) frame.
  • FIG. 5 is a block diagram of a frame error concealment apparatus using the overlapping method according to an exemplary embodiment of the present invention.
  • the frame error concealment apparatus includes a similar signal extraction unit 500, a synthetic signal generation unit 510, and a reconstruction unit 520.
  • the synthetic signal generation unit 510 includes a window function determination unit 530 and a synthesis unit 540.
  • the similar signal extraction unit 500 searches in a search range of a previous frame for two similar blocks having the highest correlation with a signal of the previous block 310 located immediately previous to the n' frame having an error. Let the first found similar block be the first similar block 320 and let the second found similar block be the second similar block 325.
  • the synthetic signal generation unit 510 generates the synthetic signal 360 for reconstructing the n frame by synthesizing the first previous signal 350 including the found first similar block 320 and its following first next signal 330 of a predetermined length and the second previous signal 355 including the found second similar block 325 and its following second next signal 335 of a predetermined length.
  • the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 includes the similar block 370, the portion 380 that is directly used for reconstructing the signal of the n frame, and the overlapping block 390.
  • the consecutive next signals 330 and 340 following the first similar block 320 and the consecutive next signals 335 and 345 following the second similar block 325 may be similar to the signal of the n frame.
  • the first similar block 320 and the first overlapping (OV) block 340 are included in the first previous signal 350
  • the second similar block 325 and the second overlapping block 345 are included in the second overlapping (OV) block 345, so as to cause the synthetic signal 360 to include the similar block 370 and the overlapping block 390, thereby preventing the occurrence of discontinuity at the boundary between the synthetic signal 360 and a signal that has been output before or is to be output after the synthetic signal 360 when the synthetic signal 360 is copied to the current frame.
  • the synthetic signal 360 can be smoothed by overlapping and adding the similar block 370 to the signal preceding the synthetic signal 360 or overlapping and adding the overlapping block 390 to the signal following the synthetic signal 360.
  • the window function determination unit 530 determines the first window function for windowing the first previous signal 350 based on a correlation between the first similar block 320 and the previous block 310 and the second window function for windowing the second previous signal 355 based on a correlation between the second similar block 325 and the previous block 310.
  • the first window function and the second window function be summed as 1. It is also desirable to determine the first window function and the second window function so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 .
  • a previous signal that is more similar to a signal of an error frame than the other previous signal would be the larger part of the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 that are windowed by being multiplied by window functions, thereby generating the synthetic signal 360 that more approximates the signal of the error frame.
  • the window function determination unit 530 may also determine the first window function and the second window function so that in the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355, one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is faded out and the other previous signal is faded in.
  • FIGS. 4A, 4B and 4C are reference diagrams for explaining the determination of the first window function and the second window function based on a correlation between the first similar block 320 with the previous block 310 and a correlation between the second similar block 325 with the previous block 310.
  • the first window function and the second window function are determined as follows:
  • m is the number of time-domain samples constituting the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
  • m is the number of time-domain samples constituting the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
  • m is the number of time-domain samples constituting the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
  • m is the number of time-domain samples constituting the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
  • m is the number of time-domain samples constituting the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
  • Jt O and is a constant function 430 having a value of 1 for
  • F(x) ranges between the linear function 410 and the constant function 430.
  • ⁇ OO are determined as in Equation 6 for the correlation of the first similar block 320 with the previous block 310, which is a higher correlation than the correlation of the second similar block 325 with the previous block 310, and are determined as in Equation 7 for the correlation of the second similar block 325 with the previous block 310, which is a higher correlation than the correlation of the first similar block 320 with the previous block 310.
  • k ⁇ - (BC ⁇ - BCl) I l (6)
  • 5Cl is correlation between the first similar block 320 and the previous block 310
  • BC 2 is a correlation between the second similar block 325 and the previous block 310
  • m is the number of time-domain samples included in the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
  • the first window function and the second window function are determined so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310.
  • first window function and the second window function are determined so that one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is output prior to the other previous signal, thereby causing the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 that are windowed by the first window function and the second window function, so as to more approximate the signal of the current n frame.
  • the synthesis unit 540 windows the firsts previous signal 350 and the second previous signal 355 by multiplying the first previous signal 350 by the first window function and the second previous signal 355 by the second window function and overlaps and adds the first previous signal 350 and the second previous signal 355 to each other, thereby generating the synthetic signal 360.
  • the reconstruction unit 520 copies the generated synthetic signal 360 to the n frame at least once, thereby reconstructing the signal of the n frame.
  • the reconstruction unit 520 smoothes the start portion of the synthetic signal 360 by overlapping and adding the similar block 370 of the synthetic signal 360 to the previous block 310 of the previous (n-1) frame, so as to prevent discontinuity at a boundary between the synthetic signal 360 and another signal.
  • the reconstruction unit 520 smoothes the end portion of the synthetic signal 360 by overlapping and adding the overlapping block 390 to a block of the start portion of the next (n+1) frame.
  • the frame error concealment method and apparatus using the overlapping method generates a new synthetic signal using a plurality of previous signals that are similar to a signal of an error frame and copies the synthetic signal to the error frame so as to conceal the error of the error frame, thereby preventing the generation of modulation noise that may be generated in frame error concealment using a repetition method.
  • the error concealment scheme construction method constructs an error concealment scheme for a plurality of frames by properly combining the overlapping method, the repetition method, and a frame error concealment method using an interpolation method (hereinafter, referred to as an interpolation method) when errors occur consecutively in the plurality of frames, thereby maximizing reconstructed sound quality. Since the repetition method and the overlapping method have already been described, the interpolation method will be first described with reference to FIG. 6 and then the adaptive frame error concealment method using the error concealment scheme construction method according to an exemplary embodiment of the present invention will be described.
  • FIG. 6 is a reference diagram for explaining the interpolation method according to an exemplary embodiment of the present invention.
  • the interpolation method applies linear interpolation between a previous frame 600 and a next good frame 620.
  • a future signal is provided in frame units due to a delay problem, and thus relaxed interpolation using a window that is modified for overlapping is applied.
  • the window as illustrated in FIG. 6 is used for relaxed interpolation.
  • the window may use a longitudinal window, a linear function, a polynomial function, or a sine function.
  • FIG. 8 illustrates an example of a window using a linear function. It is noted that when a previous window 800 and a next window 820 overlap with each other, the two windows have to be summed as 1. In FIG.
  • a signal output by relaxed interpolation that overlaps and adds two windows of the same size as a frame further includes a signal of a block having a predetermined overlap size OV_SIZE in addition to a signal of the frame size.
  • the signal of the block is overlapped and added to a signal of the next frame 620, thereby smoothing the rear boundary of a signal reconstructed using the interpolation method.
  • the signal of the block is overlapped and added to a signal of the previous frame 600, thereby smoothing the front boundary of the reconstructed signal.
  • the overlapping method since the overlapping method according to an embodiment of the present invention reconstructs a signal of an error frame using a new synthetic signal generated by synthesizing a plurality of previous signals, modulation noise does not become an issue. However, when an error occurs over a long interval like a burst error, reconstruction of a signal of an error frame using the overlapping method may attenuate the energy of a reconstructed signal. In the case of the repetition method, modulation noise may be an issue when an error occurs over a long interval like a burst error. However, the repetition method maintains the energy of a previous signal without attenuating the energy of the reconstructed signal.
  • the interpolation method may improve the accuracy of a reconstructed signal by reconstructing an error frame using both a previous frame and a next frame, but the next frame has to be a good frame having no error.
  • the overlapping method, the repetition method, and the interpolation method have different characteristics in frame error concealment. Therefore, when errors occur consecutively in a plurality of frames, the sound quality of a reconstructed signal can be maximized by constructing an error concealment scheme for concealing the errors of the plurality of frames by properly combining the overlapping method, the repetition method, and the interpolation method based on the different characteristics.
  • error concealment conditions of a previous frame preceding and a next frame following the current frame having an error are analyzed.
  • An error concealment scheme for the current frame is selected based on the analysis result and the error of the current frame is concealed according to the selected error concealment scheme in operations 710 through 795. More specifically, it is determined whether the next frame has an error in operation 710. When it is determined that the next frame has no error, i.e., the next frame is a good frame, in operation 710, the interpolation is selected as the error concealment scheme for the current frame in operation 720. When it is determined that the next frame has an error in operation 710, it is further determined whether the previous frame has an error in operation 730.
  • the overlapping method is selected as the error concealment scheme for the current frame in operation 740.
  • the overlapping method is selected as the error concealment scheme for the current frame in operation 760.
  • the overlapping method is used continuously over a predetermined number of times in order to conceal errors of previous frames in operation 770. Such a determination is intended to prevent the energy of a signal reconstructed using the overlapping method from being attenuated to a value that is lower than a recommended threshold when the overlapping method is used continuously over the predetermined number of times.
  • the repetition method is selected as the error concealment scheme for the current frame in operation 780.
  • one of the overlapping method and the repetition method is selected as the error concealment scheme for the current frame in operation 790.
  • the error concealment scheme for the current frame has been selected in operations 710 through 790, a signal of the current frame is reconstructed using the selected error concealment scheme in operation 795.
  • FIG. 8 is a reference diagram for explaining the influence of a frame error in the frequency domain upon the time domain.
  • a 50% overlap window is generally used. Consequently, when errors occur in N frames in the frequency domain during transmission of an encoded audio signal, errors occur in (N+ 1) frames in the time domain, in which N is an integer greater than 1.
  • N is an integer greater than 1.
  • FIGS. 9 A through 9C are reference diagrams illustrating error concealment schemes constructed by the error concealment scheme construction method according to an exemplary embodiment of the present invention.
  • An error occurs in a single frame in the frequency domain in FIG. 9 A, errors occur in two frames in FIG. 9B, and errors occur in three frames in FIG. 9C.
  • 'W/O ERROR' indicates a good frame having no error
  • 'OVERLAPPING', 'REPETITION', and INTERPOLATION' indicate respective selected error concealment schemes. It can be seen from FIGS.
  • FIG. 10 is a block diagram of an adaptive frame error concealment apparatus including an error concealment scheme construction apparatus according to an exemplary embodiment of the present invention.
  • the adaptive frame error concealment apparatus includes an error concealment scheme selection unit 1000 and an error concealment unit 1010.
  • the error concealment scheme selection unit 1000 includes an analysis unit 1020 and a selection unit 1030.
  • the analysis unit 1020 analyzes error concealment conditions of a previous frame preceding and a next frame following the current frame having an error.
  • the error concealment conditions may include information about whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, information about whether an error occurs in the next frame, and information about whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
  • the selection unit 1030 selects an error concealment scheme for the current frame from the overlapping method, the repetition method, and the interpolation method in the time domain based on the analysis result obtained by the analysis unit 1020.
  • the selection unit 1030 may select the overlapping method as the error concealment scheme for the current frame. If the analysis result shows that the repetition method has been used for the previous frame, the selection unit 1030 may select one of the overlapping method and the interpolation method as the error concealment scheme for the current frame. If the analysis result shows that the overlapping method has been used continuously over the predetermined number of times to conceal the error of the previous frame, the selection unit 1030 may select one of the repetition method and the interpolation method as the error concealment scheme for the current frame. If the analysis result shows that the next frame is a good frame, the selection unit 1030 may select the interpolation method as the error concealment scheme for the current frame.
  • the selection unit 1030 operates as follows. First, the selection unit 1030 is
  • the 1030 determines whether an error occurs in the next frame based on the analysis result obtained by the analysis unit 1020. When the selection unit 1030 determines that the next frame is a good frame, it selects the interpolation method as the error concealment scheme for the current frame. When the selection unit 1030 determines that an error occurs in the next frame, it further determines whether an error occurs in the previous frame. When the selection unit 1030 determines that the previous frame is a good frame, it selects the overlapping method as the error concealment scheme for the current frame. When the selection unit 1030 determines that an error occurs in the previous frame, it further determines whether the error of the previous frame has been concealed using the overlapping method or the repetition method.
  • the selection unit 1030 determines that the error of the previous frame has been concealed using the repetition method, it selects the overlapping method as the error concealment scheme for the current frame.
  • the selection unit 1030 determines that the error of the previous frame has been concealed using the overlapping method, it further determines whether the overlapping method has been used continuously over a predetermined number of times in order to conceal errors of previous frames.
  • Such a determination is intended to prevent the energy of a signal reconstructed using the overlapping method from being attenuated to a value that is lower than a recommended threshold when the overlapping method is used continuously over the predetermined number of times.
  • the selection unit 1030 determines that the overlapping method is used continuously over the predetermined number of times, it selects the repetition method as the error concealment scheme for the current frame.
  • the selection unit 1030 determines that the overlapping method is not used continuously over the predetermined number of times, it selects one of the overlapping method and the repetition method as the error concealment scheme for the current frame.
  • the error concealment unit 1010 reconstructs a signal of the current frame using the error concealment scheme selected by the selection unit 1030, thereby concealing the error of the current frame.
  • the adaptive frame error concealment method and apparatus using the error concealment scheme construction method construct an error concealment scheme for the current frame having an error by properly combining the overlapping method, the repetition method, and the interpolation method based on the characteristics of these methods, thereby reconstructing a signal of the current signal while maximizing reconstructed sound quality.
  • the adaptive frame error concealment method and apparatus may also be implemented by using a stand alone structure that is independent of a core codec. In other words, a signal of the current frame can be reconstructed using only time-domain signals of a previous frame preceding or a next frame following the current frame.
  • an embodiment of the present invention can be implemented with a simple structure.
  • a frame error can be concealed at the minor cost of one-frame delay.
  • the present invention can be embodied as code that is readable by a computer, including a device having an information processing function, on a computer-readable recording medium.
  • the computer-readable recording medium includes all kinds of recording devices storing data that is readable by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and the like.
  • the frame error concealment method and apparatus using the overlapping method according to the present invention synthesize a plurality of previous signals to reconstruct a signal of an error frame, thereby preventing the generation of modulation noise.
  • the error concealment scheme construction method and apparatus construct an error concealment scheme for a plurality of consecutive error frames by properly combining the overlapping method, the repetition method, and the interpolation method, thereby maximizing reconstructed sound quality.
  • the adaptive frame error concealment method and apparatus conceal errors of a plurality of consecutive error frames by properly combining the overlapping method, the repetition method, and the interpolation method, thereby maximizing reconstructed sound quality.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Detection And Prevention Of Errors In Transmission (AREA)

Abstract

Provided are a frame error concealment method and apparatus and an error concealment scheme construction method and apparatus. The frame error concealment method includes generating a new signal by synthesizing a plurality of previous signals that are similar to a signal of an error frame and reconstructing the signal of the error frame using the generated signal.

Description

Description
FRAME ERROR CONCEALMENT METHOD AND APPARATUS AND ERROR CONCEALMENT SCHEME CONSTRUCTION
METHOD AND APPARATUS
Technical Field
[1] The present invention relates to a method of and apparatus for concealing an error of a frame in the time domain, and more particularly, to a frame error concealment method and apparatus, in which an error of a frame, i.e., a frame error, is concealed by reconstructing a signal of the frame using a signal of a previous frame preceding the error frame and/or a signal of a next frame following the error frame. Background Art
[2] When some packets are lost or distorted during transmission of an encoded audio signal over a wired/wireless network, an error may be generated in a frame of a decoded audio signal due to a transmission error. Error concealment may be classified into a frequency-domain error concealment scheme and a time-domain error concealment scheme. The frequency-domain error concealment scheme may be divided into a repetition method that reconstructs a signal of an error frame by reusing spectrum coefficients of a previous frame in the error frame and an interpolation method that reconstructs spectrum coefficients of an error frame by interpolating spectrum coefficients of a previous frame and a next frame. However, due to characteristics of Modulated Discrete Cosine Transformation (MDCT) that transforms a time- domain signal into a frequency-domain signal, when the window types of a previous frame and the current frame are different from each other or a burst error occurs, an error of a frame, i.e., a frame error, cannot be concealed using the repetition method or the interpolation method in the frequency domain. In this case, therefore, time-domain error concealment is required.
[3] The time-domain error concealment scheme can also be divided into a repetition method that repetitively reproduces a time-domain sample of a previous frame in an error frame, an interpolation method that reconstructs a time-domain sample of an error frame by interpolating time-domain samples of a previous frame and a next frame, and other methods that reconstruct a signal of an error frame by analyzing a signal of a previous frame. However, in the case of the repetition method in the time domain, when an error occurs over a long interval, the same spectrum signal of a previous frame is repeated over the long interval, causing modulation noise. Moreover, since the interpolation method in the time domain conceals an error with reference to a next frame, it is not easy to use the interpolation method when an error occurs over a long interval. The other methods for time-domain error concealment increase complexity due to the analysis of a signal of a previous frame. Disclosure of Invention Technical Solution
[4] The present invention provides a frame error concealment method and apparatus using an overlapping method that prevents modulation noise from occurring by synthesizing a plurality of previous signals to reconstruct a signal of an error frame.
[5] The present invention also provides an error concealment scheme construction method and apparatus, in which a plurality of time-domain frame error concealment methods including the overlapping method are properly combined in order to construct an error concealment scheme for concealing frame errors occurring in a plurality of frames in the time domain, thereby maximizing the sound quality of reconstructed signals of the error frames.
[6] The present invention also provides an adaptive frame error concealment method and apparatus, in which an error concealment scheme for concealing frame errors occurring in a plurality of frames is constructed using the frame error concealment scheme construction method and the frame errors are concealed using the constructed error concealment scheme, thereby maximizing the sound quality of reconstructed signals of the error frames.
[7] The present invention also provides a computer-readable recording medium having recorded thereon a program for implementing one of the frame error concealment method using the overlapping method, the error concealment scheme construction method, and the adaptive frame error concealment method.
[8] According to one aspect of the present invention, there is provided a frame error concealment method including (a) extracting a first signal and a second signal that are similar to a signal of a current frame having an error from a previous frame preceding the current frame, (b) generating a synthetic signal for reconstructing the signal of the current frame using the extracted first signal and second signal, and (c) reconstructing the signal of the current frame using the generated synthetic signal.
[9] (a) may include (al) searching in the previous frame for a first block and a second block that are similar to a previous block located immediately previous to the current frame and (a2) extracting the first signal and the second signal by referring to the positions of the found first block and second block.
[10] (b) may include (bl) windowing the extracted first signal and second signal and (b2) overlapping and adding the windowed first signal and second signal.
[11] (bl) may include (bl 1) determining a first window function for windowing the first signal based on correlation between the first block and the previous block and de- termining a second window function for windowing the second signal based on correlation between the second block and the previous block and (bl2) windowing the first signal and the second signal by multiplying the first signal by the determined first window function and multiplying the second signal by the determined second window function.
[12] (bl 1) may include determining the first window function and the second window function so that the first window function and the second window function are summed as 1. (bl 1) may include determining the first window function based on the correlation between the first block and the previous block and determining the second window function based on the correlation between the second block and the previous block, (bl 1) may include determining the first window function and the second window function so that the greater weight is applied to one of the first signal and the second signal whose block has the higher correlation with the previous block, (bl 1) may include determining the first window function and the second window function so that one of the first signal and the second signal whose block has the higher correlation with the previous block is faded out and the other is faded in.
[13] (c) may include repeating the synthetic signal at least once in the current frame.
[14] According to another aspect of the present invention, there is provided a frame error concealment method including extracting a plurality of signals that are similar to a signal of a current frame having an error from a previous frame preceding the current frame, generating a synthetic signal for reconstructing the signal of the current frame using the extracted plurality of signals, and reconstructing the signal of the current frame using the generated synthetic signal.
[15] According to another aspect of the present invention, there is provided a n error concealment scheme construction method including (a) analyzing error concealment conditions of a previous frame preceding and a next frame following a current frame having an error and (b) selecting an error concealment scheme for the current frame from among an overlapping method, a repetition method, and an interpolation method in a time domain based on the analysis result.
[16] (a) may include analyzing at least one of whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, whether an error occurs in the next frame, and whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
[17] According to another aspect of the present invention, there is provided an adaptive frame error concealment method including selecting one of an overlapping method, a repetition method, and an interpolation method in a time domain as an error concealment scheme for a current frame having an error based on error concealment conditions of a previous frame preceding and a next frame following the current frame and concealing the error using the selected error concealment scheme.
[18] According to another aspect of the present invention, there is provided a frame error concealment apparatus including a similar signal extraction unit, a synthetic signal generation unit, and a reconstruction unit. The similar signal extraction unit extracts a first signal and a second signal that are similar to a signal of a current frame having an error from a previous frame preceding the current frame. The synthetic signal generation unit generates a synthetic signal for reconstructing the signal of the current frame using the extracted first signal and second signal. The reconstruction unit reconstructs the signal of the current frame using the generated synthetic signal.
[19] The similar signal extraction unit may search in the previous frame for a first block and a second block that are similar to a previous block located immediately previous to the current frame and extracts the first signal and the second signal by referring to the positions of the found first block and second block.
[20] The first block and the second block may have the highest correlation with the previous block.
[21] The synthetic signal generation unit may include a windowing unit windowing the extracted first signal and second signal and a synthesis unit overlapping and adding the windowed first signal and second signal.
[22] The windowing unit may include a window function determination unit and a multiplication unit. The window function determination unit determines a first window function for windowing the first signal based on correlation between the first block and the previous block and determines a second window function for windowing the second signal based on correlation between the second block and the previous block. The multiplication unit windows the first signal and the second signal by multiplying the first signal by the determined first window function and multiplying the second signal by the determined second window function.
[23] The window function determination unit may determine the first window function and the second window function so that the first window function and the second window function are summed as 1. The window function determination unit may determine the first window function based on the correlation between the first block and the previous block and determine the second window function based on the correlation between the second block and the previous block. The window function determination unit may determine the first window function and the second window function so that the greater weight is applied to one of the first signal and the second signal whose block has the higher correlation with the previous block. The window function determination unit may determine the first window function and the second window function so that one of the first signal and the second signal whose block has the higher correlation with the previous block is faded out and the other is faded in.
[24] The reconstruction unit may repeat the synthetic signal at least once in the current frame.
[25] According to another aspect of the present invention, there is provided a frame error concealment apparatus including a similar signal extraction unit, a synthetic signal generation unit, and a reconstruction unit. The similar signal extraction unit extracts a plurality of signals that are similar to a signal of a current frame having an error from a previous frame preceding the current frame. The synthetic signal generation unit generates a synthetic signal for reconstructing the signal of the current frame using the extracted plurality of signals. The reconstruction unit reconstructs the signal of the current frame using the generated synthetic signal.
[26] According to another aspect of the present invention, there is provided a n error concealment scheme construction apparatus including an analysis unit and a selection unit. The analysis unit analyzes error concealment conditions of a previous frame preceding and a next frame following a current frame having an error. The selection unit selects an error concealment scheme for the current frame from among an overlapping method, a repetition method, and an interpolation method in a time domain based on the analysis result.
[27] The analysis unit may analyze at least one of whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, whether an error occurs in the next frame, and whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
[28] According to another aspect of the present invention, there is provided an adaptive frame error concealment apparatus including an error concealment scheme selection unit and an error concealment unit. The error concealment scheme selection unit selects one of an overlapping method, a repetition method, and an interpolation method in a time domain as an error concealment scheme for a current frame having an error based on error concealment conditions of a previous frame preceding and a next frame following the current frame. The error concealment unit conceals the error using the selected error concealment scheme.
[29] According to another aspect of the present invention, there is provided
[30] a computer-readable recording medium having recorded thereon a program for implementing one of the frame error concealment method, the error concealment scheme construction method, and the adaptive frame error concealment method. Description of Drawings
[31] The above and other features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings in which: [32] FIG. 1 is a reference diagram for explaining a frame error concealment method using a repetition method according to an exemplary embodiment of the present invention; [33] FIG. 2 is a flowchart illustrating a frame error concealment method using an overlapping method according to an exemplary embodiment of the present invention; [34] FIG. 3 is a reference diagram for explaining a frame error concealment method using an overlapping method according to an exemplary embodiment of the present in vention; [35] FIGS. 4A, 4B and 4C are reference diagrams for explaining the determination of a first window function and a second window function illustrated in FIG. 2; [36] FIG. 5 is a block diagram of a frame error concealment apparatus using an overlapping method according to an exemplary embodiment of the present invention; [37] FIG. 6 is a reference diagram for explaining a frame error concealment method using an interpolation method according to an exemplary embodiment of the present invention; [38] FIG. 7 is a flowchart illustrating an adaptive frame error concealment method using an error concealment scheme construction method according to an exemplary embodiment of the present invention; [39] FIG. 8 is a reference diagram for explaining the influence of a frame error in a frequency domain upon a frame in a time domain; [40] FIGS. 9 A through 9C are reference diagrams illustrating error concealment schemes constructed by an error concealment scheme construction method according to an exemplary embodiment of the present invention; and [41] FIG. 10 is a block diagram of an adaptive frame error concealment apparatus including an error concealment scheme construction apparatus according to an exemplary embodiment of the present invention.
Mode for Invention [42] Hereinafter, a frame error concealment method and apparatus using an overlapping method, an error concealment construction method and apparatus, and an adaptive frame error concealment method and apparatus according to exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. [43] First, a frame error concealment method using an overlapping method (hereinafter, referred to as an overlapping method) according to an exemplary embodiment of the present invention will be described. Prior to the explanation of the overlapping method, a frame error concealment method using a repetition method (hereinafter, referred to as a repetition method) will be described. [44] FIG. 1 is a reference diagram for explaining the repetition method according to an exemplary embodiment of the present invention. The repetition method searches in a previous frame for a signal that is similar to a signal of the current frame having an error and copies the found signal to the current frame, thereby reconstructing a signal of the current frame.
[45] Once it is determined that an error occurs in the current n frame 100, a similar block
120 having the highest correlation with a signal of a previous block 110 located immediately previous to the n frame 100 is searched for in a search region of a previous frame preceding the current n frame 100. For example, the correlation can be calculated as follows:
Figure imgf000009_0001
(1),
[47] where
R(d) is a correlation, S{κ) is a signal of a previous frame, and d is the position of a sample in a search region. As illustrated in FIG. 1, once the similar block 120 having the highest correlation with the previous block 110 is found, a previous signal 150 including the found similar block 120 and the following next signals 130 and 140 of a predetermined length are copied to an error frame. Referring to FIG. 1, the previous signal 150 includes the signal 130 that is directly output as a signal of the n frame 100, the similar block 120 preceding the signal 130, and the overlapping block 140 of the same size as the similar block 120, which follows the signal 130. The reason why the similar block 120 and the overlapping block 140, together with the signal 130, are copied to the n frame 100 is to prevent a discontinuous signal from being output at a boundary between an (n-1) frame and the n frame by overlapping and adding the previous block 110 at the boundary of the (n-1) frame to the similar block 120 copied to the n frame. Similarly, the reason why the overlapping block 140, together with the signal 130, is copied to the n frame is to prevent discontinuity at the boundary between the (n-1) frame and the n frame by overlapping and adding the overlapping block 140 copied to the n frame to a start portion of an (n+1) frame when the n frame and the (n+1) frame are good frames. Thus, when a window function is used on a signal of the (n-1) frame to reconstruct the n frame by copying the signal of the (n- 1) frame, the size of the window function may be determined using a linear function, a polynomial function, or a trigonometric function in the similar block 120 or the overlapping block 140 where overlapping occurs and a rectangular window may be used in the signal 130 where overlapping does not occur. Here, it has to be noted that weights applied to two functions in the overlapping of two blocks are summed as 1. Therefore, for using a window function on a block that overlaps the similar block 120 or the overlapping block 140, it is desirable to use a window that is out of phase with a window used for the similar block 120 or the overlapping block 140.
[48] However, as mentioned above, when a previous signal is repeated over a long interval, the repetition method may cause modulation noise due to repetition of a signal having the same spectrum over the long interval. Therefore, it is necessary to prevent the occurrence of modulation noise while reconstructing an error frame using a previous signal.
[49] Hereinafter, an overlapping method according to an exemplary embodiment of the present invention will be described with reference to FIGS. 2 and 3. FIG. 2 is a flowchart illustrating an overlapping method according to an exemplary embodiment of the present invention, and FIG. 3 is a reference diagram for explaining the overlapping method according to an exemplary embodiment of the present invention. The overlapping method searches in a previous frame for a plurality of signals that are similar to a signal of the current error frame, generates a new signal by synthesizing the found signals, and copies the generated new signal to the current error frame, thereby reconstructing the signal of the current error frame.
[50] Referring to FIGS. 2 and 3, in operation 200, it is determined whether an error occurs in the current n frame 300.
[51] When it is determined that an error occurs in the n frame 300 in operation 200, two similar blocks having the highest correlation with a signal of a previous block 310 located immediately previous to the n' frame 300 are searched for in a search region of a previous frame in operation 210. Let the first found similar block be a first similar block 320 and let the second found similar block be a second similar block 325.
[52] In operations 220 through 240, a first previous signal 350 including the found first similar block 320 and its following first next signal 330 of a predetermined length and a second previous signal 355 including the found second similar block 325 and its following second next signal 335 of a predetermined length are synthesized in order to generate a synthetic signal 360 for reconstructing the n frame 300. Referring to FIG. 3, the synthetic signal 360 includes a similar block 370, a portion 380 that is directly used for reconstructing a signal of the n frame 300, and an overlapping block 390.
[53] Since the first similar block 320 and the second similar block 325 have the highest correlation with the previous block 310, consecutive next signals 330 and 340 following the first similar block 320 and consecutive next signals 335 and 345 following the second similar block 325 may be similar to the signal of the n frame 300. Here, as mentioned previously, the first similar block 320 and the first overlapping (OV) block 340 are included in the first previous signal 350, and the second similar block 325 and the second overlapping block 345 are included in the second overlapping (OV) block 345, so as to cause the synthetic signal 360 to include the similar block 370 and the overlapping block 390, thereby preventing the occurrence of discontinuity at the boundary between the synthetic signal 360 and a signal that has been output before or is to be output after the synthetic signal 360 when the synthetic signal 360 is copied to the current frame. In other words, the synthetic signal 360 can be smoothed by overlapping and adding the similar block 370 to the signal preceding the synthetic signal 360 or overlapping and adding the overlapping block 390 to the signal following the synthetic signal 360.
[54] Hereinafter, operations 220 through 240 for generating the synthetic signal 360 by synthesizing the first previous signal 350 and the second previous signal 355 will be described in more detail.
[55] In operation 220, a first window function for windowing the first previous signal 350 and a second window function for windowing the second previous signal 355 are determined based on a correlation between the first similar block 320 and the previous block 310 and based on a correlation between the second similar block 325 and the previous block 310, respectively. Here, it is preferable that the first window function and the second window function be summed as 1. It is also desirable to determine the first window function and the second window function so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310. By doing so, a previous signal, which is more similar to a signal of an error frame than the other previous signal, is used as the larger part of the synthetic signal 360 generated by sy nthesizing the first previous signal 350 and the second previous signal 355 that are windowed by being multiplied by window functions, thereby generating the synthetic signal 360 that more approximates the signal of the error frame.
[56] The first window function and the second window function may also be determined so that in the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355, one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is faded out and the other previous signal is faded in.
[57] FIGS. 4A, 4B and 4C are reference diagrams for explaining the determination of the first window function and the second window function based on a correlation between the first similar block 320 with the previous block 310 and a correlation between the second similar block 325 with the previous block 310. According to an exemplary embodiment of the present invention, the first window function and the second window function are determined as follows: [58]
F(x) -- = 0- JLyt m
(Q ≤ k ≤ l, ≤ m)
■■ (2), [59] where m is the number of time-domain samples constituting the first previous signal 350 and the second previous signal 355 or the synthetic signal 360. As illustrated in FIGS. 4A, 4B and 4C , F(x) is a linear function 410 that reduces from 1 to 0 for
and is a constant function 430 having a value of 1 for Jt = I . Thus, for
0 ≤ k ≤ \
F(x) ranges between the linear function 410 and the constant function 430. [60] As illustrated in FIGS. 4A, 4B and 4C , the first window function
and the second window function
^0O are determined as in Equation 3 for the correlation of the first similar block 320 with the previous block 310, which is a higher correlation than the correlation of the second similar block 325 with the previous block 310, and are determined as in Equation 4 for the correlation of the second similar block 325 with the previous block 310, which is a higher correlation than the correlation of the first similar block 320 with the previous block 310.
Figure imgf000012_0001
k = \ - (BC\ - BCl) I l (3)
Figure imgf000013_0001
k = \ - {BC\ - BC2) f 2 (4),
[63] where
5Cl is a correlation between the first similar block 320 and the previous block 310, BC 2 is a correlation between the second similar block 325 and the previous block 310, and m is the number of time-domain samples included in the first previous signal 350 and the second previous signal 355 or the synthetic signal 360.
[64] As discussed above, according to an exemplary embodiment of the present invention, the first window function and the second window function are determined so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310. Additionally, the first window function and the second window function are determined so that one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is output prior to the other previous signal, thereby causing the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 that are windowed by the first window function and the second window function, so as to more approximate the signal of the current n frame.
[65] After the determination of the first window function and the second window function in operation 220, the first previous signal 350 and the second previous signal 355 are windowed by being multiplied by the determined first window function and the determined second window function, respectively, in operation 230, and then are overlapped and added to each other, thereby generating the synthetic signal 360 in operation 240.
[66] In operation 250, the generated synthetic signal 360 is copied to the n frame at least once. The start portion of the synthetic signal 360 is smoothed by overlapping and adding the similar block 370 of the synthetic signal 360 to the previous block 310 of the previous (n-1) frame, so as to prevent discontinuity at a boundary between the synthetic signal 360 and another signal. Alternatively, the end portion of the synthetic signal 360 is smoothed by overlapping and adding the overlapping block 390 of the synthetic signal 360 to a block of the start portion of the next (n+1) frame.
[67] Hereinafter, a frame error concealment apparatus using the overlapping method according to an exemplary embodiment of the present invention will be described with reference to FIGS. 3 through 5. FIG. 5 is a block diagram of a frame error concealment apparatus using the overlapping method according to an exemplary embodiment of the present invention. The frame error concealment apparatus includes a similar signal extraction unit 500, a synthetic signal generation unit 510, and a reconstruction unit 520. The synthetic signal generation unit 510 includes a window function determination unit 530 and a synthesis unit 540.
[68] The similar signal extraction unit 500 searches in a search range of a previous frame for two similar blocks having the highest correlation with a signal of the previous block 310 located immediately previous to the n' frame having an error. Let the first found similar block be the first similar block 320 and let the second found similar block be the second similar block 325.
[69] The synthetic signal generation unit 510 generates the synthetic signal 360 for reconstructing the n frame by synthesizing the first previous signal 350 including the found first similar block 320 and its following first next signal 330 of a predetermined length and the second previous signal 355 including the found second similar block 325 and its following second next signal 335 of a predetermined length. Referring to FIG. 3, the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 includes the similar block 370, the portion 380 that is directly used for reconstructing the signal of the n frame, and the overlapping block 390. Since the first similar block 320 and the second similar block 325 have the highest correlation with the previous block 310, the consecutive next signals 330 and 340 following the first similar block 320 and the consecutive next signals 335 and 345 following the second similar block 325 may be similar to the signal of the n frame. Here, as mentioned previously, the first similar block 320 and the first overlapping (OV) block 340 are included in the first previous signal 350, and the second similar block 325 and the second overlapping block 345 are included in the second overlapping (OV) block 345, so as to cause the synthetic signal 360 to include the similar block 370 and the overlapping block 390, thereby preventing the occurrence of discontinuity at the boundary between the synthetic signal 360 and a signal that has been output before or is to be output after the synthetic signal 360 when the synthetic signal 360 is copied to the current frame. In other words, the synthetic signal 360 can be smoothed by overlapping and adding the similar block 370 to the signal preceding the synthetic signal 360 or overlapping and adding the overlapping block 390 to the signal following the synthetic signal 360.
[70] The operations of the window function determination unit 530 and the synthesis unit 540 included in the synthetic signal generation unit 510 will now be described.
[71] The window function determination unit 530 determines the first window function for windowing the first previous signal 350 based on a correlation between the first similar block 320 and the previous block 310 and the second window function for windowing the second previous signal 355 based on a correlation between the second similar block 325 and the previous block 310. Here, it is preferable that the first window function and the second window function be summed as 1. It is also desirable to determine the first window function and the second window function so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 . By doing so, a previous signal that is more similar to a signal of an error frame than the other previous signal, would be the larger part of the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 that are windowed by being multiplied by window functions, thereby generating the synthetic signal 360 that more approximates the signal of the error frame.
[72] The window function determination unit 530 may also determine the first window function and the second window function so that in the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355, one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is faded out and the other previous signal is faded in.
[73] FIGS. 4A, 4B and 4C are reference diagrams for explaining the determination of the first window function and the second window function based on a correlation between the first similar block 320 with the previous block 310 and a correlation between the second similar block 325 with the previous block 310. According to an exemplary embodiment of the present invention, the first window function and the second window function are determined as follows:
1741 ™-o-i m)* (O ≤ Ar ≤ l, Q ≤ x ≤ m) (5),
[75] where m is the number of time-domain samples constituting the first previous signal 350 and the second previous signal 355 or the synthetic signal 360. As illustrated in FIGS. 4A, 4B and 4C , is a linear function 410 that reduces from 1 to 0 for
Jt = O and is a constant function 430 having a value of 1 for
Jt = I
. Thus, for
O ≤ k ≤ l
F(x) ranges between the linear function 410 and the constant function 430. [76] As illustrated in FIGS. 4A, 4B and 4C , the first window function
and the second window function
^OO are determined as in Equation 6 for the correlation of the first similar block 320 with the previous block 310, which is a higher correlation than the correlation of the second similar block 325 with the previous block 310, and are determined as in Equation 7 for the correlation of the second similar block 325 with the previous block 310, which is a higher correlation than the correlation of the first similar block 320 with the previous block 310.
Figure imgf000016_0001
k = \ - (BC\ - BCl) I l (6)
Figure imgf000016_0002
Jt = 1 - (5Cl - BCl) I l (7),
[79] where
5Cl is correlation between the first similar block 320 and the previous block 310, BC 2 is a correlation between the second similar block 325 and the previous block 310, and m is the number of time-domain samples included in the first previous signal 350 and the second previous signal 355 or the synthetic signal 360. [80] As discussed above, according to an exemplary embodiment of the present invention, the first window function and the second window function are determined so that the greater weight is applied to one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310. Additionally, the first window function and the second window function are determined so that one of the first previous signal 350 and the second previous signal 355 whose block has the higher correlation with the previous block 310 is output prior to the other previous signal, thereby causing the synthetic signal 360 generated by synthesizing the first previous signal 350 and the second previous signal 355 that are windowed by the first window function and the second window function, so as to more approximate the signal of the current n frame.
[81] The synthesis unit 540 windows the firsts previous signal 350 and the second previous signal 355 by multiplying the first previous signal 350 by the first window function and the second previous signal 355 by the second window function and overlaps and adds the first previous signal 350 and the second previous signal 355 to each other, thereby generating the synthetic signal 360.
[82] The reconstruction unit 520 copies the generated synthetic signal 360 to the n frame at least once, thereby reconstructing the signal of the n frame. At this time, the reconstruction unit 520 smoothes the start portion of the synthetic signal 360 by overlapping and adding the similar block 370 of the synthetic signal 360 to the previous block 310 of the previous (n-1) frame, so as to prevent discontinuity at a boundary between the synthetic signal 360 and another signal. Alternatively, the reconstruction unit 520 smoothes the end portion of the synthetic signal 360 by overlapping and adding the overlapping block 390 to a block of the start portion of the next (n+1) frame.
[83] As mentioned above, the frame error concealment method and apparatus using the overlapping method according to an exemplary embodiment of the present invention generates a new synthetic signal using a plurality of previous signals that are similar to a signal of an error frame and copies the synthetic signal to the error frame so as to conceal the error of the error frame, thereby preventing the generation of modulation noise that may be generated in frame error concealment using a repetition method.
[84] Hereinafter, an adaptive frame error concealment method using an error concealment scheme construction method according to an exemplary embodiment of the present invention will be described. The error concealment scheme construction method constructs an error concealment scheme for a plurality of frames by properly combining the overlapping method, the repetition method, and a frame error concealment method using an interpolation method (hereinafter, referred to as an interpolation method) when errors occur consecutively in the plurality of frames, thereby maximizing reconstructed sound quality. Since the repetition method and the overlapping method have already been described, the interpolation method will be first described with reference to FIG. 6 and then the adaptive frame error concealment method using the error concealment scheme construction method according to an exemplary embodiment of the present invention will be described. FIG. 6 is a reference diagram for explaining the interpolation method according to an exemplary embodiment of the present invention.
[85] Referring to FIG. 6, the interpolation method applies linear interpolation between a previous frame 600 and a next good frame 620. A future signal is provided in frame units due to a delay problem, and thus relaxed interpolation using a window that is modified for overlapping is applied. The window as illustrated in FIG. 6 is used for relaxed interpolation. The window may use a longitudinal window, a linear function, a polynomial function, or a sine function. FIG. 8 illustrates an example of a window using a linear function. It is noted that when a previous window 800 and a next window 820 overlap with each other, the two windows have to be summed as 1. In FIG. 6, a signal output by relaxed interpolation that overlaps and adds two windows of the same size as a frame further includes a signal of a block having a predetermined overlap size OV_SIZE in addition to a signal of the frame size. The signal of the block is overlapped and added to a signal of the next frame 620, thereby smoothing the rear boundary of a signal reconstructed using the interpolation method. The signal of the block is overlapped and added to a signal of the previous frame 600, thereby smoothing the front boundary of the reconstructed signal.
[86] The foregoing description regarding the overlapping method, the repetition method, and the interpolation method, which conceal a frame error by reconstructing a signal of an error frame in the time domain, will now be followed by a description regarding the characteristics of each of the overlapping method, the repetition method, and the interpolation method.
[87] First, since the overlapping method according to an embodiment of the present invention reconstructs a signal of an error frame using a new synthetic signal generated by synthesizing a plurality of previous signals, modulation noise does not become an issue. However, when an error occurs over a long interval like a burst error, reconstruction of a signal of an error frame using the overlapping method may attenuate the energy of a reconstructed signal. In the case of the repetition method, modulation noise may be an issue when an error occurs over a long interval like a burst error. However, the repetition method maintains the energy of a previous signal without attenuating the energy of the reconstructed signal. The interpolation method may improve the accuracy of a reconstructed signal by reconstructing an error frame using both a previous frame and a next frame, but the next frame has to be a good frame having no error. [88] As is apparent from the foregoing description, the overlapping method, the repetition method, and the interpolation method have different characteristics in frame error concealment. Therefore, when errors occur consecutively in a plurality of frames, the sound quality of a reconstructed signal can be maximized by constructing an error concealment scheme for concealing the errors of the plurality of frames by properly combining the overlapping method, the repetition method, and the interpolation method based on the different characteristics.
[89] Hereinafter, an adaptive frame error concealment method using an error concealment scheme construction method according to an exemplary embodiment of the present invention will be described with reference to FIG. 7.
[90] In operation 700, error concealment conditions of a previous frame preceding and a next frame following the current frame having an error are analyzed. An error concealment scheme for the current frame is selected based on the analysis result and the error of the current frame is concealed according to the selected error concealment scheme in operations 710 through 795. More specifically, it is determined whether the next frame has an error in operation 710. When it is determined that the next frame has no error, i.e., the next frame is a good frame, in operation 710, the interpolation is selected as the error concealment scheme for the current frame in operation 720. When it is determined that the next frame has an error in operation 710, it is further determined whether the previous frame has an error in operation 730. When it is determined that the previous frame has no error, i.e., the previous frame is a good frame, in operation 730, the overlapping method is selected as the error concealment scheme for the current frame in operation 740. When it is determined that the previous frame has an error in operation 730, it is further determined whether the error of the previous frame has been concealed using the overlapping method or the repetition method in operation 750. Since the current frame has an error and thus the error of the previous frame cannot have been concealed using the interpolation method, it is not necessary to determine whether the error of the previous frame has been concealed using the interpolation method. When it is determined that the error of the previous frame has been concealed using the repetition method in operation 750, the overlapping method is selected as the error concealment scheme for the current frame in operation 760. When it is determined that the error of the previous frame has been concealed using the overlapping method in operation 750, it is further determined whether the overlapping method is used continuously over a predetermined number of times in order to conceal errors of previous frames in operation 770. Such a determination is intended to prevent the energy of a signal reconstructed using the overlapping method from being attenuated to a value that is lower than a recommended threshold when the overlapping method is used continuously over the predetermined number of times. When it is determined that the overlapping method is used continuously over the predetermined number of times in operation 770, the repetition method is selected as the error concealment scheme for the current frame in operation 780. When it is determined that the overlapping method is not used continuously over the predetermined number of times in operation 770, one of the overlapping method and the repetition method is selected as the error concealment scheme for the current frame in operation 790. Once the error concealment scheme for the current frame has been selected in operations 710 through 790, a signal of the current frame is reconstructed using the selected error concealment scheme in operation 795.
[91] FIG. 8 is a reference diagram for explaining the influence of a frame error in the frequency domain upon the time domain. Referring to FIG. 8, during modulated discrete cosine transformation (MDCT) with respect to time-domain samples in an encoding phase, a 50% overlap window is generally used. Consequently, when errors occur in N frames in the frequency domain during transmission of an encoded audio signal, errors occur in (N+ 1) frames in the time domain, in which N is an integer greater than 1. Thus, when an error occurs in a frame in the frequency domain and a signal of the error frame is reconstructed using the repetition method, the same signal is repeated at least three times, causing modulation noise. Therefore, it is necessary to construct an error concealment scheme by properly combining the overlapping method, the repetition method, and the interpolation method while avoiding using the repetition method for more than one frame, thereby preventing the generation of modulation noise.
[92] FIGS. 9 A through 9C are reference diagrams illustrating error concealment schemes constructed by the error concealment scheme construction method according to an exemplary embodiment of the present invention. An error occurs in a single frame in the frequency domain in FIG. 9 A, errors occur in two frames in FIG. 9B, and errors occur in three frames in FIG. 9C. In FIGS. 9A through 9C, 'W/O ERROR' indicates a good frame having no error, and 'OVERLAPPING', 'REPETITION', and INTERPOLATION' indicate respective selected error concealment schemes. It can be seen from FIGS. 9A through 9C that an error of the current frame is concealed using the interpolation method when the next frame is a good frame and is concealed using the overlapping method when the previous frame is a good frame, i.e., the error starts from the current frame. Additionally, it can be seen that a frame whose error is concealed using the repetition method is inserted between frames whose errors are concealed using the overlapping method and the repetition method is not used continuously.
[93] FIG. 10 is a block diagram of an adaptive frame error concealment apparatus including an error concealment scheme construction apparatus according to an exemplary embodiment of the present invention. Referring to FIG. 10, the adaptive frame error concealment apparatus includes an error concealment scheme selection unit 1000 and an error concealment unit 1010. The error concealment scheme selection unit 1000 includes an analysis unit 1020 and a selection unit 1030.
[94] The analysis unit 1020 analyzes error concealment conditions of a previous frame preceding and a next frame following the current frame having an error. The error concealment conditions may include information about whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, information about whether an error occurs in the next frame, and information about whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
[95] The selection unit 1030 selects an error concealment scheme for the current frame from the overlapping method, the repetition method, and the interpolation method in the time domain based on the analysis result obtained by the analysis unit 1020.
[96] For example, if the analysis result shows that the previous frame is a good frame, the selection unit 1030 may select the overlapping method as the error concealment scheme for the current frame. If the analysis result shows that the repetition method has been used for the previous frame, the selection unit 1030 may select one of the overlapping method and the interpolation method as the error concealment scheme for the current frame. If the analysis result shows that the overlapping method has been used continuously over the predetermined number of times to conceal the error of the previous frame, the selection unit 1030 may select one of the repetition method and the interpolation method as the error concealment scheme for the current frame. If the analysis result shows that the next frame is a good frame, the selection unit 1030 may select the interpolation method as the error concealment scheme for the current frame.
[97] More specifically, the selection unit 1030 operates as follows. First, the selection unit
1030 determines whether an error occurs in the next frame based on the analysis result obtained by the analysis unit 1020. When the selection unit 1030 determines that the next frame is a good frame, it selects the interpolation method as the error concealment scheme for the current frame. When the selection unit 1030 determines that an error occurs in the next frame, it further determines whether an error occurs in the previous frame. When the selection unit 1030 determines that the previous frame is a good frame, it selects the overlapping method as the error concealment scheme for the current frame. When the selection unit 1030 determines that an error occurs in the previous frame, it further determines whether the error of the previous frame has been concealed using the overlapping method or the repetition method. Since the current frame has an error and thus the error of the previous frame cannot have been concealed using the interpolation method, it is not necessary to determine whether the error of the previous frame has been concealed using the interpolation method. When the selection unit 1030 determines that the error of the previous frame has been concealed using the repetition method, it selects the overlapping method as the error concealment scheme for the current frame. When the selection unit 1030 determines that the error of the previous frame has been concealed using the overlapping method, it further determines whether the overlapping method has been used continuously over a predetermined number of times in order to conceal errors of previous frames. Such a determination is intended to prevent the energy of a signal reconstructed using the overlapping method from being attenuated to a value that is lower than a recommended threshold when the overlapping method is used continuously over the predetermined number of times. When the selection unit 1030 determines that the overlapping method is used continuously over the predetermined number of times, it selects the repetition method as the error concealment scheme for the current frame. When the selection unit 1030 determines that the overlapping method is not used continuously over the predetermined number of times, it selects one of the overlapping method and the repetition method as the error concealment scheme for the current frame.
[98] The error concealment unit 1010 reconstructs a signal of the current frame using the error concealment scheme selected by the selection unit 1030, thereby concealing the error of the current frame.
[99] As described above, the adaptive frame error concealment method and apparatus using the error concealment scheme construction method according to an exemplary embodiment of the present invention construct an error concealment scheme for the current frame having an error by properly combining the overlapping method, the repetition method, and the interpolation method based on the characteristics of these methods, thereby reconstructing a signal of the current signal while maximizing reconstructed sound quality. By reconstructing a signal of an error frame using time- domain frame error concealment, the adaptive frame error concealment method and apparatus may also be implemented by using a stand alone structure that is independent of a core codec. In other words, a signal of the current frame can be reconstructed using only time-domain signals of a previous frame preceding or a next frame following the current frame. Moreover, since a frame error is concealed using the overlapping method, the repetition method, and the interpolation method without a need for a complex process such as the analysis of a signal of the previous frame, an embodiment of the present invention can be implemented with a simple structure. In addition, a frame error can be concealed at the minor cost of one-frame delay.
[100] Meanwhile, the present invention can be embodied as code that is readable by a computer, including a device having an information processing function, on a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording devices storing data that is readable by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and the like.
[101] As described above, the frame error concealment method and apparatus using the overlapping method according to the present invention synthesize a plurality of previous signals to reconstruct a signal of an error frame, thereby preventing the generation of modulation noise.
[102] Moreover, the error concealment scheme construction method and apparatus according to the present invention construct an error concealment scheme for a plurality of consecutive error frames by properly combining the overlapping method, the repetition method, and the interpolation method, thereby maximizing reconstructed sound quality.
[103] Furthermore, the adaptive frame error concealment method and apparatus according to the present invention conceal errors of a plurality of consecutive error frames by properly combining the overlapping method, the repetition method, and the interpolation method, thereby maximizing reconstructed sound quality.
[104] While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention as defined by the following claims.

Claims

Claims
[1] What is claimed is:
[2] L A frame error concealment method comprising:
(a) extracting a first signal and a second signal that are similar to a signal of a current frame having an error from a previous frame preceding the current frame;
(b) generating a synthetic signal for reconstructing the signal of the current frame using the extracted first signal and second signal; and
(c) reconstructing the signal of the current frame using the generated synthetic signal.
[3] 2. The frame error concealment method of claim 1, wherein (a) comprises:
(al) searching in the previous frame for a first block and a second block that are similar to a previous block located immediately previous to the current frame; and
(a2) extracting the first signal and the second signal by referring to the positions of the found first block and second block.
[4] 3. The frame error concealment method of claim 2, wherein the first block and the second block have the highest correlation with the previous block.
[5] 4. The frame error concealment method of claim 2, wherein (a2) comprises: extracting the first signal including the first block and a next signal of a predetermined length, which follows the first block; and extracting the second signal including the second block and a next signal of the predetermined length, which follows the second block.
[6] 5. The frame error concealment method of claim 2, wherein (b) comprises:
(bl) windowing the extracted first signal and second signal; and (b2) overlapping and adding the windowed first signal and second signal.
[7] 6. The frame error concealment method of claim 5, wherein (bl) comprises:
(bl 1) determining a first window function for windowing the first signal based on correlation between the first block and the previous block and determining a second window function for windowing the second signal based on correlation between the second block and the previous block; and
(bl2) windowing the first signal and the second signal by multiplying the first signal by the determined first window function and multiplying the second signal by the determined second window function.
[8] 7. The frame error concealment method of claim 6, wherein (bl 1) comprises determining the first window function and the second window function so that the first window function and the second window function are summed as 1.
[9] 8. The frame error concealment method of claim 7, wherein (bl 1) comprises de- termining the first window function based on the correlation between the first block and the previous block and determining the second window function based on the correlation between the second block and the previous block.
[10] 9. The frame error concealment method of claim 8, wherein (bl 1) comprises determining the first window function and the second window function so that the greater weight is applied to one of the first signal and the second signal whose block has the higher correlation with the previous block.
[11] 10. The frame error concealment method of claim 8, wherein (bl 1) comprises determining the first window function and the second window function so that one of the first signal and the second signal whose block has the higher correlation with the previous block is faded out and the other is faded in.
[12] 11. The frame error concealment method of claim 8, wherein (bl 1) comprises determining a window function multiplied by one of the first signal and the second signal whose block has the higher correlation with the previous block as F(x) and determining a window function multiplied by the other as \ - F(x) , as follows:
F(x) = (λ - ^f m (1), where m is the length of the time axis of the first signal or the second signal and x is a time-axis coordinate of the window function with respect to the starting point of the first signal or the second signal.
[13] 12. The frame error concealment method of claim 11, wherein k is determined as follows:
* = l - |.?Cl- £C2]/ 2 (2), where
5Cl is a correlation between the first block and the previous block and
BC 2 is a correlation between the second block and the previous block.
[14] 13. The frame error concealment method of claim 1, wherein (c) comprises repe ating the synthetic signal at least once in the current frame.
[15] 14. The frame error concealment method of claim 13, wherein (c) further comprises overlapping and adding a portion of a previous signal preceding the synthetic signal and a portion of the synthetic signal to smooth the previous signal and the synthetic signal.
[16] 15. The frame error concealment method of claim 13, wherein (c) further comprises overlapping and adding a portion of a next signal following the synthetic signal and a portion of the synthetic signal to smooth the next signal and the synthetic signal.
[17] 16. A frame error concealment method comprising: extracting a plurality of signals that are similar to a signal of a current frame having an error from a previous frame preceding the current frame; generating a synthetic signal for reconstructing the signal of the current frame using the extracted plurality of signals; and reconstructing the signal of the current frame using the generated synthetic signal.
[18] 17. An error concealment scheme construction method comprising:
(a) analyzing error concealment conditions of a previous frame preceding and a next frame following a current frame having an error; and
(b) selecting an error concealment scheme for the current frame from among an overlapping method, a repetition method, and an interpolation method in a time domain based on the analysis result.
[19] 18. The error concealment scheme construction method of claim 17, wherein (a) comprises analyzing at least one of whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, whether an error occurs in the next frame, and whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
[20] 19. The error concealment scheme construction method of claim 18, wherein (b) comprises selecting the overlapping method as the error concealment scheme for the current frame when the previous frame is a good frame having no error.
[21] 20. The error concealment scheme construction method of claim 18, wherein (b) comprises selecting one of the overlapping method and the interpolation method as the error concealment scheme for the current frame when the repetition method has been used for the previous frame.
[22] 21. The error concealment scheme construction method of claim 18, wherein (b) comprises selecting one of the repetition method and the interpolation method as the error concealment scheme for the current frame when the repetition method has been used for the previous frame continuously over the predetermined number of times.
[23] 22. The error concealment scheme construction method of claim 18, wherein (b) comprises selecting the interpolation method as the error concealment scheme for the current frame when the next frame is a good frame having no error.
[24] 23. An adaptive frame error concealment method comprising: selecting one of an overlapping method, a repetition method, and an interpolation method in a time domain as an error concealment scheme for a current frame having an error based on error concealment conditions of a previous frame preceding and a next frame following the current frame; and concealing the error using the selected error concealment scheme.
[25] 24. A computer-readable medium containing computer-readable codes to perform a frame error method comprising
(a) extracting a first signal and a second signal that are similar to a signal of a current frame having an error from a previous frame preceding the current frame;
(b) generating a synthetic signal for reconstructing the signal of the current frame using the extracted first signal and second signal; and
(c) reconstructing the signal of the current frame using the generated synthetic signal.
[26] 25. A frame error concealment apparatus comprising: a similar signal extraction unit extracting a first signal and a second signal that are similar to a signal of a current frame having an error from a previous frame preceding the current frame; a synthetic signal generation unit generating a synthetic signal for reconstructing the signal of the current frame using the extracted first signal and second signal; and a reconstruction unit reconstructing the signal of the current frame using the generated synthetic signal.
[27] 26. The frame error concealment apparatus of claim 25, wherein the similar signal extraction unit searches in the previous frame for a first block and a second block that are similar to a previous block located immediately previous to the current frame and extracts the first signal and the second signal by referring to the positions of the found first block and second block.
[28] 27. The frame error concealment apparatus of claim 26, wherein the first block and the second block have the highest correlation with the previous block.
[29] 28. The frame error concealment apparatus of claim 26, wherein the similar signal extraction unit extracts the first signal including the first block and a next signal of a predetermined length, which follows the first block, and extracts the second signal including the second block and a next signal of the predetermined length, which follows the second block.
[30] 29. The frame error concealment apparatus of claim 26, wherein the synthetic signal generation unit comprises: a windowing unit windowing the extracted first signal and second signal; and a synthesis unit overlapping and adding the windowed first signal and second signal.
[31] 30. The frame error concealment apparatus of claim 29, wherein the windowing unit comprises: a window function determination unit determining a first window function for windowing the first signal based on correlation between the first block and the previous block and determining a second window function for windowing the second signal based on correlation between the second block and the previous block; and a multiplication unit windowing the first signal and the second signal by multiplying the first signal by the determined first window function and multiplying the second signal by the determined second window function.
[32] 31. The frame error concealment apparatus of claim 30, wherein the window function determination unit determines the first window function and the second window function so that the first window function and the second window function are summed as 1.
[33] 32. The frame error concealment apparatus of claim 31, wherein the window function determination unit determines the first window function based on the correlation between the first block and the previous block and determines the second window function based on the correlation between the second block and the previous block.
[34] 33. The frame error concealment apparatus of claim 32, wherein the window function determination unit determines the first window function and the second window function so that the greater weight is applied to one of the first signal and the second signal whose block has the higher correlation with the previous block.
[35] 34. The frame error concealment apparatus of claim 32, wherein the window function determination unit determines the first window function and the second window function so that one of the first signal and the second signal whose block has the higher correlation with the previous block is faded out and the other is faded in.
[36] 35. The frame error concealment apparatus of claim 32, wherein the window function determination unit determines a window function multiplied by one of the first signal and the second signal whose block has the higher correlation with the previous block as
F(x) and determines a window function multiplied by the other as
\ - F(x)
, as follows:
F(x) = 0 - -)k m (1), where m is the length of the time axis of the first signal or the second signal and x is a time-axis coordinate of the window function with respect to the starting point of the first signal or the second signal.
[37] 36. The frame error concealment apparatus of claim 35, wherein k is determined as follows:
Figure imgf000029_0001
(2), where
BCl is a correlation between the first block and the previous block and
BC 2 is a correlation between the second block and the previous block.
[38] 37. The frame error concealment apparatus of claim 25, wherein the reconstruction unit repeats the synthetic signal at least once in the current frame.
[39] 38. A frame error concealment apparatus comprising: a similar signal extraction unit extracting a plurality of signals that are similar to a signal of a current frame having an error from a previous frame preceding the current frame; a synthetic signal generation unit generating a synthetic signal for reconstructing the signal of the current frame using the extracted plurality of signals; and a reconstruction unit reconstructing the signal of the current frame using the generated synthetic signal.
[40] 39. An error concealment scheme construction apparatus comprising: an analysis unit analyzing error concealment conditions of a previous frame preceding and a next frame following a current frame having an error; and a selection unit selecting an error concealment scheme for the current frame from among an overlapping method, a repetition method, and an interpolation method in a time domain based on the analysis result.
[41] 40. The error concealment scheme construction apparatus of claim 39, wherein the analysis unit analyzes at least one of whether an error occurs in the previous frame and if so, an error concealment scheme for the previous frame, whether an error occurs in the next frame, and whether the overlapping method has been used continuously over a predetermined number of times to conceal the error of the previous frame.
[42] 41. The error concealment scheme construction apparatus of claim 39, wherein the selection unit selects the overlapping method as the error concealment scheme for the current frame when the previous frame is a good frame having no error.
[43] 42. The error concealment scheme construction apparatus of claim 39, wherein the selection unit selects one of the overlapping method and the interpolation method as the error concealment scheme for the current frame when the repetition method has been used for the previous frame.
[44] 43. The error concealment scheme construction apparatus of claim 39, wherein the selection unit selects one of the repetition method and the interpolation method as the error concealment scheme for the current frame when the repetition method has been used for the previous frame continuously over the predetermined number of times.
[45] 44. The error concealment scheme construction apparatus of claim 39, wherein the selection unit selects the interpolation method as the error concealment scheme for the current frame when the next frame is a good frame having no error.
[46] 45. An adaptive frame error concealment apparatus comprising: an error concealment scheme selection unit selecting one of an overlapping method, a repetition method, and an interpolation method in a time domain as an error concealment scheme for a current frame having an error based on error concealment conditions of a previous frame preceding and a next frame following the current frame; and an error concealment unit concealing the error using the selected error concealment scheme.
PCT/KR2007/005694 2006-11-30 2007-11-13 Frame error concealment method and apparatus and error concealment scheme construction method and apparatus WO2008066265A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020060120107A KR101291193B1 (en) 2006-11-30 2006-11-30 The Method For Frame Error Concealment
KR10-2006-0120107 2006-11-30

Publications (1)

Publication Number Publication Date
WO2008066265A1 true WO2008066265A1 (en) 2008-06-05

Family

ID=39468020

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2007/005694 WO2008066265A1 (en) 2006-11-30 2007-11-13 Frame error concealment method and apparatus and error concealment scheme construction method and apparatus

Country Status (3)

Country Link
US (4) US20080133242A1 (en)
KR (1) KR101291193B1 (en)
WO (1) WO2008066265A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103065636A (en) * 2011-10-24 2013-04-24 中兴通讯股份有限公司 Voice frequency signal frame loss compensation method and device
WO2014011353A1 (en) * 2012-07-10 2014-01-16 Motorola Mobility Llc Apparatus and method for audio frame loss recovery
EP2645365B1 (en) * 2010-11-24 2018-01-17 LG Electronics Inc. Speech signal encoding method and speech signal decoding method
RU2680748C1 (en) * 2013-10-29 2019-02-26 Нтт Докомо, Инк. Audio signal processing device, audio signal processing method, and audio signal processing program
WO2020131594A1 (en) * 2018-12-21 2020-06-25 Microsoft Technology Licensing, Llc Combined forward and backward extrapolation of lost network data
US10784988B2 (en) 2018-12-21 2020-09-22 Microsoft Technology Licensing, Llc Conditional forward error correction for network data

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101291193B1 (en) 2006-11-30 2013-07-31 삼성전자주식회사 The Method For Frame Error Concealment
JP4910786B2 (en) * 2007-03-05 2012-04-04 富士通株式会社 Image processing apparatus and image processing method
US9384748B2 (en) 2008-11-26 2016-07-05 Electronics And Telecommunications Research Institute Unified Speech/Audio Codec (USAC) processing windows sequence based mode switching
US20120195573A1 (en) * 2011-01-28 2012-08-02 Apple Inc. Video Defect Replacement
JP2014527778A (en) 2011-08-29 2014-10-16 アイ.シー.ブイ.ティー リミテッド Control of video content system
JP6088644B2 (en) * 2012-06-08 2017-03-01 サムスン エレクトロニクス カンパニー リミテッド Frame error concealment method and apparatus, and audio decoding method and apparatus
EP2903004A4 (en) 2012-09-24 2016-11-16 Samsung Electronics Co Ltd Method and apparatus for concealing frame errors, and method and apparatus for decoding audios
US9437203B2 (en) * 2013-03-07 2016-09-06 QoSound, Inc. Error concealment for speech decoder
SG11201510513WA (en) * 2013-06-21 2016-01-28 Fraunhofer Ges Forschung Method and apparatus for obtaining spectrum coefficients for a replacement frame of an audio signal, audio decoder, audio receiver and system for transmitting audio signals
EP3291233B1 (en) * 2013-09-12 2019-10-16 Dolby International AB Time-alignment of qmf based processing data
US9437211B1 (en) * 2013-11-18 2016-09-06 QoSound, Inc. Adaptive delay for enhanced speech processing
WO2015134579A1 (en) 2014-03-04 2015-09-11 Interactive Intelligence Group, Inc. System and method to correct for packet loss in asr systems
EP3230980B1 (en) * 2014-12-09 2018-11-28 Dolby International AB Mdct-domain error concealment
WO2017129270A1 (en) * 2016-01-29 2017-08-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for improving a transition from a concealed audio signal portion to a succeeding audio signal portion of an audio signal
WO2020164752A1 (en) * 2019-02-13 2020-08-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio transmitter processor, audio receiver processor and related methods and computer programs

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030177011A1 (en) * 2001-03-06 2003-09-18 Yasuyo Yasuda Audio data interpolation apparatus and method, audio data-related information creation apparatus and method, audio data interpolation information transmission apparatus and method, program and recording medium thereof
JP2004120619A (en) * 2002-09-27 2004-04-15 Kddi Corp Audio information decoding device
US6973425B1 (en) * 1999-04-19 2005-12-06 At&T Corp. Method and apparatus for performing packet loss or Frame Erasure Concealment

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4111131C2 (en) * 1991-04-06 2001-08-23 Inst Rundfunktechnik Gmbh Method of transmitting digitized audio signals
GB2263373B (en) * 1992-01-09 1995-05-24 Sony Broadcast & Communication Data error concealment
KR970011728B1 (en) * 1994-12-21 1997-07-14 김광호 Error chache apparatus of audio signal
JPH10109409A (en) 1996-10-04 1998-04-28 Canon Inc Ink jet recording apparatus and control method thereof
US5907822A (en) * 1997-04-04 1999-05-25 Lincom Corporation Loss tolerant speech decoder for telecommunications
EP1006665B1 (en) * 1998-12-04 2003-05-28 Lucent Technologies Inc. Error concealment or correction of speech, image and video signals
US6952668B1 (en) * 1999-04-19 2005-10-04 At&T Corp. Method and apparatus for performing packet loss or frame erasure concealment
US6597961B1 (en) * 1999-04-27 2003-07-22 Realnetworks, Inc. System and method for concealing errors in an audio transmission
DE19921122C1 (en) * 1999-05-07 2001-01-25 Fraunhofer Ges Forschung Method and device for concealing an error in a coded audio signal and method and device for decoding a coded audio signal
US6636829B1 (en) * 1999-09-22 2003-10-21 Mindspeed Technologies, Inc. Speech communication system and method for handling lost frames
US6915263B1 (en) * 1999-10-20 2005-07-05 Sony Corporation Digital audio decoder having error concealment using a dynamic recovery delay and frame repeating and also having fast audio muting capabilities
US6757654B1 (en) * 2000-05-11 2004-06-29 Telefonaktiebolaget Lm Ericsson Forward error correction in speech coding
US7031926B2 (en) * 2000-10-23 2006-04-18 Nokia Corporation Spectral parameter substitution for the frame error concealment in a speech decoder
US7069208B2 (en) * 2001-01-24 2006-06-27 Nokia, Corp. System and method for concealment of data loss in digital audio transmission
US6614370B2 (en) * 2001-01-26 2003-09-02 Oded Gottesman Redundant compression techniques for transmitting data over degraded communication links and/or storing data on media subject to degradation
US7590525B2 (en) * 2001-08-17 2009-09-15 Broadcom Corporation Frame erasure concealment for predictive speech coding based on extrapolation of speech waveform
US7319703B2 (en) * 2001-09-04 2008-01-15 Nokia Corporation Method and apparatus for reducing synchronization delay in packet-based voice terminals by resynchronizing during talk spurts
US7379865B2 (en) * 2001-10-26 2008-05-27 At&T Corp. System and methods for concealing errors in data transmission
WO2003043277A1 (en) 2001-11-15 2003-05-22 Matsushita Electric Industrial Co., Ltd. Error concealment apparatus and method
US7047187B2 (en) * 2002-02-27 2006-05-16 Matsushita Electric Industrial Co., Ltd. Method and apparatus for audio error concealment using data hiding
CA2388439A1 (en) * 2002-05-31 2003-11-30 Voiceage Corporation A method and device for efficient frame erasure concealment in linear predictive based speech codecs
WO2003107591A1 (en) * 2002-06-14 2003-12-24 Nokia Corporation Enhanced error concealment for spatial audio
US6985856B2 (en) * 2002-12-31 2006-01-10 Nokia Corporation Method and device for compressed-domain packet loss concealment
EP1582061A4 (en) * 2003-01-10 2010-09-22 Thomson Licensing Decoder apparatus and method for smoothing artifacts created during error concealment
US20050049853A1 (en) * 2003-09-01 2005-03-03 Mi-Suk Lee Frame loss concealment method and device for VoIP system
US7324937B2 (en) * 2003-10-24 2008-01-29 Broadcom Corporation Method for packet loss and/or frame erasure concealment in a voice communication system
US7356748B2 (en) * 2003-12-19 2008-04-08 Telefonaktiebolaget Lm Ericsson (Publ) Partial spectral loss concealment in transform codecs
US7668712B2 (en) * 2004-03-31 2010-02-23 Microsoft Corporation Audio encoding and decoding with intra frames and adaptive forward error correction
US20060062304A1 (en) * 2004-09-17 2006-03-23 Shih-Chang Hsia Apparatus and method for error concealment
SG124307A1 (en) 2005-01-20 2006-08-30 St Microelectronics Asia Method and system for lost packet concealment in high quality audio streaming applications
EP1884028A2 (en) * 2005-05-11 2008-02-06 QUALCOMM Incorporated A method and apparatus for unified error concealment framework
US7930176B2 (en) * 2005-05-20 2011-04-19 Broadcom Corporation Packet loss concealment for block-independent speech codecs
US7831421B2 (en) * 2005-05-31 2010-11-09 Microsoft Corporation Robust decoder
US7805297B2 (en) * 2005-11-23 2010-09-28 Broadcom Corporation Classification-based frame loss concealment for audio signals
US8075952B2 (en) * 2006-06-29 2011-12-13 Applied Materials, Inc. Power loading substrates to reduce particle contamination
WO2008007700A1 (en) * 2006-07-12 2008-01-17 Panasonic Corporation Sound decoding device, sound encoding device, and lost frame compensation method
US8731913B2 (en) * 2006-08-03 2014-05-20 Broadcom Corporation Scaled window overlap add for mixed signals
US8346546B2 (en) * 2006-08-15 2013-01-01 Broadcom Corporation Packet loss concealment based on forced waveform alignment after packet loss
KR101291193B1 (en) * 2006-11-30 2013-07-31 삼성전자주식회사 The Method For Frame Error Concealment
KR100998396B1 (en) * 2008-03-20 2010-12-03 광주과학기술원 Method And Apparatus for Concealing Packet Loss, And Apparatus for Transmitting and Receiving Speech Signal
CN100550133C (en) * 2008-03-20 2009-10-14 华为技术有限公司 A kind of audio signal processing method and device
CN101335000B (en) * 2008-03-26 2010-04-21 华为技术有限公司 Method and apparatus for encoding
US9666210B2 (en) * 2014-05-15 2017-05-30 Telefonaktiebolaget Lm Ericsson (Publ) Audio signal classification and coding

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6973425B1 (en) * 1999-04-19 2005-12-06 At&T Corp. Method and apparatus for performing packet loss or Frame Erasure Concealment
US20030177011A1 (en) * 2001-03-06 2003-09-18 Yasuyo Yasuda Audio data interpolation apparatus and method, audio data-related information creation apparatus and method, audio data interpolation information transmission apparatus and method, program and recording medium thereof
JP2004120619A (en) * 2002-09-27 2004-04-15 Kddi Corp Audio information decoding device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PERKINS C. ET AL.: "A Survey of Packet Loss Recovery Techniques for Streaming Audio", IEEE NETWORK MAGAZINE, vol. 12, no. 5, September 1998 (1998-09-01), pages 40 - 48, XP000875014, DOI: doi:10.1109/65.730750 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2645365B1 (en) * 2010-11-24 2018-01-17 LG Electronics Inc. Speech signal encoding method and speech signal decoding method
CN103065636A (en) * 2011-10-24 2013-04-24 中兴通讯股份有限公司 Voice frequency signal frame loss compensation method and device
WO2014011353A1 (en) * 2012-07-10 2014-01-16 Motorola Mobility Llc Apparatus and method for audio frame loss recovery
US9053699B2 (en) 2012-07-10 2015-06-09 Google Technology Holdings LLC Apparatus and method for audio frame loss recovery
RU2680748C1 (en) * 2013-10-29 2019-02-26 Нтт Докомо, Инк. Audio signal processing device, audio signal processing method, and audio signal processing program
RU2701075C1 (en) * 2013-10-29 2019-09-24 Нтт Докомо, Инк. Audio signal processing device, audio signal processing method and audio signal processing program
WO2020131594A1 (en) * 2018-12-21 2020-06-25 Microsoft Technology Licensing, Llc Combined forward and backward extrapolation of lost network data
US10784988B2 (en) 2018-12-21 2020-09-22 Microsoft Technology Licensing, Llc Conditional forward error correction for network data
US10803876B2 (en) 2018-12-21 2020-10-13 Microsoft Technology Licensing, Llc Combined forward and backward extrapolation of lost network data

Also Published As

Publication number Publication date
KR101291193B1 (en) 2013-07-31
US20080133242A1 (en) 2008-06-05
US20180122386A1 (en) 2018-05-03
US20170040022A1 (en) 2017-02-09
US9478220B2 (en) 2016-10-25
US10325604B2 (en) 2019-06-18
US9858933B2 (en) 2018-01-02
US20150279380A1 (en) 2015-10-01
KR20080049486A (en) 2008-06-04

Similar Documents

Publication Publication Date Title
US10325604B2 (en) Frame error concealment method and apparatus and error concealment scheme construction method and apparatus
KR102151749B1 (en) Frame error concealment method and apparatus, and audio decoding method and apparatus
JP4603091B2 (en) Method and apparatus for concealing frame loss on high band signals
TWI585748B (en) Frame error concealment method and audio decoding method
US7337108B2 (en) System and method for providing high-quality stretching and compression of a digital audio signal
US9514755B2 (en) Position-dependent hybrid domain packet loss concealment
RU2526745C2 (en) Sbr bitstream parameter downmix
US9613629B2 (en) Correction of frame loss during signal decoding
US8065141B2 (en) Apparatus and method for processing signal, recording medium, and program
US11482232B2 (en) Audio frame loss concealment
CN105453172B (en) Correction of frame loss using weighted noise
KR20180049182A (en) Sinusoidal interpolation across missing data
KR101291198B1 (en) The Apparatus For Frame Error Concealment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07834001

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07834001

Country of ref document: EP

Kind code of ref document: A1