CN114141257A - Method, device, system and medium for processing audio data transmission lost frame - Google Patents

Method, device, system and medium for processing audio data transmission lost frame Download PDF

Info

Publication number
CN114141257A
CN114141257A CN202111678569.XA CN202111678569A CN114141257A CN 114141257 A CN114141257 A CN 114141257A CN 202111678569 A CN202111678569 A CN 202111678569A CN 114141257 A CN114141257 A CN 114141257A
Authority
CN
China
Prior art keywords
point
sampling
end point
sample
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111678569.XA
Other languages
Chinese (zh)
Inventor
梁邦飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Optical Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Optical Technology Co Ltd filed Critical Goertek Optical Technology Co Ltd
Priority to CN202111678569.XA priority Critical patent/CN114141257A/en
Publication of CN114141257A publication Critical patent/CN114141257A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/005—Correction of errors induced by the transmission channel, if related to the coding algorithm

Abstract

The invention discloses a method, a device and a system for processing audio data transmission lost frames and a computer readable storage medium, wherein the method comprises the following steps: determining a frame loss region of the audio signal; calculating each sampling point to be compensated of the frame loss region and a sampling value corresponding to each sampling point to be compensated according to the left end point and the right end point of the frame loss region, a first preset number of sampling points positioned in front of the frame loss region and a second preset number of sampling points positioned behind the frame loss region; supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain a supplemented audio signal; the method and the device can reduce the generation of the popping sound in the using process, and are beneficial to improving the audio playing effect and improving the user experience.

Description

Method, device, system and medium for processing audio data transmission lost frame
Technical Field
The present invention relates to the field of audio decoding technologies, and in particular, to a method, an apparatus, a system, and a computer-readable storage medium for processing a lost frame in audio data transmission.
Background
After any USB device is connected to the USB interface, the host detects that a new device is connected, and queries the attribute of the device using a different Request command (Request), and the device reports its own status to the host through different descriptors, which may specifically include the type of the device, the function of the device, the number of endpoints that the device has, and other operational attributes. UAC (USB Audio Class, UAC for short) Audio is a way to transmit Audio data through USB, and USB Audio drives to generate analog sound CARDs (CARDs), and Audio data is transmitted through USB interfaces, such as RECORD (RECORD) and play (play). In the process of recording Audio by the USB CARD, Audio data is sent from a HOST (HOST device) end to a SLAVE (USB CARD, SLAVE device) end, and then the USB controller at the SLAVE end sends the Audio data to a DMA (direct memory access) module for obtaining and processing.
USB has four transmission channel types (Endpoint): control (Control), Interrupt (Interrupt), Bulk (Bulk), and sync (Isochronous). Control is used for USB bus Control and the like (all devices have), Interrupt is mainly used for data transmission of a mouse and a keyboard, and Bulk is mainly used for data transmission of a U disk. The first three types all have retransmission, but Audio data transmission adopted by UAC Audio is a fourth port, i.e., Isochronous, and has an error detection mechanism, but there is no retransmission function, which often results in that when data loss occurs in an Audio data packet during transmission, original data cannot be collected again, and the Audio of a lost segment will generate pop sound, so that user experience is poor.
In view of the above, how to provide a method, an apparatus, a system and a computer readable storage medium for processing audio data transmission lost frames to solve the above technical problems is a problem to be solved by those skilled in the art.
Disclosure of Invention
Embodiments of the present invention provide a method, an apparatus, a system, and a computer-readable storage medium for processing lost frames in audio data transmission, which can reduce the occurrence of pop noise during the use process, and are beneficial to improving the audio playing effect and improving the user experience.
In order to solve the above technical problem, an embodiment of the present invention provides a method for processing a lost frame in audio data transmission, including:
determining a frame loss region of the audio signal;
calculating each sample point to be compensated of the frame loss region and a sample value corresponding to each sample point to be compensated according to the left end point and the right end point of the frame loss region, a first preset number of sample points positioned in front of the frame loss region and a second preset number of sample points positioned behind the frame loss region;
and supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain a supplemented audio signal.
Optionally, the process of calculating each sample point to be compensated of the frame loss region and a sample value corresponding to each sample point to be compensated according to the left and right endpoints of the frame loss region, the first preset number of sample points located before the frame loss region, and the second preset number of sample points located after the frame loss region is as follows:
determining the number and the type of extreme points to be supplemented by comparing the sizes of the sampling values of the left end point of the frame loss region, the first sampling point positioned on the left side of the left end point, the right end point of the frame loss region and the first sampling point positioned on the right side of the right end point;
determining the sampling value of the extreme point to be supplemented according to the sampling values of the left end point of the frame loss region, the nth sampling point positioned on the left side of the left end point, the (n-1) th sampling point positioned on the left side of the left end point, the right end point of the frame loss region, the mth sampling point positioned on the right side of the right end point and the (m-1) th sampling point positioned on the right side of the right end point;
and determining the number of the sampling points to be compensated of the lost frame region and the sampling value of each sampling point to be compensated according to the sampling values of the extreme point to be compensated, the left end point of the lost frame region, the first sampling point positioned on the left side of the left end point, the right end point of the lost frame region and the first sampling point positioned on the right side of the right end point.
Optionally, the process of determining the number and the type of the extreme points to be supplemented by comparing the sample values of the left end point of the frame loss region, the first sample point located on the left side of the left end point, the right end point of the frame loss region, and the first sample point located on the right side of the right end point is as follows:
when L isA-LA1＜0，LB-LB1If the number of the extreme points to be supplemented is less than 0, the type is a minimum value point;
when L isA-LA1＜0，LB-LB1When the number of the extreme points to be supplemented is more than 0, the number of the extreme points to be supplemented is two, and the types of the extreme points are respectively a minimum value point and a maximum value point;
when L isA-LA1＞0，LB-LB1When the number is more than 0, the number of the extreme points to be supplemented is one, and the type is the maximum point;
when L isA-LA1＞0，LB-LB1When the number of the extreme points to be supplemented is less than 0, the types of the extreme points to be supplemented are respectively a maximum value point and a minimum value point;
wherein L isASample value, L, representing the left end point of the lost frame regionA1Sample value, L, representing the first sample point to the left of the left end pointBSample value, L, representing the right end of the lost frame regionB1Representing the sample value of the first sample point to the right of the right end point.
Optionally, the process of determining the sampling value of the extreme point to be compensated according to the sampling values of the left end point of the frame loss region, the nth sampling point located on the left side of the left end point, the (n-1) th sampling point located on the left side of the left end point, the right end point of the frame loss region, the mth sampling point located on the right side of the right end point, and the (m-1) th sampling point located on the right side of the right end point is as follows:
when the extreme point to be supplemented is one and is a minimum point:
if L isA(n-1)-LAnIf > 0, Lmin ═ LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf < 0, Lmin ═ LA+(LA-LAn) (ii) a Wherein Lmin is a sampling value of a minimum value point;
when the number of the extreme points to be supplemented is two, and the number of the extreme points to be supplemented is LATo LBWhen the minimum value point and the maximum value point are in turn:
if L isA(n-1)-LAnIf > 0, Lmin ═ LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf < 0, Lmin ═ LA+(LA-LAn)；
If L isB(m-1)-LBmIf < 0, Lmax is equal to LB+(LB-LB(m-1))；
If L isB(m-1)-LBmIf greater than 0, Lmax is equal to LB+(LB-LBm) (ii) a Wherein Lmax is a sampling value of the maximum value point;
when the extreme point to be supplemented is one and is a maximum point:
if L isA(n-1)-LAnIf < 0, Lmax is equal to LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf greater than 0, Lmax is equal to LA+(LA-LAn)；
When the number of the extreme points to be supplemented is two, and the extreme points are from LA to LB in sequence:
if L isA(n-1)-LAnIf < 0, Lmax is equal to LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf greater than 0, Lmax is equal to LA+(LA-LAn)；
If L isB(m-1)-LBmIf > 0, Lmin ═ LB+(LB-LB(m-1))；
If L isB(m-1)-LBmIf < 0, Lmin ═ LB+(LB-LBm)；
Wherein n is a first predetermined number, m is a second predetermined number, LAnSample value representing the nth sample point to the left of the left end point, LA(n-1)Sample value representing the (n-1) th sample point located to the left of the left end point, LBmRepresenting the sample value of the m-th sample point located to the right of said right end point, LBm-1Indicating the sample value of the m-1 sample point located to the right of the right end point.
Optionally, the process of determining the number of to-be-supplemented sampling points of the lost frame region and the sampling value of each to-be-supplemented sampling point according to the to-be-supplemented extreme point, the left end point of the lost frame region, the first sampling point located on the left side of the left end point, the right end point of the lost frame region, and the sampling value of the first sampling point located on the right side of the right end point is as follows:
when the extreme point to be supplemented is one and is a minimum point:
from LANumber L of sample points to Lmin to be replenishedP＝(Lmin-LA)/(LA-LA1) And the sampling value of the p-th sampling point to be compensated is LA+p*LAstepWherein L isAstep＝LA-LA1；
From LBNumber L of sample points to Lmin to be replenishedQ＝(Lmin-LB)/(LB-LB1) And the sampling value of the qth sampling point to be compensated is LB+p*LBstepWherein L isBstep＝LB-LB1；
When the number of the extreme points to be supplemented is two and is LATo LBWhen the minimum value point and the maximum value point are in turn:
from LANumber L of sample points to Lmin to be replenishedX＝(LA-Lmin)/(LA-LA1) And the sampling value of the xth sampling point to be compensated is LA+x*LAstep(ii) a Wherein L isAstep＝LA-LA1；
Number L of sample points to be replenished from Lmin to LmaxY＝(Lmax-Lmin)/((|LA-LA1|+|LB-LB1L)/2) and the sampling value of the y sampling point to be compensated is Lmin + y LAstep(ii) a Wherein L isBstep＝(|LA-LA1|+|LB-LB1|)/2；
From Lmax to LBNumber L of sampling points to be replenishedZ＝(Lmax-LB)/(LB-LB1) And the sampling value of the z th sampling point to be replenished is Lmax + z x LBstepWherein L isBstep＝LB1-LB；
When the extreme point to be supplemented is one and is a maximum point:
from LANumber of sample points to Lmax to be replenished LP＝(Lmax-LA)/(LA-LA1) And the sampling value of the p-th sampling point to be compensated is LA+p*LAstepWherein L isAstep＝LA-LA1；
From Lmax to LBNumber L of sampling points to be replenishedQ＝(Lmax-LB)/(LB-LB1) And the sampling value of the q sampling point to be compensated is Lmax-p LBstepWherein L isBstep＝LB-LB1；
When the number of the extreme points to be supplemented is two, and the number of the extreme points to be supplemented is LATo LBWhen the maximum value point and the minimum value point are sequentially arranged:
from LANumber of sample points to Lmax to be replenished LX＝(LA-Lmax)/(LA-LA1) And the sampling value of the xth sampling point to be compensated is LA+x*LAstep(ii) a Wherein L isAstep＝LA-LA1；
Number L of sample points to be replenished from Lmax to LminY＝(Lmax-Lmin)/((|LA-LA1|+|LB-LB1L)/2) and the sampling value of the y sampling point to be compensated is Lmax-y LAstep(ii) a Wherein L isBstep＝(|LA-LA1|+|LB-LB1|)/2；
From Lmin to LBNumber L of sampling points to be replenishedZ＝(Lmin-LB)/(LB-LB1) And the sampling value of the z th sampling point to be replenished is Lmin + z x LBstepWherein L isBstep＝LB1-LB。
Optionally, the method for determining the first preset number includes:
comparing from the first sample point before the left end of the frame-missing region when L is presentA(n-1)-LAnWhen the number is more than 0, determining the number of n, and taking the number as a first preset number; when L does not exist within the preset threshold numberA(n-1)-LAnWhen the number is larger than 0, taking the preset threshold number as the first preset number;
comparing from the first sample point after the right end point of the frame loss region when L existsB(m-1)-LBmWhen the number is more than 0, determining the number of m, and taking the number as a second preset number; when L does not exist within the preset threshold numberB(m-1)-LBmAnd when the number is more than 0, taking the preset threshold number as the second preset number.
The embodiment of the invention also provides a device for processing the audio data transmission lost frame, which comprises:
the determining module is used for determining a frame loss region of the audio signal;
the calculation module is used for calculating each sampling point to be compensated of the frame loss region and a sampling value corresponding to each sampling point to be compensated according to the left end point and the right end point of the frame loss region, a first preset number of sampling points positioned in front of the frame loss region and a second preset number of sampling points positioned behind the frame loss region;
and the supplement module is used for supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain a supplemented audio signal.
Optionally, the calculation module includes:
the first determining unit is used for determining the number and the type of extreme points to be supplemented by comparing the sizes of sampling values of a left end point of the frame loss region, a first sampling point positioned on the left side of the left end point, a right end point of the frame loss region and a first sampling point positioned on the right side of the right end point;
a second determining unit, configured to determine a sampling value of the extreme point to be compensated according to a left end point of the frame loss region, an nth sampling point located on the left side of the left end point, an nth-1 sampling point located on the left side of the left end point, a right end point of the frame loss region, an mth sampling point located on the right side of the right end point, and an mth-1 sampling point located on the right side of the right end point;
and the third determining unit is used for determining the number of the sampling points to be compensated of the lost frame region and the sampling value of each sampling point to be compensated according to the sampling values of the extreme point to be compensated, the left end point of the lost frame region, the first sampling point positioned on the left side of the left end point, the right end point of the lost frame region and the first sampling point positioned on the right side of the right end point.
The embodiment of the invention also provides a system for processing the audio data transmission lost frame, which comprises:
a memory for storing a computer program;
and the processor is used for realizing the steps of the audio data transmission lost frame processing method when executing the computer program.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for processing a lost frame in audio data transmission are implemented as described above.
The embodiment of the invention provides a method, a device and a system for processing audio data transmission lost frames and a computer readable storage medium, wherein the method comprises the following steps: determining a frame loss region of the audio signal; calculating each sampling point to be compensated of the frame loss region and a sampling value corresponding to each sampling point to be compensated according to the left end point and the right end point of the frame loss region, a first preset number of sampling points positioned in front of the frame loss region and a second preset number of sampling points positioned behind the frame loss region; and supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain the supplemented audio signal.
It can be seen that, in the embodiment of the present invention, a frame loss region of an audio signal is first determined, then, according to left and right end points of the frame loss region, a first preset number of sampling points located before the frame loss region, and a second preset number of sampling points located after the frame loss region, each to-be-supplemented sampling point in the frame loss region, and a sampling value corresponding to each to-be-supplemented sampling point are further calculated, and the frame loss region is supplemented according to each to-be-supplemented sampling point and each corresponding sampling value, so as to obtain a supplemented audio signal; the method and the device can reduce the generation of the popping sound in the using process, and are beneficial to improving the audio playing effect and improving the user experience.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flowchart of a method for processing a lost frame in audio data transmission according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a method for calculating a sampling point to be compensated and a corresponding sampling value according to an embodiment of the present invention;
fig. 3 is an audio signal with a lost frame according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a frame loss region of an audio signal according to an embodiment of the present invention;
fig. 5 is a schematic diagram of another audio signal frame loss region according to an embodiment of the present invention;
fig. 6 is a schematic diagram of another audio signal frame loss region according to an embodiment of the present invention;
fig. 7 is a schematic diagram of another audio signal frame loss region according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an apparatus for processing a lost frame in audio data transmission according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a method, a device and a system for processing audio data transmission lost frames and a computer readable storage medium, which can reduce the generation of popping sound in the use process, and are beneficial to improving the audio playing effect and improving the user experience.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for processing a lost frame in audio data transmission according to an embodiment of the present invention. The method comprises the following steps:
s110: determining a frame loss region of the audio signal;
it should be noted that, in practical applications, the USB module may acquire PCM Audio data sent by the USB host device and store the Audio data in the HW cache module, the HW cache module triggers an interrupt to notify the USB controller to transfer the PCM Audio data to a DMA (direct memory access), and the Audio module acquires the DMA data to perform processing on the Audio data, such as Playback, and transfers the DMA data to a wav Audio file and stores the wav Audio file in Flash. After the HW cache module is triggered to be interrupted, the audio module receives a state identifier for acquiring the HW cache returned by the USB controller, and specifically, whether the audio signal has a lost data frame or not can be further determined through the state identifier, and at this time, the audio signal can be further acquired, and a corresponding frame loss region is determined through the acquired audio signal.
S120: calculating each sampling point to be compensated of the frame loss region and a sampling value corresponding to each sampling point to be compensated according to the left end point and the right end point of the frame loss region, a first preset number of sampling points positioned in front of the frame loss region and a second preset number of sampling points positioned behind the frame loss region;
specifically, in the embodiment of the present invention, after a frame loss region in an audio signal is determined, a first preset number of sampling points (including sampling values corresponding to each sampling point) located before the frame loss region and a second preset number of sampling points (including sampling values of the sampling points) located after the frame loss region in the audio signal may be obtained, and then each sample to be supplemented of the frame loss region and each sampling value corresponding to each sample to be supplemented are further calculated according to the first preset number of sampling points located before the frame loss region and the second preset number of sampling points located after the frame loss region.
For example, referring to the audio signal with a binaural stereo and a sampling frequency of 48k shown in fig. 2, LA is a left end point of a left channel frame loss region, LB is a right end point of the left channel frame loss region, RA is a left end point of the right channel frame loss region, and RB is a right end point of the left channel frame loss region, and in practical applications, the method provided by the embodiment of the present invention is adopted for each channel to perform signal compensation of the frame loss region.
S130: and supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain the supplemented audio signal.
Specifically, after each sampling point to be compensated in the frame loss region and the sampling value corresponding to each sampling point to be compensated are determined, the position of each sampling point to be compensated and the corresponding sampling value can be compensated from the frame loss region, so that data in the frame loss region is complete, a compensated audio signal is obtained, and the frame loss region in the compensated audio signal is partially compensated with the sampling point and the corresponding sampling value.
Further, referring to fig. 3, in the above step S120, a process of calculating each sample to be compensated of the frame loss region and a sample value corresponding to each sample to be compensated according to the left and right end points of the frame loss region, the first preset number of sample points located before the frame loss region, and the second preset number of sample points located after the frame loss region may specifically be:
s210: determining the number and the type of extreme points to be supplemented by comparing the sizes of sampling values of a left end point of a frame loss region, a first sampling point positioned on the left side of the left end point, a right end point of the frame loss region and a first sampling point positioned on the right side of the right end point;
it should be noted that, in the embodiment of the present invention, a detailed description may be given by taking one of the channels as an example, where after a frame loss region of an audio signal is determined, a left end point and a right end point of the frame loss region may be determined according to a position of the frame loss region, then a first preset number of sampling points and corresponding sampling values before the frame loss region (that is, the sampling points are earlier than the position of the frame loss region) are further determined from the audio signal, and a second preset number of sampling points and corresponding sampling values after the frame loss region (that is, the sampling points are later than the position of the frame loss region) are determined, where the first preset number and the second preset number may be the same or different, and may be specifically determined according to an actual situation, and the embodiment of the present invention is not particularly limited.
Specifically, the number and type of extreme points to be supplemented in the frame loss region can be determined by the following method:
when L isA-LA1＜0，LB-LB1When the number is less than 0, one extreme point to be supplemented is adopted, and the type is an extremely small value point; specifically, when L isA-LA1＜0，LB-LB1When the frequency is less than 0, the audio trend graphs at the two ends of the audio signal frame loss region are shown in figure 4, and the trend of the sampling points to be supplemented in the Fourier transform frame loss region is LATo LBGoes down first and then goes up, so LAAnd LBThe minimum point is the supplementary minimum point between the two points.
When L isA-LA1＜0，LB-LB1When the number of the extreme points is more than 0, two extreme points to be supplemented are provided, and the types of the extreme points are respectively a minimum value point and a maximum value point; specifically, when L isA-LA1＜0，LB-LB1When the value is more than 0, the audio trend graphs at the two ends of the audio signal frame loss region are shown in figure 5, and the trend of the sampling points to be supplemented in the Fourier transform frame loss region is LATo LBFirst falls, then rises and then falls, so LAAnd LBThe supplementary extreme points are the minimum point and the maximum point in turn.
When L isA-LA1＞0，LB-LB1When the number is more than 0, one extreme point to be supplemented is adopted, and the type is the maximum point; specifically, when L isA-LA1＞0，LB-LB1When the value is more than 0, the audio trend graphs at the two ends of the audio signal frame loss region are shown in figure 6, and the trend of the sampling points to be supplemented in the Fourier transform frame loss region is LATo LBRises first and then falls, so LAAnd LBThe extreme point supplemented in between is the maximum point.
When L isA-LA1＞0，LB-LB1When the number is less than 0, two extreme points to be supplemented are provided, and the types of the extreme points are respectively a maximum value point and a minimum value point; specifically, when L isA-LA1＞0，LB-LB1When the frequency is less than 0, the audio trend graphs at the two ends of the audio signal frame loss region are shown in figure 7, and the trend of the sampling points to be supplemented in the Fourier transform frame loss region is LATo LBRising first, falling then rising again, so LAAnd LBThe extreme points supplemented in between are the maximum point and the minimum point in turn.
Wherein L isASample value, L, representing the left end point of a lost frame regionA1Sample value, L, representing the first sample point to the left of the left end pointBSample value, L, representing the right end of a lost frame regionB1Indicating the sample value of the first sample point to the right of the right end point.
S220: determining a sampling value of an extreme point to be supplemented according to sampling values of a left end point of a frame loss region, an nth sampling point positioned on the left side of the left end point, an nth-1 sampling point positioned on the left side of the left end point, a right end point of the frame loss region, an mth sampling point positioned on the right side of the right end point and an mth-1 sampling point positioned on the right side of the right end point;
specifically, after the number and the type of the extreme points to be supplemented are determined, the sampling value of the extreme points to be supplemented can be determined by the following method:
when the minimum point to be supplemented is one, and the minimum point is:
if L isA(n-1)-LAn> 0, denotes LA(n-1)Maximum, then Lmin equals LA+(LA-LA(n-1))；
If L isA(n-1)-LAn< 0, indicating L in the region between n sample points before the frame loss regionAnWhen the maximum value is reached, Lmin is equal to LA+(LA-LAn) (ii) a Wherein Lmin is a sampling value of a minimum value point;
when the number of the extreme points to be supplemented is two, and from LATo LBWhen the minimum value point and the maximum value point are in turn:
if L isA(n-1)-LAn> 0, denotes LA(n-1)Maximum, then Lmin equals LA+(LA-LA(n-1))；
If L isA(n-1)-LAn< 0, indicating L in the region between n sample points before the frame loss regionAnWhen the maximum value is reached, Lmin is equal to LA+(LA-LAn)；
If L isB(m-1)-LBm< 0, indicating LB(n-1)If the value is minimal, Lmax is equal to LB+(LB-LB(m-1))；
If L isB(m-1)-LBmIs greater than 0, and indicates L in the region between n sampling points after the frame loss regionBnWhen the minimum value is reached, Lmax is equal to LB+(LB-LBm) (ii) a Wherein Lmax is a sampling value of the maximum value point;
when the extreme point to be supplemented is one and is the maximum point:
if L isA(n-1)-LAn< 0, indicating LA(n-1)If the value is minimal, Lmax is equal to LA+(LA-LA(n-1))；
If L isA(n-1)-LAnGreater than 0, indicating L in the region between n samples before the frame lost regionAnWhen the minimum value is reached, Lmax is equal to LA+(LA-LAn)；
When the number of the extreme points to be supplemented is two, and the extreme points and the minimum points are from LA to LB in sequence:
if L isA(n-1)-LAn< 0, indicating LA(n-1)If the value is minimal, Lmax is equal to LA+(LA-LA(n-1))；
If L isA(n-1)-LAn> 0, denotes LAnIf the value is minimal, Lmax is equal to LA+(LA-LAn)；
If L isB(m-1)-LBm> 0, denotes LB(n-1)Maximum, then Lmin equals LB+(LB-LB(m-1))；
If L isB(m-1)-LBm< 0, indicating LBnIf the value is minimal, Lmin is equal to LB+(LB-LBm)；
Wherein n is a first predetermined number, m is a second predetermined number, LAnSample value, L, representing the nth sample point to the left of the left end pointA(n-1)Sample value representing the (n-1) th sample point located to the left of the left end point, LBmRepresenting the sample value of the m-th sample point to the right of the right endpoint, LBm-1Indicating the sample value of the m-1 sample point located to the right of the right end point.
S230: and determining the number of the sampling points to be compensated of the lost frame region and the sampling value of each sampling point to be compensated according to the sizes of the sampling values of the extreme point to be compensated, the left end point of the lost frame region, the first sampling point positioned on the left side of the left end point, the right end point of the lost frame region and the first sampling point positioned on the right side of the right end point.
Specifically, after the sampling value of the extreme point to be compensated is determined, each sampling point to be compensated in the frame loss region and the sampling value corresponding to each sampling point to be compensated can be determined by the following method, which is specifically as follows:
when the extreme point to be supplemented is one and is a minimum point:
from LANumber L of sample points to Lmin to be replenishedP＝(Lmin-LA)/(LA-LA1) And the sampling value of the p-th sampling point to be compensated is LA+p*LAstepWherein L isAstep＝LA-LA1；
That is, L may be substitutedAstep＝LA-LA1As a slave LATo LminA fixed difference between the sampling values of the sampling points to be replenished, then LAThe sampling value of the first sampling point to be supplemented to the right is LA+1*LAstep，LAThe sampling value of the second sampling point to be supplemented to the right is LA+2*LAstep… … sample value size of p-th sample point to be compensated is LA+p*LAstep. The position of each sample point to be supplemented on the abscissa is determined by the system audio sampling rate, and the invention is not particularly limited.
From LBNumber L of sample points to Lmin to be replenishedQ＝(Lmin-LB)/(LB-LB1) And the sampling value of the qth sampling point to be compensated is LB+p*LBstepWherein L isBstep＝LB-LB1；
That is, L may be substitutedBstep＝LB-LB1As from Lmin to LBOf the sampling points to be replenished, then LBThe sampling value of the first sampling point to be supplemented to the left is LB+1*LBstep，LBThe sampling value of the second sampling point to be supplemented to the left is LB+2*LBstep… … sample value size of the qth sample point to be compensated is LB+p*LBstep。
When the number of the extreme points to be supplemented is two, and is LATo LBWhen the minimum value point and the maximum value point are in turn:
from LANumber L of sample points to Lmin to be replenishedX＝(LA-Lmin)/(LA-LA1) And the sampling value of the xth sampling point to be compensated is LA+x*LAstep(ii) a Wherein L isAstep＝LA-LA1；
That is, L may be substitutedAstep＝LA-LA1As a slave LAFixed difference between the sample values of the sample points to be replenished to Lmin, then LAThe sampling value of the first sampling point to be supplemented to the right is LA+1*LAstep，LASampling value of second sampling point to be supplemented to rightSize LA+2*LAstep… … sample value of the xth sample point to be compensated is LA+x*LAstep。
Number L of sample points to be replenished from Lmin to LmaxY＝(Lmax-Lmin)/((|LA-LA1|+|LB-LB1L)/2) and the sampling value of the y sampling point to be compensated is Lmin + y LAstep(ii) a Wherein L isBstep＝(|LA-LA1|+|LB-LB1|)/2；
That is, L may be substitutedBstep＝(|LA-LA1|+|LB-LB1L)/2 is taken as a fixed difference value between sampling values of sampling points to be supplemented from Lmin to Lmax, and the sampling value of the sampling point to be supplemented, which is the first sampling point to be supplemented to the right, of the Lmin is Lmin + 1LAstepThe sampling value of the second sample point to be supplemented to the right of the Lmin is Lmin +2 x LAstepAnd the sampling value of the … … y th sample point to be supplemented is Lmin + y LAstep。
From Lmax to LBNumber L of sampling points to be replenishedZ＝(Lmax-LB)/(LB-LB1) And the sampling value of the z th sampling point to be replenished is Lmax + z x LBstepWherein L isBstep＝LB1-LB；
That is, L may be substitutedBstep＝LB1-LBAs from Lmax to LBThe fixed difference value between the sampling values of the sampling points to be supplemented is that the sampling value of the sampling point to be supplemented, which is the first sampling point to be supplemented to the right, has the size of Lmax + 1LAstepThe sampling value of the second sample point to be supplemented to the right of Lmax is Lmax +2 x LAstepAnd the magnitude of the sample value of the z th sample point to be supplemented is … … Lmax + z LAstep。
When the extreme point to be supplemented is one and is the maximum point:
from LANumber of sample points to Lmax to be replenished LP＝(Lmax-LA)/(LA-LA1) And the sampling value of the p-th sampling point to be compensated is LA+p*LAstepWherein L isAstep＝LA-LA1；
That is, L may be substitutedAstep＝LA-LA1As a slave LAFixed difference between the sample values of the sample points to be replenished to Lmax, then LAThe sampling value of the first sampling point to be supplemented to the right is LA+1*LAstep，LAThe sampling value of the second sampling point to be supplemented to the right is LA+2*LAstep… … sample value size of p-th sample point to be compensated is LA+p*LAstep。
From Lmax to LBNumber L of sampling points to be replenishedQ＝(Lmax-LB)/(LB-LB1) And the sampling value of the q sampling point to be compensated is Lmax-p LBstepWherein L isBstep＝LB-LB1；
That is, L may be substitutedBstep＝LB-LB1As from Lmax to LBThe fixed difference value between the sampling values of the sampling points to be supplemented is that the sampling value of the sampling point to be supplemented, which is the first sampling point to be supplemented to the right, has the size Lmax-1LBstep，LBThe sampling value of the second sampling point to be supplemented to the left is Lmax-2 x LBstepAnd the size of the sampling value of the qth sampling point to be compensated is … … Lmax-p LBstep。
When the number of the extreme points to be supplemented is two, and from LATo LBWhen the maximum value point and the minimum value point are sequentially arranged:
from LANumber of sample points to Lmax to be replenished LX＝(LA-Lmax)/(LA-LA1) And the sampling value of the xth sampling point to be compensated is LA+x*LAstep(ii) a Wherein L isAstep＝LA-LA1；
That is, L may be substitutedAstep＝LA-LA1As a slave LAFixed difference between the sample values of the sample points to be replenished to Lmax, then LAThe sampling value of the first sampling point to be supplemented to the right is LA+1*LAstep，LASampling value size of second sampling point to be supplemented to rightIs LA+2*LAstep… … sample value of the xth sample point to be compensated is LA+x*LAstep。
Number L of sample points to be replenished from Lmax to LminY＝(Lmax-Lmin)/((|LA-LA1|+|LB-LB1L)/2) and the sampling value of the y sampling point to be compensated is Lmax-y LAstep(ii) a Wherein L isBstep＝(|LA-LA1|+|LB-LB1|)/2；
That is, L may be substitutedBstep＝(|LA-LA1|+|LB-LB1L)/2 is used as a fixed difference value between the sampling values of the sampling points to be supplemented from Lmax to Lmin, the sampling value of the sampling point to be supplemented from Lmax to the first sampling point to the right is Lmax-1LAstepThe sampling value of the second sample point to be supplemented to the right of the Lmin is Lmax-2 x LAstepThe sampling value of the … … y th sample point to be supplemented is Lmax-y LAstep。
From Lmin to LBNumber L of sampling points to be replenishedZ＝(Lmin-LB)/(LB-LB1) And the sampling value of the z th sampling point to be replenished is Lmin + z x LBstepWherein L isBstep＝LB1-LB。
That is, L may be substitutedBstep＝LB1-LBAs from Lmin to LBThe fixed difference value between the sampling values of the sampling points to be supplemented is that the sampling value of the sampling point to be supplemented, which is the first sampling point to be supplemented to the right, of Lmin is Lmin + 1LAstepThe sampling value of the second sample point to be supplemented to the right of the Lmin is Lmin +2 x LAstepAnd the magnitude of the sample value of the z th sample point to be supplemented is Lmin + z L of … …Astep。
It should be further noted that, in practical applications, when determining the first preset number and the second preset number, the determination may be performed by the following method:
specifically, the method for determining the first preset number may specifically be:
the comparison is made starting from the first sample point located before the left end of the lost frame regionWhen L is presentA(n-1)-LAnWhen the number is more than 0, determining the number of n, and taking the number as a first preset number; when L does not exist within the preset threshold numberA(n-1)-LAnWhen the number is more than 0, taking the number of the preset threshold values as a first preset number;
the method for determining the second preset number may specifically be:
the comparison is made starting from the first sample point located after the right end point of the frame loss region when L is presentB(m-1)-LBmWhen the number is more than 0, determining the number of m, and taking the number as a second preset number; when L does not exist within the preset threshold numberB(m-1)-LBmAnd when the number is more than 0, taking the preset threshold number as a second preset number.
It can be seen that, in the embodiment of the present invention, a frame loss region of an audio signal is first determined, then, according to a first preset number of sampling points located before the frame loss region and a second preset number of sampling points located after the frame loss region, each to-be-supplemented sampling point in the frame loss region and a sampling value corresponding to each to-be-supplemented sampling point are further calculated, and the frame loss region is supplemented according to each to-be-supplemented sampling point and each corresponding sampling value, so as to obtain a supplemented audio signal; the method and the device can reduce the generation of the popping sound in the using process, and are beneficial to improving the audio playing effect and improving the user experience.
On the basis of the foregoing embodiments, an embodiment of the present invention further provides an apparatus for processing a lost frame in audio data transmission, and specifically refer to fig. 8. The device includes:
a determining module 21, configured to determine a frame loss region of the audio signal;
the calculation module 22 is configured to calculate each sample point to be compensated of the frame loss region and a sample value corresponding to each sample point to be compensated according to the left and right endpoints of the frame loss region, the first preset number of sample points located before the frame loss region, and the second preset number of sample points located after the frame loss region;
and the supplementing module 23 is configured to supplement the frame loss region according to each sampling point to be supplemented and each corresponding sampling value, so as to obtain a supplemented audio signal.
Optionally, the calculation module includes:
the first determining unit is used for determining the number and the type of extreme points to be supplemented by comparing the sizes of the sampling values of the left end point of the frame loss region, the first sampling point positioned on the left side of the left end point, the right end point of the frame loss region and the first sampling point positioned on the right side of the right end point;
the second determining unit is used for determining the sampling value of the extreme point to be supplemented according to the left end point of the frame loss region, the nth sampling point positioned on the left side of the left end point, the nth-1 sampling point positioned on the left side of the left end point, the right end point of the frame loss region, the mth sampling point positioned on the right side of the right end point and the mth-1 sampling point positioned on the right side of the right end point;
and the third determining unit is used for determining the number of the sampling points to be compensated of the lost frame region and the sampling value of each sampling point to be compensated according to the sizes of the sampling values of the extreme point to be compensated, the left end point of the lost frame region, the first sampling point positioned on the left side of the left end point, the right end point of the lost frame region and the first sampling point positioned on the right side of the right end point.
It should be noted that the apparatus for processing lost audio data transmission in the embodiment of the present invention has the same beneficial effects as the method for processing lost audio data transmission provided in the above embodiment, and for the specific description of the method for processing lost audio data transmission in the embodiment of the present invention, the detailed description of the present invention is omitted here with reference to the above embodiment.
On the basis of the above embodiment, an embodiment of the present invention further provides a system for processing a lost frame of audio data transmission, where the system includes:
a memory for storing a computer program;
and the processor is used for realizing the steps of the audio data transmission lost frame processing method when executing the computer program.
For example, the processor in the embodiment of the present invention has a frame loss region for realizing the determination of the audio signal; calculating each sampling point to be compensated of the frame loss region and a sampling value corresponding to each sampling point to be compensated according to a first preset number of sampling points positioned in front of the frame loss region and a second preset number of sampling points positioned behind the frame loss region; and supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain the supplemented audio signal.
On the basis of the foregoing embodiments, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for processing a lost frame in audio data transmission are implemented.
The computer-readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A method for processing audio data transmission lost frames is characterized by comprising the following steps:
determining a frame loss region of the audio signal;
calculating each sample point to be compensated of the frame loss region and a sample value corresponding to each sample point to be compensated according to the left end point and the right end point of the frame loss region, a first preset number of sample points positioned in front of the frame loss region and a second preset number of sample points positioned behind the frame loss region;
and supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain a supplemented audio signal.
2. The method for processing the lost frame in audio data transmission according to claim 1, wherein the process of calculating each sample value to be compensated of the lost frame region and the sample value corresponding to each sample value to be compensated according to the left and right end points of the lost frame region, the first predetermined number of sample points located before the lost frame region, and the second predetermined number of sample points located after the lost frame region is as follows:
determining the number and the type of extreme points to be supplemented by comparing the sizes of the sampling values of the left end point of the frame loss region, the first sampling point positioned on the left side of the left end point, the right end point of the frame loss region and the first sampling point positioned on the right side of the right end point;
determining the sampling value of the extreme point to be supplemented according to the sampling values of the left end point of the frame loss region, the nth sampling point positioned on the left side of the left end point, the (n-1) th sampling point positioned on the left side of the left end point, the right end point of the frame loss region, the mth sampling point positioned on the right side of the right end point and the (m-1) th sampling point positioned on the right side of the right end point;
and determining the number of the sampling points to be compensated of the lost frame region and the sampling value of each sampling point to be compensated according to the sampling values of the extreme point to be compensated, the left end point of the lost frame region, the first sampling point positioned on the left side of the left end point, the right end point of the lost frame region and the first sampling point positioned on the right side of the right end point.
3. The method of claim 2, wherein the determining the number and type of the extreme points to be compensated by comparing the values of the samples of the left end point of the frame loss region, the first sample point located at the left side of the left end point, the right end point of the frame loss region, and the first sample point located at the right side of the right end point comprises:
when L isA-LA1＜0，LB-LB1If the number of the extreme points to be supplemented is less than 0, the type is a minimum value point;
when L isA-LA1＜0，LB-LB1When the number of the extreme points to be supplemented is more than 0, the number of the extreme points to be supplemented is two, and the types of the extreme points are respectively a minimum value point and a maximum value point;
when L isA-LA1＞0，LB-LB1When the number is more than 0, the number of the extreme points to be supplemented is one, and the type is the maximum point;
when L isA-LA1＞0，LB-LB1When the number of the extreme points to be supplemented is less than 0, the types of the extreme points to be supplemented are respectively a maximum value point and a minimum value point;
wherein L isASample value, L, representing the left end point of the lost frame regionA1Sample value, L, representing the first sample point to the left of the left end pointBSample value, L, representing the right end of the lost frame regionB1Representing the sample value of the first sample point to the right of the right end point.
4. The method for processing the audio data loss frame in the audio data transmission according to claim 3, wherein the process of determining the sampling value of the to-be-supplemented extreme point according to the sampling values of the left end point, the nth sampling point located at the left side of the left end point, the n-1 th sampling point located at the left side of the left end point, the right end point of the frame loss region, the mth sampling point located at the right side of the right end point, and the m-1 th sampling point located at the right side of the right end point comprises:
when the extreme point to be supplemented is one and is a minimum point:
if L isA(n-1)-LAnIf > 0, Lmin ═ LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf < 0, Lmin ═ LA+(LA-LAn) (ii) a Wherein Lmin is a sampling value of a minimum value point;
when the number of the extreme points to be supplemented is two, and the number of the extreme points to be supplemented is LATo LBWhen the minimum value point and the maximum value point are in turn:
if L isA(n-1)-LAnIf > 0, Lmin ═ LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf < 0, Lmin ═ LA+(LA-LAn)；
If L isB(m-1)-LBmIf < 0, Lmax is equal to LB+(LB-LB(m-1))；
If L isB(m-1)-LBmIf greater than 0, Lmax is equal to LB+(LB-LBm) (ii) a Wherein Lmax is a sampling value of the maximum value point;
when the extreme point to be supplemented is one and is a maximum point:
if L isA(n-1)-LAnIf < 0, Lmax is equal to LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf greater than 0, Lmax is equal to LA+(LA-LAn)；
When the number of the extreme points to be supplemented is two, and the extreme points are from LA to LB in sequence:
if L isA(n-1)-LAnIf < 0, Lmax is equal to LA+(LA-LA(n-1))；
If L isA(n-1)-LAnIf greater than 0, Lmax is equal to LA+(LA-LAn)；
If L isB(m-1)-LBmIf > 0, Lmin ═ LB+(LB-LB(m-1))；
If L isB(m-1)-LBmIf < 0, Lmin ═ LB+(LB-LBm)；
Wherein n is a first predetermined number, m is a second predetermined number, LAnSample value representing the nth sample point to the left of the left end point, LA(n-1)Sample value representing the (n-1) th sample point located to the left of the left end point, LBmRepresenting the sample value of the m-th sample point located to the right of said right end point, LBm-1Indicating the sample value of the m-1 sample point located to the right of the right end point.
5. The method for processing the lost frame in audio data transmission according to claim 4, wherein the process of determining the number of the sample points to be compensated of the lost frame region and the sample value of each sample point to be compensated according to the sample values of the extreme point to be compensated, the left end point of the lost frame region, the first sample point located at the left side of the left end point, the right end point of the lost frame region, and the first sample point located at the right side of the right end point comprises:
when the extreme point to be supplemented is one and is a minimum point:
from LANumber L of sample points to Lmin to be replenishedP＝(Lmin-LA)/(LA-LA1) And the sampling value of the p-th sampling point to be compensated is LA+p*LAstepWherein L isAstep＝LA-LA1；
From LBNumber L of sample points to Lmin to be replenishedQ＝(Lmin-LB)/(LB-LB1) And the sampling value of the qth sampling point to be compensated is LB+p*LBstepWherein L isBstep＝LB-LB1；
When the number of the extreme points to be supplemented is two and is LATo LBWhen the minimum value point and the maximum value point are in turn:
from LANumber L of sample points to Lmin to be replenishedX＝(LA-Lmin)/(LA-LA1) And the sampling value of the xth sampling point to be compensated is LA+x*LAstep(ii) a Wherein L isAstep＝LA-LA1；
Number L of sample points to be replenished from Lmin to LmaxY＝(Lmax-Lmin)/((|LA-LA1|+|LB-LB1L)/2) and the sampling value of the y sampling point to be compensated is Lmin + y LAstep(ii) a Wherein L isBstep＝(|LA-LA1|+|LB-LB1|)/2；
From Lmax to LBNumber L of sampling points to be replenishedZ＝(Lmax-LB)/(LB-LB1) And the sampling value of the z th sampling point to be replenished is Lmax + z x LBstepWherein L isBstep＝LB1-LB；
When the extreme point to be supplemented is one and is a maximum point:
from LANumber of sample points to Lmax to be replenished LP＝(Lmax-LA)/(LA-LA1) And the sampling value of the p-th sampling point to be compensated is LA+p*LAstepWherein L isAstep＝LA-LA1；
From Lmax to LBTo be replenished with sampling pointsNumber LQ＝(Lmax-LB)/(LB-LB1) And the sampling value of the q sampling point to be compensated is Lmax-p LBstepWherein L isBstep＝LB-LB1；
When the number of the extreme points to be supplemented is two, and the number of the extreme points to be supplemented is LATo LBWhen the maximum value point and the minimum value point are sequentially arranged:
from LANumber of sample points to Lmax to be replenished LX＝(LA-Lmax)/(LA-LA1) And the sampling value of the xth sampling point to be compensated is LA+x*LAstep(ii) a Wherein L isAstep＝LA-LA1；
Number L of sample points to be replenished from Lmax to LminY＝(Lmax-Lmin)/((|LA-LA1|+|LB-LB1L)/2) and the sampling value of the y sampling point to be compensated is Lmax-y LAstep(ii) a Wherein L isBstep＝(|LA-LA1|+|LB-LB1|)/2；
From Lmin to LBNumber L of sampling points to be replenishedZ＝(Lmin-LB)/(LB-LB1) And the sampling value of the z th sampling point to be replenished is Lmin + z x LBstepWherein L isBstep＝LB1-LB。
6. The method for processing lost frame in audio data transmission according to any of claims 1-5, wherein the first predetermined number is determined by:
comparing from the first sample point before the left end of the frame-missing region when L is presentA(n-1)-LAnWhen the number is more than 0, determining the number of n, and taking the number as a first preset number; when L does not exist within the preset threshold numberA(n-1)-LAnWhen the number is larger than 0, taking the preset threshold number as the first preset number;
comparing from the first sample point after the right end point of the frame loss region when L existsB(m-1)-LBmWhen the number is more than 0, determining the number of m, and taking the number as a second preset number; when L does not exist within the preset threshold numberB(m-1)-LBmAnd when the number is more than 0, taking the preset threshold number as the second preset number.
7. An apparatus for processing a lost frame of audio data transmission, comprising:
the determining module is used for determining a frame loss region of the audio signal;
the calculation module is used for calculating each sampling point to be compensated of the frame loss region and a sampling value corresponding to each sampling point to be compensated according to the left end point and the right end point of the frame loss region, a first preset number of sampling points positioned in front of the frame loss region and a second preset number of sampling points positioned behind the frame loss region;
and the supplement module is used for supplementing the frame loss region according to each sampling point to be supplemented and the corresponding sampling value to obtain a supplemented audio signal.
8. The apparatus for processing lost frame in audio data transmission according to claim 7, wherein said calculation module comprises:
the first determining unit is used for determining the number and the type of extreme points to be supplemented by comparing the sizes of sampling values of a left end point of the frame loss region, a first sampling point positioned on the left side of the left end point, a right end point of the frame loss region and a first sampling point positioned on the right side of the right end point;
a second determining unit, configured to determine a sampling value of the extreme point to be compensated according to a left end point of the frame loss region, an nth sampling point located on the left side of the left end point, an nth-1 sampling point located on the left side of the left end point, a right end point of the frame loss region, an mth sampling point located on the right side of the right end point, and an mth-1 sampling point located on the right side of the right end point;
and the third determining unit is used for determining the number of the sampling points to be compensated of the lost frame region and the sampling value of each sampling point to be compensated according to the sampling values of the extreme point to be compensated, the left end point of the lost frame region, the first sampling point positioned on the left side of the left end point, the right end point of the lost frame region and the first sampling point positioned on the right side of the right end point.
9. A system for processing lost frames for audio data transmission, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the audio data transmission lost frame processing method according to any one of claims 1 to 6 when executing said computer program.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method for processing a lost frame of audio data transmission according to any one of claims 1 to 6.
CN202111678569.XA 2021-12-31 2021-12-31 Method, device, system and medium for processing audio data transmission lost frame Pending CN114141257A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111678569.XA CN114141257A (en) 2021-12-31 2021-12-31 Method, device, system and medium for processing audio data transmission lost frame

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111678569.XA CN114141257A (en) 2021-12-31 2021-12-31 Method, device, system and medium for processing audio data transmission lost frame

Publications (1)

Publication Number Publication Date
CN114141257A true CN114141257A (en) 2022-03-04

Family

ID=80381704

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111678569.XA Pending CN114141257A (en) 2021-12-31 2021-12-31 Method, device, system and medium for processing audio data transmission lost frame

Country Status (1)

Country Link
CN (1) CN114141257A (en)

Similar Documents

Publication Publication Date Title
US6289406B1 (en) Optimizing the performance of asynchronous bus bridges with dynamic transactions
US9916840B1 (en) Delay estimation for acoustic echo cancellation
US5918073A (en) System and method for equalizing data buffer storage and fetch rates of peripheral devices
US10754609B2 (en) Enhancing a rendering system to distinguish presentation time from data time
US9477618B2 (en) Information processing device, information processing system, storage medium storing program for controlling information processing device, and method for controlling information processing device
US8843663B2 (en) Data transmission device and method for merging multiple commands
JP2010514062A5 (en)
TW201030604A (en) Pattern-recognition processor with results buffer
JP2004513454A (en) Method and apparatus for determining the best case reaction time of a periodic task
WO2017008587A1 (en) Method and apparatus for eliminating popping at the head of audio, and a storage medium
US7962518B2 (en) Method and apparatus to control media transfer protocol device to manage media file
US11010094B2 (en) Task management method and host for electronic storage device
KR20100050819A (en) Method for operating semiconductor memory system
CN113687781A (en) Method, device, equipment and medium for pulling up thermal data
CN113873255A (en) Video data transmission method, video data decoding method and related devices
CN111708720A (en) Data caching method, device, equipment and medium
US7890958B2 (en) Automatic adjustment of time a consumer waits to access data from queue during a waiting phase and transmission phase at the queue
CN114141257A (en) Method, device, system and medium for processing audio data transmission lost frame
US20140244887A1 (en) Data processing apparatus and control method
US7873755B2 (en) Semiconductor device, reproduction device, and method for controlling the same
CN114466285A (en) Method, device and equipment for adjusting loudness of audio signal and storage medium
TWI727432B (en) Singing scoring method and singing scoring system based on streaming media
CN113782050A (en) Sound tone changing method, electronic device and storage medium
CN113395589B (en) Video file playing method and device, computer equipment and storage medium
CN117373501B (en) Statistical service execution rate improving method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20221125

Address after: No. 500 Songling Road, Laoshan District, Qingdao City, Shandong Province, 266100

Applicant after: GOERTEK TECHNOLOGY Co.,Ltd.

Address before: 261031 workshop 1, phase III, Geer Photoelectric Industrial Park, 3999 Huixian Road, Yongchun community, Qingchi street, Weifang High tech Zone, Weifang City, Shandong Province

Applicant before: GoerTek Optical Technology Co.,Ltd.