CN109887514A - Audio frequency transmission method and device - Google Patents
Audio frequency transmission method and device Download PDFInfo
- Publication number
- CN109887514A CN109887514A CN201910024331.1A CN201910024331A CN109887514A CN 109887514 A CN109887514 A CN 109887514A CN 201910024331 A CN201910024331 A CN 201910024331A CN 109887514 A CN109887514 A CN 109887514A
- Authority
- CN
- China
- Prior art keywords
- packets
- data
- audio
- redundant
- packet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The present embodiments relate to audio coding fields.The embodiment of the invention provides a kind of audio frequency transmission method and device, which includes: acquisition audio sampling data；The audio sampling data is encoded into packets of audio data, records the length of the packets of audio data；The audio sampling data is encoded into redundant data packets；Redundant data packets described in n-th are attached in the N+i packets of audio data, N is positive integer, and i is the integer more than or equal to 2；The length information of the packets of audio data is attached in the packets of audio data.When continual data package dropout occurs, the present invention can restore packets of audio data, substantially increase voice call quality.
Description
Technical field
The present invention relates to audio coding fields, in particular to a kind of audio frequency transmission method and device.
Background technique
Often there is the phenomenon that packet loss in transmission process in packets of audio data, although the method for thering are data to restore at present, and
Once running into continual data package dropout, it is difficult to be restored.
Summary of the invention
The embodiment of the invention provides a kind of audio frequency transmission method and devices can restore sound when continual data package dropout occurs
Frequency data packet.
In a first aspect, the embodiment of the invention provides a kind of audio frequency transmission methods, comprising:
Obtain audio sampling data；
The audio sampling data is encoded into packets of audio data, records the length of the packets of audio data；
The audio sampling data is encoded into redundant data packets；
Redundant data packets described in n-th are attached in the N+i packets of audio data, N is positive integer, and i is more than or equal to 2
Integer；
The length information of the packets of audio data is attached in the packets of audio data.
It wherein, further include setting buffer；
Described redundant data packets described in n-th are attached in the N+i packets of audio data include:
The redundant data packets being encoded into are stored in the last of the buffer；
Judge whether the redundant data packets stored in the buffer reach predetermined number, if so, by described slow
It rushes first redundant data packets stored in device to be attached in the N+i packets of audio data, by first redundant digit
It is deleted from the buffer according to packet.
Wherein, the buffer is the array of first in first out.
Wherein, the packets of audio data is OPUS data packet.
Wherein, which is characterized in that the redundant data packets are low bit- rate redundancy packet.
Wherein, the i value is 4.
It wherein, further include that the audio sampling data is encoded into forward error correction data packet；By the forward error correction data
Packet is attached in the packets of audio data.
Wherein, further includes: when decoding, decoded from the packets of audio data；When no packets of audio data, from institute
It states and is decoded in forward error correction data packet；When no forward error correction data packet, decoded from the redundant data packets.
Second aspect, the embodiment of the invention also provides a kind of audio transmission devices, comprising:
Acquiring unit, for obtaining audio sampling data；
First coding unit records the audio data for the audio sampling data to be encoded into packets of audio data
The length of packet；
Second coding unit, for the audio sampling data to be encoded into redundant data packets；
First extra cell, for redundant data packets described in n-th to be attached in the N+i packets of audio data, N is positive
Integer, i are the integer more than or equal to 2；
Second extra cell, for the length information of the packets of audio data to be attached in the packets of audio data.
It wherein, further include setting unit, for buffer to be arranged；
First extra cell is used for:
The redundant data packets being encoded into are stored in the last of the buffer；
Judge whether the redundant data packets stored in the buffer reach predetermined number, if so, by described slow
It rushes first redundant data packets stored in device to be attached in the N+i packets of audio data, by first redundant digit
It is deleted from the buffer according to packet.
Wherein, the buffer is the array of first in first out.
Wherein, the packets of audio data is OPUS data packet.
Wherein, the redundant data packets are low bit- rate redundancy packet.
Wherein, the i value is 4.
Wherein, further includes:
Third coding unit, for the audio sampling data to be encoded into forward error correction data packet；
Third extra cell, for the forward error correction data packet to be attached in the packets of audio data.
Wherein, further include decoding unit, be used for: when decoding, being decoded from the packets of audio data；When no audio
When data packet, decoded from the forward error correction data packet；When no forward error correction data packet, from the redundant data
It is decoded in packet.
The third aspect, the embodiment of the invention provides a kind of computer readable storage mediums, are stored thereon with computer journey
Sequence, when which is executed by processor the step of realization any of the above-described the method.
Fourth aspect the embodiment of the invention provides a kind of electronic equipment, including memory, processor and is stored in storage
On device and the computer program that can run on a processor, the processor are realized described in any of the above-described when executing described program
The step of method.
Audio frequency transmission method of the embodiment of the present invention has the following beneficial effects:
In audio frequency transmission method of the embodiment of the present invention, audio sampling data is obtained, audio sampling data is separately encoded into
Packets of audio data and redundant data packets, it is next by redundant data packets and audio data packet aggregation, n-th redundant data packets are attached
It is added in the N+i packets of audio data, is attached to redundant data packets in the subsequent packets of audio data of the redundant data packets, example
Such as it is located at behind redundant data packets in the packets of audio data of the 2nd (or the 3rd, the 4th), redundant data packets is not added
Into adjacent packets of audio data thereafter, therefore, when continual data package dropout occurs, number of dropped packets can be restored from redundant data packets
According to substantially increasing voice call quality.
Detailed description of the invention
Fig. 1 is the flow diagram one of audio frequency transmission method of the embodiment of the present invention；
Fig. 2 is the schematic diagram of cataloged procedure in audio frequency transmission method of the embodiment of the present invention；
Fig. 3 is the flow diagram two of audio frequency transmission method of the embodiment of the present invention；
Fig. 4 is the schematic diagram of buffer in audio frequency transmission method of the embodiment of the present invention；
Fig. 5 is the flow diagram three of audio frequency transmission method of the embodiment of the present invention；
Fig. 6 is the structural schematic diagram of audio transmission device of the embodiment of the present invention.
Specific embodiment
The embodiment of the present invention is further introduced with reference to the accompanying drawings and examples.
In following introductions, term " first ", " second " only for descriptive purposes, and should not be understood as instruction or dark
Show relative importance.Following introductions provide multiple embodiments of the embodiment of the present invention, can be replaced between different embodiments or
Person merges combination, therefore the embodiment of the present invention is it is also contemplated that all possibility comprising documented identical and/or different embodiments
Combination.Thus, if one embodiment includes feature A, B, C, another embodiment includes feature B, D, then the present invention is implemented
Example also should be regarded as including the every other possible combined embodiment of one or more containing A, B, C, D, although the embodiment
May there be specific literature record in the following contents.
In following introductions, statement " having ", " can have ", "comprising" and " comprising " or " may include " and " can be with
Including " indicate that there are corresponding feature (for example, elements of such as numerical value, function, operation or component etc), but be not excluded for depositing
In additional feature.
In following introductions, when an element (for example, first element) is referred to as " (operation or communication) is couple to " or " connects
Be connected to " another element (for example, second element) when, other elements can be directly coupled or connected, or may exist
Intermediary element (for example, third element).On the other hand, when an element (for example, first element) referred to as " is directly coupled to "
Or when " being directly connected to " another element (for example, second element), it should be appreciated that be not present intermediary element (for example, third element).
Following description provides example, and does not carry out to range, applicability described in claims or example
Limitation.The function and arrangement of the element of description can be made in the case where not departing from the range of content of the embodiment of the present invention
Change.Various processes or component can suitably be omitted, substitute or be added to each example.Such as described method can be to be retouched
The order in a different order stated executes, and can add, omits or combine various steps.Furthermore, it is possible to will be about some
The feature of example description is combined in other examples.
Remote voice communications using more and more extensive, such as video conference, mobile terminal sound call etc..In video council
The processing such as in view, meeting-place includes terminal device, and the terminal device in the meeting-place samples the voice messaging of participant, encodes
VoP is formed, VoP is then sent to another party meeting-place, the terminal device in another party meeting-place is to voice
Data packet is decoded, to realize the voice communication in two side meeting-place video conferences.In the voice communication scene of mobile terminal
In, there is also essentially identical voice data transmissions.Voice data is influenced in transmission process by factors such as communication lines,
Packet loss or even continual data package dropout can occur.After continual data package dropout, if VoP can be restored, eventually to video conference, movement
The speech quality of end voice communication etc. has a major impact.Audio frequency transmission method and device provided in an embodiment of the present invention, are occurring
When continual data package dropout, audio data can be restored, improve the stability and quality of voice communication.
Audio frequency transmission method of the embodiment of the present invention for example can be applied to interactive intelligent tablet computer, interaction plate, display or
The equipment such as smart television can also be applied to mobile terminal, tablet computer, personal computer, notebook, desktop computer, clothes
Business device, personal digital assistant (Personal Digital Assistant, PDA), wearable device etc..The present invention is described below
Embodiment audio frequency transmission method.
Fig. 1 is the flow diagram one of audio frequency transmission method of the embodiment of the present invention, as shown in Figure 1, the present embodiment audio passes
Transmission method includes step 101, obtains audio sampling data；Step 102, audio sampling data is encoded into packets of audio data, remembered
Record the length of packets of audio data；Step 103, audio sampling data is encoded into redundant data packets；Step 104, by n-th redundancy
Data packet is attached in the N+i packets of audio data, and N is positive integer, and i is the integer more than or equal to 2；Step 105, by audio number
It is attached in packets of audio data according to the length information of packet.Step 101-105 is described below.
Step 101, audio sampling data is obtained.
Fig. 2 is the schematic diagram of cataloged procedure in audio frequency transmission method of the embodiment of the present invention, as shown in Figs. 1-2, in some realities
It applies in example, terminal device samples voice messaging, obtains audio sampling data.The process of sampling is to convert acoustic waveform
At the process of a series of binary data and the process of an analog/digital conversion.In sampling process, with certain period pair
Sound wave is sampled, and samples all recorded the state of original analog sound wave at a time, referred to as sample each time.By one
The sample of string connects, so that it may describe one section of sound wave.In some embodiments, the sampling period can be according to the actual situation
Setting, for example, 20ms, as shown in Fig. 2, data1 is the audio data in first sampling period, data2 is second sampling week
The audio data of phase, data3 are the audio data in third sampling period, and so on.
Step 102, audio sampling data is encoded into packets of audio data, recording audio according to packet length.
As shown in Fig. 2, in some embodiments, audio sampling data data1 is encoded into packets of audio data p1, by audio
Sampled data data2 is encoded into packets of audio data p2, audio sampling data data3 is encoded into packets of audio data p3, successively class
It pushes away.In some embodiments, packets of audio data is OPUS data packet, and OPUS is the format for damaging acoustic coding, main special
Property is as follows:
Arrive within 6kb/ seconds the bit rate of 510kb/s
Sample rate is from 8kHz (narrowband) to 48kHz (full range)
Frame sign is from 2.5 milliseconds to 60 millisecond
Support constant bit rate (CBR) and variable bit rate (VBR)
Audio bandwidth from narrowband to full frequency band
Support voice and music
Support monophonic and stereo
Support up to 255 channels (frame of multiple data stream)
It can dynamic regulation bit rate, audio bandwidth and frame sign
Good robustness Loss Rate and data packet loss concealment
Floating-point and fixed-point implementation
In this step, recording audio is gone back according to the length of packet, because after storing one piece of data in a computer, if it is desired to
The data are obtained, segment data initial position in a computer and the length of the data is needed, is obtained with so whole
Segment data.In some embodiments, the polymerization that the data that terminal is sent out are, for example, packets of audio data and redundant data packets is sent,
The length information length of packets of audio data is attached to the last of polymerization packet；When receiving decoding terminals, according to length information
Length can obtain the length of packets of audio data, to parse packets of audio data, and then can solve from remaining data
Redundancy packet is precipitated.
Step 103, audio sampling data is encoded into redundant data packets.
As shown in Fig. 2, in some embodiments, audio sampling data data1 is encoded into redundant data packets nb_p1, it is superfluous
Remaining data packet nb_p1 is the backup of audio sampling data data1；Audio sampling data data2 is encoded into redundant data packets nb_
P2, redundant data packets nb_p2 are the backups of audio sampling data data2；Audio sampling data data3 is encoded into redundant data
Nb_p3 is wrapped, redundant data packets nb_p3 is the backup of audio sampling data data3, and so on.In some embodiments, by sound
Frequency sampling data are compressed by narrowband, generate the narrowband redundancy packet of a 8Kbps (Kilobit per second, kilobit are per second)
That is redundant data packets.In some embodiments, redundant data packets be low bit- rate redundancy packet (Low Bit-Rate Redundancy,
LBRR)。
Step 104, n-th redundant data packets are attached in the N+i packets of audio data, N is positive integer, i be greater than
Integer equal to 2.
As shown in Fig. 2, in some embodiments, i is the integer more than or equal to 2, the value of i for example can for 2,3,4,5,
6,7 etc., it is introduced by taking i=4 as an example below.For the 1st redundant data packets nb_p1, it is appended to the 5th (1+4) a sound
Behind frequency data packet p5；For the 2nd redundant data packets nb_p2, it is appended to a packets of audio data p6's of the 6th (2+4)
Below；For the 3rd redundant data packets nb_p3, it is appended to behind a packets of audio data p7 of the 7th (3+4)；For the 4th
A redundant data packets nb_p4, it is appended to behind a packets of audio data p8 of the 8th (4+4), and so on.It, will in this step
N-th redundant data packets are attached in the N+i packets of audio data, are attached to redundant data packets behind the redundant data packets
Packets of audio data in, such as the 2nd behind redundant data packets in the packets of audio data of (or the 3rd, the 4th etc.),
It, therefore, can be from redundancy when continual data package dropout occurs in adjacent packets of audio data redundant data packets not being appended to
Restore packet loss data in data packet, substantially increases voice call quality.
Step 105, the length information of packets of audio data is attached in packets of audio data.
As shown in Fig. 2, in some embodiments, the length information of packets of audio data is attached to the 5th packets of audio data
In p5, such as behind redundant data packets nb_p1；The length information of packets of audio data is attached to the 6th packets of audio data
In p6, such as behind redundant data packets nb_p2, and so on.The length information length of packets of audio data is attached to
Packets of audio data finally, receive decoding terminals when, the length of packets of audio data can be obtained according to length information length, from
And packets of audio data is parsed, and then redundant data packets can be parsed from remaining data.In some embodiments, every
Its length information is added in one packets of audio data.
In audio frequency transmission method of the embodiment of the present invention, audio sampling data is obtained, audio sampling data is separately encoded into
Packets of audio data and redundant data packets, it is next by redundant data packets and audio data packet aggregation, n-th redundant data packets are attached
It is added in the N+i packets of audio data, is attached to redundant data packets in the subsequent packets of audio data of the redundant data packets, example
Such as it is located at behind redundant data packets in the packets of audio data of the 2nd (or the 3rd, the 4th), redundant data packets is not added
Into adjacent packets of audio data thereafter, therefore, when continual data package dropout occurs, number of dropped packets can be restored from redundant data packets
According to substantially increasing voice call quality.
Fig. 3 is the flow diagram two of audio frequency transmission method of the embodiment of the present invention, as shown in figure 3, the present embodiment audio passes
Transmission method includes step 201, obtains audio sampling data；Step 202, audio sampling data is encoded into packets of audio data, remembered
Record the length of packets of audio data；Step 203, audio sampling data is encoded into redundant data packets；Step 204, it will be encoded into
Redundant data packets are stored in the last of buffer；Step 205, judge whether the redundant data packets stored in buffer reach default
Number, if so, step 206 is executed, if not, executing step 207；Step 206, by stored in buffer first redundant digit
It is attached in the N+i packets of audio data according to packet, first redundant data packets is deleted from buffer；Step 207, by audio
The length information of data packet is attached in packets of audio data.Wherein step 201-203 and step 101-103 are essentially identical, step
207 is essentially identical with step 105, refers to the introduction of step 101-103, step 105, and step 204-206 is described below.
Step 204, by the last of the redundant data packets being encoded into deposit buffer.
It in some embodiments, in this step or before this step include setting buffer.As shown in Figure 3-4, delay
It rushes device and is used to store redundant data packets, such as storing 5 nearest redundant data packets, also can store other nearest numbers
Purpose redundant data packets.The size of buffer for example can be set to 5 redundant data packets of storage.Buffer for example can be for first
Into the array for first going out (First Input First Output, FIFO).As shown in figure 4, the redundant data stored in buffer
Packet forms queue, the redundant data packets that are stored in every time deposit buffer finally, for example first redundant data packets nb_p1 is deposited
Enter buffer, when storing second redundant data packets nb_p2, second redundant data packets nb_p2 is stored in first redundancy
Behind data packet nb_p1, when storing third redundant data packets nb_p3, third redundant data packets nb_p3 is stored in second
Behind a redundant data packets nb_p2, and so on.
Step 205, judge whether the redundant data packets stored in buffer reach predetermined number, if so, executing step
206, if not, executing step 207.
In some embodiments, predetermined number can be set according to actual needs, such as 3,4,5 etc..One
In a little embodiments, predetermined number can be for example i+1.In some embodiments, predetermined number is more than or equal to 3.
Step 206, store in buffer first redundant data packets is attached in the N+i packets of audio data, it will
First redundant data packets is deleted from buffer.
As shown in figure 4, in some embodiments, first redundant data packets stored in buffer be in buffer at first
Redundant data packets of storage, such as when being stored with 5 redundant data packets in buffer, by this 5 redundant data packets at first
The redundant data packets of storage are attached in packets of audio data, the redundant data packets stored at first in buffer are deleted, after deletion
Buffer just has space to store redundant data packets again.In some embodiments, the storage size of buffer is fixed, such as
Store 5 redundant data packets.
In the present embodiment, nearest redundant data packets are stored in buffer, redundant data packets in a buffer reach
When to predetermined number, the redundant data packets stored at first in buffer are attached in packets of audio data, are realized redundant digit
According to packet be appended to in the non-conterminous packets of audio data of redundant data packets, can be from redundancy when continual data package dropout occurs
Restore packet loss data in data packet, substantially increases voice call quality.
Fig. 5 is the flow diagram three of audio frequency transmission method of the embodiment of the present invention, as shown in figure 5, the present embodiment audio passes
Transmission method includes step 201, obtains audio sampling data；Step 202, audio sampling data is encoded into packets of audio data, remembered
Record the length of packets of audio data；Audio sampling data is encoded into redundant data packets by step 203A；Audio sampling data is encoded
At forward error correction data packet；Forward error correction data packet is attached in packets of audio data；Step 204, the redundant digit that will be encoded into
According to the last of packet deposit buffer；Step 205, judge whether the redundant data packets stored in buffer reach predetermined number, such as
Fruit is to execute step 206, if not, executing step 207；Step 206, by stored in buffer first redundant data packets
It is attached in the N+i packets of audio data, first redundant data packets is deleted from buffer；Step 207, by audio data
The length information of packet is attached in packets of audio data.Wherein, step 201,202,204-207 had been introduced, and were referred to above
It introduces, step 203A is described below.
Audio sampling data is encoded into redundant data packets by step 203A；Audio sampling data is encoded into forward error correction
Data packet；Forward error correction data packet is attached in packets of audio data.
In some embodiments, audio sampling data is not only encoded into redundant data packets, also compiles audio sampling data
Forward error correction data packet is attached to audio number at forward error correction data packet (Forward Error Correction, FEC) by code
According in packet.So in the present embodiment, the audio data after coding includes packets of audio data, forward error correction data packet and redundant digit
According to packet.It gives one example below, sampling period 20ms, the complete packet after each period coding is as follows:
In some embodiments, audio frequency transmission method further include: when decoding, decoded from packets of audio data；When there is no sound
When frequency data packet, decoded from forward direction corrected data packets；When there is no forward error correction data packet, decoded from redundant data packets.
The audio-frequency information of each sampling time section can be restored from three places, with the sound of 0-20ms sampling time section
For frequency information, it can be restored from following three places:
Packets of audio data in first: 0-20ms complete packet.
FEC packet in second: 20-40ms complete packet.
Third: the redundant data packets in 100-120ms complete packet.
In the case where packet loss is not present, do not need to obtain original audio information from three above packet simultaneously.Therefore, it needs
Priority, the sequence of priority from big to small are as follows: packets of audio data > FEC packet > redundant data packets are set for three packets above.
I.e. three above packet all in the presence of, preferentially decoded from packets of audio data, because other two is all low bit- rate
It is high not decode the sound quality come from wherein decoded sound quality from packets of audio data for narrowband packet.
If the complete packet loss of 0-20ms, preferentially decoded from the 0-20msFEC packet carried in 20-40ms complete packet extensive
It is multiple, because while the audio quality for decoding recovery from the 0-20ms redundant data packets carried in 100-120ms complete packet is basic
It is identical, but decoding delay is lower from the 0-20msFEC packet carried in 20-40ms complete packet.
When the 0-20msFEC packet carried in the complete packet of 0-20ms, 20-40ms complete packet is all lost, then from 100-
0-20ms redundant data packets in 120ms complete packet are restored.
The embodiment of the invention also provides a kind of audio transmission devices, as shown in fig. 6, audio transmission of the embodiment of the present invention fills
It sets including acquiring unit 10, for obtaining audio sampling data；First coding unit 11, for audio sampling data to be encoded into
Packets of audio data, recording audio according to packet length；Second coding unit 13, for audio sampling data to be encoded into redundant digit
According to packet；First extra cell 14, for n-th redundant data packets to be attached in the N+i packets of audio data, N is positive integer,
I is the integer more than or equal to 2；Second extra cell 12, for the length information of packets of audio data to be attached to packets of audio data
In.
It optionally, further include setting unit, for buffer to be arranged；
First extra cell is used for:
By the last of the redundant data packets being encoded into deposit buffer；
Judge whether the redundant data packets stored in buffer reach predetermined number, if so, will store in buffer
First redundant data packets is attached in the N+i packets of audio data, and first redundant data packets is deleted from buffer.
Optionally, buffer is the array of first in first out.
Optionally, packets of audio data is OPUS data packet.
Optionally, redundant data packets are low bit- rate redundancy packet.
Optionally, i value is 4.
Optionally, further includes:
Third coding unit, for audio sampling data to be encoded into forward error correction data packet；
Third extra cell, for forward error correction data packet to be attached in packets of audio data.
Optionally, further include decoding unit, be used for: when decoding, being decoded from packets of audio data；When there is no packets of audio data
When, it is decoded from forward direction corrected data packets；When there is no forward error correction data packet, decoded from redundant data packets.
In this specification, for audio transmission device embodiment, content is substantially similar to audio frequency transmission method reality
Example is applied, related place refers to foregoing description.
Those skilled in the art can be understood that the embodiment of the present invention technical solution can by software and/or
Hardware is realized." unit " and " module " in this specification is to refer to complete independently or complete with other component cooperation specific
The software and/or hardware of function, wherein hardware for example can be FPGA (Field-ProgrammaBLE Gate Array, it is existing
Field programmable gate array), IC (Integrated Circuit, integrated circuit) etc..
Unit and/or module are managed everywhere in the embodiment of the present invention, it can be by realizing function described in the embodiment of the present invention
Analog circuit and realize, can also be realized by executing the software of function described in the embodiment of the present invention.
The embodiment of the invention also provides a kind of electronic equipment, including memory, processor and storage are on a memory simultaneously
The step of computer program that can be run on a processor, processor realizes the above method when executing program.
The embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer program, the journey
The step of above method is realized when sequence is executed by processor.Wherein, computer readable storage medium can include but is not limited to appoint
The disk of what type, including floppy disk, CD, DVD, CD-ROM, mini drive and magneto-optic disk, ROM, RAM, EPROM,
EEPROM, DRAM, VRAM, flash memory device, magnetic or optical card, nanosystems (including molecular memory IC), or be suitble to
In any kind of medium or equipment of store instruction and/or data.
In several embodiments provided by the embodiment of the present invention, it should be understood that disclosed device and method, it can be with
It realizes by another way.The apparatus embodiments described above are merely exemplary, for example, the division of the unit,
Only a kind of logical function partition, there may be another division manner in actual implementation, such as: multiple units or components can be tied
It closes, or is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each group
Can be through some interfaces at the mutual coupling in part or direct-coupling or communication connection, equipment or unit it is indirect
Coupling or communication connection, can be electrical, mechanical or other forms.
Each functional unit in each embodiment of the embodiment of the present invention can be fully integrated in one processing unit, can also
To be each unit individually as a unit, can also be integrated in one unit with two or more units；It is above-mentioned
Integrated unit both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
Described above is only the preferred embodiment of the embodiment of the present invention, is not intended to restrict the invention embodiment, right
For those skilled in the art, the embodiment of the present invention can have various modifications and variations.All essences in the embodiment of the present invention
Within mind and principle, any modification, equivalent replacement, improvement and so on should be included in the protection scope of the embodiment of the present invention
Within.
Claims (18)
1. a kind of audio frequency transmission method characterized by comprising
Obtain audio sampling data；
The audio sampling data is encoded into packets of audio data, records the length of the packets of audio data；
The audio sampling data is encoded into redundant data packets；
Redundant data packets described in n-th are attached in the N+i packets of audio data, N is positive integer, and i is whole more than or equal to 2
Number；
The length information of the packets of audio data is attached in the packets of audio data.
2. audio frequency transmission method according to claim 1, which is characterized in that further include setting buffer；
Described redundant data packets described in n-th are attached in the N+i packets of audio data include:
The redundant data packets being encoded into are stored in the last of the buffer；
Judge whether the redundant data packets stored in the buffer reach predetermined number, if so, by the buffer
First redundant data packets of middle storage are attached in the N+i packets of audio data, by first redundant data packets
It is deleted from the buffer.
3. audio frequency transmission method according to claim 2, which is characterized in that the buffer is the array of first in first out.
4. audio frequency transmission method according to any one of claim 1-3, which is characterized in that the packets of audio data is
OPUS data packet.
5. audio frequency transmission method according to any one of claim 1-3, which is characterized in that the redundant data packets are low
Code rate redundancy packet.
6. audio frequency transmission method according to any one of claim 1-3, which is characterized in that the i value is 4.
7. audio frequency transmission method according to any one of claim 1-3, which is characterized in that further include adopting the audio
Sample data encoding is at forward error correction data packet；The forward error correction data packet is attached in the packets of audio data.
8. audio frequency transmission method according to claim 7, which is characterized in that further include: when decoding, from the audio data
It is decoded in packet；When no packets of audio data, decoded from the forward error correction data packet；When no forward error correction
When data packet, decoded from the redundant data packets.
9. a kind of audio transmission device characterized by comprising
Acquiring unit, for obtaining audio sampling data；
First coding unit records the packets of audio data for the audio sampling data to be encoded into packets of audio data
Length；
Second coding unit, for the audio sampling data to be encoded into redundant data packets；
First extra cell, for redundant data packets described in n-th to be attached in the N+i packets of audio data, N is positive whole
Number, i are the integer more than or equal to 2；
Second extra cell, for the length information of the packets of audio data to be attached in the packets of audio data.
10. audio transmission device according to claim 9, which is characterized in that further include setting unit, for buffering to be arranged
Device；
First extra cell is used for:
The redundant data packets being encoded into are stored in the last of the buffer；
Judge whether the redundant data packets stored in the buffer reach predetermined number, if so, by the buffer
First redundant data packets of middle storage are attached in the N+i packets of audio data, by first redundant data packets
It is deleted from the buffer.
11. audio transmission device according to claim 10, which is characterized in that the buffer is the number of first in first out
Group.
12. the audio transmission device according to any one of claim 9-11, which is characterized in that the packets of audio data is
OPUS data packet.
13. the audio transmission device according to any one of claim 9-11, which is characterized in that the redundant data packets are
Low bit- rate redundancy packet.
14. the audio transmission device according to any one of claim 9-11, which is characterized in that the i value is 4.
15. the audio transmission device according to any one of claim 9-11, which is characterized in that further include:
Third coding unit, for the audio sampling data to be encoded into forward error correction data packet；
Third extra cell, for the forward error correction data packet to be attached in the packets of audio data.
16. audio transmission device according to claim 15, which is characterized in that further include decoding unit, be used for: decoding
When, it is decoded from the packets of audio data；When no packets of audio data, decoded from the forward error correction data packet；
When no forward error correction data packet, decoded from the redundant data packets.
17. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The step of any one of claim 1-8 the method is realized when execution.
18. a kind of electronic equipment including memory, processor and stores the calculating that can be run on a memory and on a processor
Machine program, which is characterized in that the processor realizes any one of the claim 1-8 the method when executing described program
The step of.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910024331.1A CN109887514B (en) | 2019-01-10 | 2019-01-10 | Audio transmission method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910024331.1A CN109887514B (en) | 2019-01-10 | 2019-01-10 | Audio transmission method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109887514A true CN109887514A (en) | 2019-06-14 |
| CN109887514B CN109887514B (en) | 2021-03-19 |
Family
ID=66925823
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910024331.1A Active CN109887514B (en) | 2019-01-10 | 2019-01-10 | Audio transmission method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109887514B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113660063A (en) * | 2021-08-18 | 2021-11-16 | 杭州网易智企科技有限公司 | Spatial audio data processing method and device, storage medium and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1241821A1 (en) * | 2001-03-13 | 2002-09-18 | Koninklijke Philips Electronics N.V. | Method of data packet error protection |
| CN1622504A (en) * | 2003-11-26 | 2005-06-01 | 上海贝尔阿尔卡特股份有限公司 | A data packet recovery method |
| CN1698324A (en) * | 2003-02-25 | 2005-11-16 | 三菱电机株式会社 | Packet transmission device |
| CN101030951A (en) * | 2007-02-08 | 2007-09-05 | 华为技术有限公司 | Drop-out compensating method and compensator |
| CN102170583A (en) * | 2010-02-26 | 2011-08-31 | 中兴通讯股份有限公司 | Method and system for recovering and playing audio frequency in mobile multimedia broadcast |
-
2019
- 2019-01-10 CN CN201910024331.1A patent/CN109887514B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1241821A1 (en) * | 2001-03-13 | 2002-09-18 | Koninklijke Philips Electronics N.V. | Method of data packet error protection |
| CN1698324A (en) * | 2003-02-25 | 2005-11-16 | 三菱电机株式会社 | Packet transmission device |
| CN1622504A (en) * | 2003-11-26 | 2005-06-01 | 上海贝尔阿尔卡特股份有限公司 | A data packet recovery method |
| CN101030951A (en) * | 2007-02-08 | 2007-09-05 | 华为技术有限公司 | Drop-out compensating method and compensator |
| CN102170583A (en) * | 2010-02-26 | 2011-08-31 | 中兴通讯股份有限公司 | Method and system for recovering and playing audio frequency in mobile multimedia broadcast |
Non-Patent Citations (2)
| Title |
|---|
| 曹震等: "《单向信道的信息可靠传输机制研究》", 《计算机工程与应用》 * |
| 李彬等: "《一种鲁棒灵活的非平衡多描述视频编码和传输方案》", 《计算机学报》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113660063A (en) * | 2021-08-18 | 2021-11-16 | 杭州网易智企科技有限公司 | Spatial audio data processing method and device, storage medium and electronic equipment |
| CN113660063B (en) * | 2021-08-18 | 2023-12-08 | 杭州网易智企科技有限公司 | Spatial audio data processing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109887514B (en) | 2021-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8090404B2 (en) | Methods of recording voice signals in a mobile set | |
| CA1245780A (en) | Method of reconstructing lost data in a digital voice transmission system and transmission system using said method | |
| US8386523B2 (en) | Random access audio decoder | |
| Petr et al. | Priority discarding of speech in integrated packet networks | |
| EP1624448B1 (en) | Packet multiplexing multi-channel audio | |
| CN103905928A (en) | Network voice intercom method, device and system | |
| CN105306110B (en) | A kind of method and system realized synchronous music and played | |
| US10354660B2 (en) | Audio frame labeling to achieve unequal error protection for audio frames of unequal importance | |
| US20150036679A1 (en) | Methods and apparatuses for transmitting and receiving audio signals | |
| CN110085241A (en) | Data-encoding scheme, device, computer storage medium and data encoding apparatus | |
| CN109887514A (en) | Audio frequency transmission method and device | |
| US8594075B2 (en) | Method and system for wireless VoIP communications | |
| CN108446092B (en) | Audio output method, audio output device, audio output apparatus, and storage medium | |
| Cohen | Packet communication of online speech | |
| CN101226744B (en) | Method and device for implementing voice decode in voice decoder | |
| CN103325385B (en) | Voice communication method and equipment, the method and apparatus of operation wobble buffer | |
| US20080266382A1 (en) | Indexing a data stream | |
| CN109413492B (en) | Audio data reverberation processing method and system in live broadcast process | |
| CN112769524B (en) | Voice transmission method, device, computer equipment and storage medium | |
| CN110808054B (en) | Multi-channel audio compression and decompression method and system | |
| CN114079535B (en) | Transcoding method, device, medium and electronic equipment | |
| CN101233560B (en) | Method and device for restoring audio signal | |
| CN105516524A (en) | Network voice synchronous de-noising communication method | |
| Dorogov et al. | Overview of Technologies for Transmitting Audio Streams over Low-Speed and Unstable Communication Channels | |
| Isenburg | Transmission of multimedia data over lossy networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |