CN112786062A - Bandwidth adaptive network audio transmission method, device, medium and system - Google Patents
Bandwidth adaptive network audio transmission method, device, medium and system Download PDFInfo
- Publication number
- CN112786062A CN112786062A CN202110059382.5A CN202110059382A CN112786062A CN 112786062 A CN112786062 A CN 112786062A CN 202110059382 A CN202110059382 A CN 202110059382A CN 112786062 A CN112786062 A CN 112786062A
- Authority
- CN
- China
- Prior art keywords
- audio
- sampling rate
- bandwidth
- audio data
- network
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 101
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000003044 adaptive effect Effects 0.000 title claims description 67
- 238000005070 sampling Methods 0.000 claims abstract description 271
- 238000013139 quantization Methods 0.000 claims description 17
- 230000000694 effects Effects 0.000 abstract description 8
- 230000005236 sound signal Effects 0.000 description 39
- 238000010586 diagram Methods 0.000 description 12
- 238000006243 chemical reaction Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000011084 recovery Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/032—Quantisation or dequantisation of spectral components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0882—Utilisation of link capacity
Abstract
The invention discloses a method, a device, a medium and a system for transmitting audio frequency of a bandwidth self-adaptive network, wherein the method comprises the following steps: when an audio sending end receives original audio data, acquiring an original sampling rate, bandwidth information and the number of audio channels; determining a target sampling rate according to the bandwidth information and the number of audio channels; generating variable sampling rate audio data according to the target sampling rate and the original audio data; and generating an audio data packet according to the variable sampling rate audio data and the original sampling rate and sending the audio data packet to an audio receiving end. The audio receiving end obtains variable sampling rate audio data and an original sampling rate according to the received audio data packet sent by the audio sending end; and generating and outputting the target audio data according to the original sampling rate and the variable sampling rate audio data. The problem of low network audio transmission quality is solved, the sampling rate of audio data is dynamically adjusted according to the network bandwidth, the effect of transmitting high-quality audio data by using the limited bandwidth is realized, and the transmission quality of the network audio is improved.
Description
Technical Field
The present invention relates to the field of computer communications technologies, and in particular, to a method, a device, a medium, and a system for bandwidth adaptive network audio transmission.
Background
In the process of network audio transmission, the sampling rate of the network audio is fixed, high-quality audio can be transmitted when the network bandwidth is guaranteed, and when packet loss occurs due to limited network bandwidth, a receiving end detects the packet loss and then performs interpolation recovery on the packet loss data or informs the sending end of retransmission. However, both of these methods require data buffering at the receiving end, which increases the delay of the whole network audio transmission system. In addition, the interpolation data can cause audio distortion and slightly high processing complexity, and the network delay of the method for notifying the retransmission of the sending end is larger than the system delay of the interpolation method, so that the network audio transmission quality is lower.
Disclosure of Invention
Embodiments of the present invention provide a method, an apparatus, a medium, and a system for transmitting a bandwidth-adaptive network audio, and aim to solve the technical problem of low network audio transmission quality in the prior art.
In order to achieve the above object, an embodiment of the present invention provides a bandwidth adaptive network audio transmission method, which is applied to an audio transmitting end, and the bandwidth adaptive network audio transmission method includes the following steps:
when original audio data are received, acquiring an original sampling rate, bandwidth information and the number of audio channels, wherein the original audio data are audio data sampled according to the original sampling rate;
determining a target sampling rate according to the bandwidth information and the number of audio channels;
generating variable sampling rate audio data according to the target sampling rate and the original audio data;
and generating an audio data packet according to the variable sampling rate audio data and the original sampling rate, and sending the audio data packet to an audio receiving end.
Optionally, the step of determining a target sampling rate according to the bandwidth information and the number of audio channels includes:
acquiring available network bandwidth of an audio transmitting end;
acquiring the number of audio channels and presetting sampling quantization precision;
and determining a target sampling rate according to the number of the audio channels, preset sampling quantization precision and the available network bandwidth.
Optionally, the step of acquiring an available network bandwidth of the audio transmitting end includes:
acquiring the total bandwidth of a network and the bandwidth occupied by network data except original audio data;
and determining the available network bandwidth according to the total network bandwidth, the bandwidth occupied by the network data except the original audio data and the number of audio channels.
Optionally, the step of obtaining the available network bandwidth of the audio sending end further includes:
when the available network bandwidth of the audio sending end is smaller than the preset network bandwidth, outputting warning prompt information of insufficient bandwidth;
and when the available network bandwidth is greater than or equal to a preset network bandwidth, executing the steps of obtaining the number of audio channels and presetting sampling quantization precision.
In order to achieve the above object, the present invention further provides a bandwidth adaptive network audio transmission method, which is applied to an audio receiving end, and the bandwidth adaptive network audio transmission method includes:
receiving an audio data packet sent by an audio sending end;
acquiring variable sampling rate audio data and an original sampling rate according to the audio data packet;
generating target audio data according to the original sampling rate and the variable sampling rate audio data;
and outputting the target audio data.
Optionally, the step of generating target audio data from the original sample rate and the variable sample rate audio data comprises:
and sampling the variable sampling rate audio data according to the original sampling rate to obtain target audio data.
Optionally, the step of obtaining variable sample rate audio data and a raw sample rate from the audio data packet comprises:
acquiring variable sampling rate audio data in the audio data packet;
when the audio data packet contains an original sampling rate, executing the step of generating target audio data according to the original sampling rate and the variable sampling rate audio data;
and when the audio data packet does not contain the original sampling rate, generating target audio data according to a preset sampling rate and the variable sampling rate audio data.
To achieve the above object, the present invention further provides a bandwidth adaptive network audio transmission device, which includes a memory, a processor, and a bandwidth adaptive network audio transmission program stored in the memory and operable on the processor, wherein the bandwidth adaptive network audio transmission program, when executed by the processor, implements the bandwidth adaptive network audio transmission method as described above.
To achieve the above object, the present invention also provides a computer-readable storage medium storing a bandwidth adaptive network audio transmission program which, when executed by a processor, implements the bandwidth adaptive network audio transmission method as described above.
To achieve the above object, the present invention further provides a bandwidth adaptive network audio transmission system, including: the audio transmitting end comprises a memory, a processor and a bandwidth self-adaptive network audio transmission program which is stored in the memory and can run on the processor, wherein when the bandwidth self-adaptive network audio transmission program is executed by the processor, the bandwidth self-adaptive network audio transmission method is realized; an audio sink comprising a memory, a processor, and a bandwidth adaptive network audio transmission program stored in the memory and executable on the processor, the bandwidth adaptive network audio transmission program when executed by the processor implementing the bandwidth adaptive network audio transmission method as described above.
The invention provides a method, a device, a medium and a system for transmitting audio frequency of a bandwidth self-adaptive network, wherein when an audio sending end in the system receives audio frequency data sent by an audio input end, a preset original sampling rate is obtained to sample the audio frequency data to obtain original audio frequency data, namely a fixed high sampling rate audio frequency signal, available bandwidth and audio frequency channel number are obtained, a target sampling rate is determined according to the available bandwidth and the audio frequency channel number, the target sampling rate is adjusted in real time, the original audio frequency data can be sampled at the highest sampling rate corresponding to the available bandwidth to obtain audio frequency data with a variable sampling rate when the network bandwidth is surplus or limited, and the audio frequency data with the variable sampling rate and the original sampling rate are generated into audio frequency data packets to be transmitted to an audio receiving end. And when the audio receiving end receives the audio data packet, acquiring variable sampling rate audio data and an original sampling rate, and sampling the variable sampling rate audio data according to the original sampling rate to obtain target audio data, namely the fixed high sampling rate audio signal. Therefore, the audio signal with the variable sampling rate is adopted, and the audio signal is transmitted at a high sampling rate when the network audio bandwidth is ensured so as to ensure the quality of the transmitted audio signal. Audio signals are transmitted at a lower sampling rate when network audio bandwidth is limited to reduce bandwidth occupation. The method and the device realize the effect of dynamically adjusting the sampling rate of the audio data according to the network bandwidth and transmitting the high-quality low-delay audio data by using the limited bandwidth, and improve the network audio transmission quality.
Drawings
FIG. 1 is a schematic diagram of an apparatus architecture of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a bandwidth adaptive network audio transmission system according to the present invention;
FIG. 3 is a flowchart illustrating a first embodiment of a bandwidth adaptive network audio transmission method according to the present invention;
FIG. 4 is a flowchart illustrating a second embodiment of a bandwidth adaptive network audio transmission method according to the present invention;
fig. 5 is a flowchart illustrating a third embodiment of a bandwidth adaptive network audio transmission method according to the present invention.
Detailed Description
In the transmission process of network audio data, a network audio sending end and a network audio receiving end generally adopt a fixed network audio sampling rate, when the network bandwidth is surplus, high-quality audio data can be transmitted, however, when the network bandwidth is small, packet loss of the network audio data can be caused, a common solution is that when the packet loss is detected, interpolation recovery is performed on the packet loss data or the audio sending end is informed to retransmit the network audio, however, in these methods, data caching is required at the network audio receiving end, the demonstration of the whole network audio transmission system can be increased, and interpolation recovery of the audio data can also cause audio data distortion and slightly high processing complexity, so that the transmission efficiency of the bandwidth adaptive network audio transmission system can be low. In order to solve the above problems, the present invention provides a bandwidth adaptive network audio transmission method, which comprises the following steps: when original audio data are received, acquiring an original sampling rate, bandwidth information and the number of audio channels, wherein the original audio data are audio data sampled according to the original sampling rate; determining a target sampling rate according to the bandwidth information and the number of audio channels; generating variable sampling rate audio data according to the target sampling rate and the original audio data; and generating an audio data packet according to the variable sampling rate audio data and the original sampling rate, and sending the audio data packet to an audio receiving end. The method and the device realize the effect of dynamically adjusting the sampling rate of the audio data according to the network bandwidth and transmitting the high-quality low-delay audio data by using the limited bandwidth, and improve the network audio transmission quality.
For a better understanding of the above technical solutions, exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As one implementation, the bandwidth adaptive network audio transmission device may be as shown in fig. 1.
The embodiment scheme of the invention relates to a bandwidth self-adaptive network audio transmission device, which comprises: a processor 101, e.g. a CPU, a memory 102, a communication bus 103. Wherein a communication bus 103 is used for enabling the connection communication between these components.
The memory 102 may be a high-speed RAM memory or a non-volatile memory (e.g., a disk memory). As shown in fig. 1, a memory 102, which is a type of computer storage medium, may include a bandwidth adaptive network audio transmission program therein; and the processor 101 may be configured to invoke the bandwidth adaptive network audio transmission program stored in the memory 102 and perform the following operations:
when original audio data are received, acquiring an original sampling rate, bandwidth information and the number of audio channels, wherein the original audio data are audio data sampled according to the original sampling rate;
determining a target sampling rate according to the bandwidth information and the number of audio channels;
generating variable sampling rate audio data according to the target sampling rate and the original audio data;
and generating an audio data packet according to the variable sampling rate audio data and the original sampling rate, and sending the audio data packet to an audio receiving end.
Further, the processor 101 may be configured to invoke the bandwidth adaptive network audio transmission program stored in the memory 102 and perform the following operations:
acquiring available network bandwidth of an audio transmitting end;
acquiring the number of audio channels and presetting sampling quantization precision;
and determining a target sampling rate according to the number of the audio channels, preset sampling quantization precision and the available network bandwidth.
Further, the processor 101 may be configured to invoke the bandwidth adaptive network audio transmission program stored in the memory 102 and perform the following operations:
acquiring the total bandwidth of a network and the bandwidth occupied by network data except original audio data;
and determining the available network bandwidth according to the total network bandwidth, the bandwidth occupied by the network data except the original audio data and the number of audio channels.
Further, the processor 101 may be configured to invoke the bandwidth adaptive network audio transmission program stored in the memory 102 and perform the following operations:
when the available network bandwidth of the audio sending end is smaller than the preset network bandwidth, outputting warning prompt information of insufficient bandwidth;
and when the available network bandwidth is greater than or equal to a preset network bandwidth, executing the steps of obtaining the number of audio channels and presetting sampling quantization precision.
Further, the processor 101 may be configured to invoke the bandwidth adaptive network audio transmission program stored in the memory 102 and perform the following operations:
receiving an audio data packet sent by an audio sending end;
acquiring variable sampling rate audio data and an original sampling rate according to the audio data packet;
generating target audio data according to the original sampling rate and the variable sampling rate audio data;
and outputting the target audio data.
Further, the processor 101 may be configured to invoke the bandwidth adaptive network audio transmission program stored in the memory 102 and perform the following operations:
and sampling the variable sampling rate audio data according to the original sampling rate to obtain target audio data.
Further, the processor 101 may be configured to invoke the bandwidth adaptive network audio transmission program stored in the memory 102 and perform the following operations:
acquiring variable sampling rate audio data in the audio data packet;
when the audio data packet contains an original sampling rate, executing the step of generating target audio data according to the original sampling rate and the variable sampling rate audio data;
and when the audio data packet does not contain the original sampling rate, generating target audio data according to a preset sampling rate and the variable sampling rate audio data.
According to the scheme, when an audio sending end in the bandwidth adaptive network audio transmission system receives audio data sent by an audio input end, a preset original sampling rate is obtained to sample the audio data to obtain original audio data, namely, fixed high sampling rate audio signals, available bandwidth and the number of audio channels are obtained, a target sampling rate is determined according to the available bandwidth and the number of the audio channels, the target sampling rate is adjusted in real time, it is guaranteed that the original audio data can be sampled at the highest sampling rate corresponding to the available bandwidth to obtain variable sampling rate audio data when the network bandwidth is surplus or limited, and audio data packets are generated by the variable sampling rate audio data and the original sampling rate and are transmitted to an audio receiving end. And when the audio receiving end receives the audio data packet, acquiring variable sampling rate audio data and an original sampling rate, and sampling the variable sampling rate audio data according to the original sampling rate to obtain target audio data, namely the fixed high sampling rate audio signal. Therefore, the audio signal with the variable sampling rate is adopted, and the audio signal is transmitted at a high sampling rate when the network audio bandwidth is ensured so as to ensure the quality of the transmitted audio signal. Audio signals are transmitted at a low sampling rate when network audio bandwidth is limited to reduce bandwidth occupation. The method and the device realize the effect of dynamically adjusting the sampling rate of the audio data according to the network bandwidth and transmitting the high-quality low-delay audio data by using the limited bandwidth, and improve the network audio transmission quality.
Referring to fig. 2, fig. 2 is a schematic diagram of a bandwidth adaptive network audio transmission system according to the present invention.
In this embodiment, the bandwidth adaptive network audio transmission system is a network audio transmission system, and the network audio transmission system includes a network audio transmitting end and a network audio receiving end. The network audio transmitting end comprises an original audio receiving module, a sampling rate conversion module, a network audio transmitting module, other network data transmitting and receiving modules, a configuration module and a network transmission module. The original audio receiving module receives a fixed high sampling rate digital audio signal, i.e., original audio data, from an audio input according to an original sampling rate. The other network data sending and receiving modules and the network audio sending module share the same Ethernet interface, and share a transmitting channel and a receiving channel through the network transmission module. The configuration module can identify the bandwidth information occupied by the other network data sending and receiving modules, calculate the network bandwidth of the network audio sending module according to the total network transmission bandwidth and the bandwidth occupied by the other network data sending and receiving modules, acquire the number of the sent audio channels, calculate the highest sampling rate of the transmittable audio, namely the target sampling rate according to the number of the audio channels and the network bandwidth of the network audio sending module, and configure the target sampling rate to the sampling rate conversion module, wherein the target sampling rate is smaller than the original sampling rate of the original audio data. And the sampling rate conversion module samples the original audio data according to the configured target sampling rate to obtain variable sampling rate audio data, and generates audio data packets by the variable sampling rate audio data and the original sampling rate and sends the audio data packets through the network audio sending module.
The network receiving end comprises an original audio transmitting module, a sampling rate conversion module, a network audio receiving module, other network data transmitting and receiving modules, a configuration module and a network transmission module. The network transmission module receives an audio data packet sent by a network audio sending end, other network audio communication data and network data from other equipment. The network transmission module extracts a network audio data packet from a network audio transmitting end and transmits the network audio data packet to the network audio receiving module. The network audio receiving module unpacks the received audio data packet, sends the variable sampling rate audio data in the audio data packet to the sampling rate conversion module, and sends the original sampling rate in the audio data packet to the configuration module. The configuration module configures the sample rate conversion module according to the received original sample rate. The sampling rate conversion module samples the variable sampling rate audio data according to the configured original sampling rate to obtain target audio data, namely high sampling rate audio signals, and sends the target audio data to the original audio sending module, and the original audio sending module outputs the target audio data, namely the high sampling rate digital audio signals through an audio output end.
According to the technical scheme provided by the embodiment, when an audio sending end in the bandwidth adaptive network audio transmission system receives audio data sent by an audio input end, a preset original sampling rate is obtained to sample the audio data to obtain original audio data, namely, fixed high sampling rate audio signals, available bandwidth and the number of audio channels are obtained, a target sampling rate is determined according to the available bandwidth and the number of the audio channels, the target sampling rate is adjusted in real time, it is guaranteed that the original audio data can be sampled at the highest sampling rate corresponding to the available bandwidth to obtain variable sampling rate audio data when the network bandwidth is surplus or limited, and audio data packets are generated by the variable sampling rate audio data and the original sampling rate and are transmitted to an audio receiving end. And when the audio receiving end receives the audio data packet, acquiring variable sampling rate audio data and an original sampling rate, and sampling the variable sampling rate audio data according to the original sampling rate to obtain target audio data, namely the fixed high sampling rate audio signal. Therefore, the audio signal with the variable sampling rate is adopted, and the audio signal is transmitted at a high sampling rate when the network audio bandwidth is ensured so as to ensure the quality of the transmitted audio signal. Audio signals are transmitted at a low sampling rate when network audio bandwidth is limited to reduce bandwidth occupation. The method and the device realize the effect of dynamically adjusting the sampling rate of the audio data according to the network bandwidth and transmitting the high-quality low-delay audio data by using the limited bandwidth, and improve the network audio transmission quality.
Based on the hardware architecture of the bandwidth adaptive network audio transmission device, the embodiment of the bandwidth adaptive network audio transmission method is provided.
Referring to fig. 3, fig. 3 is a diagram of a bandwidth adaptive network audio transmission method according to a first embodiment of the present invention, applied to an audio transmitting end, where the bandwidth adaptive network audio transmission method includes the following steps:
step S10, when receiving original audio data, acquiring an original sampling rate, bandwidth information and the number of audio channels, wherein the original audio data is audio data sampled according to the original sampling rate;
in the transmission process of network audio data, a network audio sending end and a network audio receiving end generally adopt a fixed network audio sampling rate, when network bandwidth is surplus, high-quality audio data can be transmitted, however, when the network bandwidth is small, packet loss of the network audio data can be caused, a common solution is that when the packet loss is detected, interpolation recovery is performed on the packet loss data or the audio sending end is informed to retransmit the network audio, however, in these methods, data caching is required at the network audio receiving end, the demonstration of the whole network audio transmission system can be increased, and interpolation recovery of the audio data can also cause audio data distortion and slightly high processing complexity, so that the transmission efficiency of the network audio transmission system can be low. In this embodiment, when an audio transmitting end of a network audio transmission system receives audio data sent by an audio input end, an original sampling rate is obtained, the audio data is sampled according to the original sampling rate to obtain original audio data, the original sampling rate is a high sampling rate that is preset and stored at the audio transmitting end, and the original audio data is a high sampling rate audio signal. And when the original audio data is received, acquiring bandwidth information and the number of audio channels of a network configuration module in an audio sending end, wherein the bandwidth information comprises the total bandwidth of a network and the bandwidth occupied by other network data except the original audio data, and the number of the audio channels is preset in a bandwidth self-adaptive network audio transmission system.
Step S20, determining a target sampling rate according to the bandwidth information and the number of audio channels;
the available network bandwidth of the current network can be determined according to the total bandwidth of the network and the bandwidth occupied by other network data except the original audio data, and the target sampling rate can be determined according to the available network bandwidth and the number of audio channels, wherein the target sampling rate is the highest sampling rate which can be loaded by the current available network bandwidth, and is less than or equal to the original sampling rate. When the available network bandwidth changes, the target sampling rate is updated and adjusted in real time so as to ensure that the target sampling rate is large enough to ensure the audio transmission quality of the whole system when the available network bandwidth is small.
Step S30, generating variable sampling rate audio data according to the target sampling rate and the original audio data;
optionally, after determining the target sampling rate, sampling the original audio data according to the target sampling rate to obtain variable sampling rate audio data, it is understood that the variable sampling rate audio data may be adjusted in real time according to the adjustment of the target sampling rate, and when the network bandwidth is limited, the transmission quality of the variable sampling rate audio data is reduced, so as to ensure that the variable sampling rate audio data may be transmitted when the network bandwidth is limited, and retransmission due to packet loss is avoided.
And step S40, generating an audio data packet according to the variable sampling rate audio data and the original sampling rate, and sending the audio data packet to an audio receiving end.
And the audio sending end packs the generated variable sampling rate audio data and the original audio sampling rate into an audio data packet and sends the audio data packet to the audio receiving end.
In the technical solution provided in this embodiment, according to the above scheme, when an audio sending end in a bandwidth adaptive network audio transmission system receives audio data sent by an audio input end, an audio sending end in the bandwidth adaptive network audio transmission system obtains a preset original sampling rate to sample the audio data to obtain original audio data, that is, a fixed high sampling rate audio signal, obtains an available bandwidth and an audio channel number, determines a target sampling rate according to the available bandwidth and the audio channel number, and adjusts the target sampling rate in real time to ensure that the original audio data can be sampled at a highest sampling rate corresponding to the available bandwidth to obtain variable sampling rate audio data when the network bandwidth is surplus or limited, and generates an audio data packet with the variable sampling rate audio data and the original sampling rate and transmits the audio data packet to an audio receiving end. The audio signal with variable sampling rate is adopted, the audio signal is transmitted according to high sampling rate when the network audio bandwidth is guaranteed so as to guarantee the quality of the transmitted audio signal, and the audio signal is transmitted according to low sampling rate when the network audio bandwidth is limited so as to reduce the bandwidth occupation. The method and the device realize the effect of dynamically adjusting the sampling rate of the audio data according to the network bandwidth and transmitting the high-quality low-delay audio data by using the limited bandwidth, and improve the network audio transmission quality.
Referring to fig. 4, fig. 4 is a second embodiment of the audio transmission method for bandwidth adaptive network according to the present invention, and based on the first embodiment, the step S20 includes:
step S21, acquiring available network bandwidth of the audio transmitting end;
optionally, the audio sending end obtains the total network bandwidth of the bandwidth adaptive network audio transmission system and the bandwidth occupied by the network data except the original audio data;
and determining the available network bandwidth according to the total network bandwidth, the bandwidth occupied by the network data except the original audio data and the number of audio channels. Specifically, the available network bandwidth is the total bandwidth of the network — the bandwidth occupied by the network data except the original audio data.
Further, when the available network bandwidth is smaller than the preset network bandwidth, outputting warning prompt information of bandwidth insufficiency;
it should be noted that, when the available network bandwidth is too small, the target sampling rate is too low, which results in the poor quality of the variable audio data and may become useless audio data, therefore, after determining the available network bandwidth, it is determined whether the available network bandwidth is smaller than the preset network bandwidth, and when the available network bandwidth is smaller than the preset network bandwidth, a warning prompt message indicating that the bandwidth is insufficient is output, so that the user can timely know the network audio transmission condition to timely adjust the sampling rate or suspend transmission. The prompt message can be in at least one form of audio and video or words or an alarm lamp.
And when the available network bandwidth is greater than or equal to a preset network bandwidth, executing the steps of obtaining the number of audio channels and presetting sampling quantization precision.
Step S22, acquiring the number of audio channels and presetting sampling quantization precision;
the preset sampling quantization precision is the bandwidth occupied by the unit sampling rate preset in the bandwidth self-adaptive network audio transmission system by the user.
And step S23, determining a target sampling rate according to the number of the audio channels, preset sampling quantization precision and the available network bandwidth.
Specifically, a target sampling rate is obtained by calculation according to the number of audio channels, a preset sampling quantization precision and an available network bandwidth, and a calculation formula of the target sampling rate is as follows: the target sampling rate (total bandwidth of the network-bandwidth occupied by network data except the original audio data)/the number of audio channels multiplied by the preset quantization precision.
Optionally, acquiring the available network bandwidth and a preset mapping relation between an audio channel and a sampling rate;
and inquiring a target sampling rate according to the available network bandwidth, the number of audio channels and the preset mapping relation. Presetting a mapping relation table between available network bandwidth and audio channels and sampling rate, when receiving original audio data, obtaining the current available network bandwidth and the number of audio channels, and taking the sampling rate as a target sampling rate according to the sampling rate corresponding to the available network bandwidth and the number of audio channels in the mapping relation table.
In the technical scheme provided by this embodiment, the audio sending end determines an available network bandwidth according to a total network bandwidth and a bandwidth occupied by network data other than original audio data, obtains the number of audio channels and a preset sampling quantization precision, determines a target sampling rate according to the number of audio channels, the preset sampling quantization precision and the available network bandwidth, and samples a far-view audio signal according to the target sampling rate to obtain a variable sampling rate audio signal. Therefore, the audio signal with the variable sampling rate is adopted, and the audio signal is transmitted at a high sampling rate when the network audio bandwidth is ensured so as to ensure the quality of the transmitted audio signal. Audio signals are transmitted at a low sampling rate when network audio bandwidth is limited to reduce bandwidth occupation. The method and the device realize the effect of dynamically adjusting the sampling rate of the audio data according to the network bandwidth and transmitting the high-quality low-delay audio data by using the limited bandwidth, and improve the network audio transmission quality.
Referring to fig. 5, fig. 5 is a third embodiment of the bandwidth adaptive network audio transmission method of the present invention, applied to an audio receiving end, and based on the first or second embodiment, the bandwidth adaptive network audio transmission method further includes:
step S50, receiving an audio data packet sent by an audio sending end;
step S60, obtaining variable sampling rate audio data and original sampling rate according to the audio data packet;
when an audio receiving end receives an audio data packet sent by an audio sending end, obtaining variable sampling rate audio data with the audio data weight and an original sampling rate, and sampling the variable sampling rate audio data according to the original sampling rate to obtain target audio data, wherein the target audio data is high-sampling-rate data. Therefore, when the audio receiving end outputs the audio data, the variable sampling rate audio data is collected through the sampling rate converter according to the high sampling rate so as to improve the quality of the audio signal.
Step S70, generating target audio data according to the original sampling rate and the variable sampling rate audio data;
the target audio data is a fixed high sample rate audio signal.
And step S80, outputting the target audio data.
Optionally, the step S70 includes: acquiring variable sampling rate audio data in the audio data packet;
when the audio data packet contains an original sampling rate, executing the step of generating target audio data according to the original sampling rate and the variable sampling rate audio data;
and when the audio data packet does not contain the original sampling rate, generating target audio data according to a preset sampling rate and the variable sampling rate audio data.
In the technical solution provided in this embodiment, when receiving the audio data packet, an audio receiving end obtains variable sampling rate audio data and an original sampling rate, and samples the variable sampling rate audio data according to the original sampling rate to obtain target audio data, that is, a fixed high sampling rate audio signal. Therefore, the audio signal with the variable sampling rate is adopted, and the audio signal is transmitted at a high sampling rate when the network audio bandwidth is ensured so as to ensure the quality of the transmitted audio signal. Audio signals are transmitted at a low sampling rate when network audio bandwidth is limited to reduce bandwidth occupation. The method and the device realize the effect of dynamically adjusting the sampling rate of the audio data according to the network bandwidth and transmitting the high-quality low-delay audio data by using the limited bandwidth, and improve the audio bandwidth self-adaptive network audio transmission quality.
To achieve the above object, the present invention also provides a computer-readable storage medium storing a bandwidth adaptive network audio transmission program which, when executed by a processor, implements the bandwidth adaptive network audio transmission method as described above.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A bandwidth adaptive network audio transmission method is applied to an audio transmitting end, and comprises the following steps:
when original audio data are received, acquiring an original sampling rate, bandwidth information and the number of audio channels, wherein the original audio data are audio data sampled according to the original sampling rate;
determining a target sampling rate according to the bandwidth information and the number of audio channels;
generating variable sampling rate audio data according to the target sampling rate and the original audio data;
and generating an audio data packet according to the variable sampling rate audio data and the original sampling rate, and sending the audio data packet to an audio receiving end.
2. The method for audio transmission over a bandwidth adaptive network of claim 1, wherein the step of determining a target sampling rate based on the bandwidth information and the number of audio channels comprises:
acquiring available network bandwidth of an audio transmitting end;
acquiring the number of audio channels and presetting sampling quantization precision;
and determining a target sampling rate according to the number of the audio channels, preset sampling quantization precision and the available network bandwidth.
3. The method for transmitting audio over a bandwidth adaptive network according to claim 2, wherein the step of obtaining the available network bandwidth of the audio sender comprises:
acquiring the total bandwidth of a network and the bandwidth occupied by network data except original audio data;
and determining the available network bandwidth according to the total network bandwidth, the bandwidth occupied by the network data except the original audio data and the number of audio channels.
4. The method for transmitting audio over a bandwidth adaptive network of claim 2, wherein the step of obtaining the available network bandwidth at the audio sender is followed by the step of:
when the available network bandwidth of the audio sending end is smaller than the preset network bandwidth, outputting warning prompt information of insufficient bandwidth;
and when the available network bandwidth is greater than or equal to a preset network bandwidth, executing the steps of obtaining the number of audio channels and presetting sampling quantization precision.
5. A bandwidth adaptive network audio transmission method is applied to an audio receiving end, and comprises the following steps:
receiving an audio data packet sent by an audio sending end;
acquiring variable sampling rate audio data and an original sampling rate according to the audio data packet;
generating target audio data according to the original sampling rate and the variable sampling rate audio data;
and outputting the target audio data.
6. The bandwidth adaptive network audio transmission method of claim 5, wherein the step of generating target audio data from the original sample rate and the variable sample rate audio data comprises:
acquiring variable sampling rate audio data in the audio data packet;
when the audio data packet contains an original sampling rate, executing the step of generating target audio data according to the original sampling rate and the variable sampling rate audio data;
and when the audio data packet does not contain the original sampling rate, generating target audio data according to a preset sampling rate and the variable sampling rate audio data.
7. The bandwidth adaptive network audio transmission method of claim 5, wherein the step of generating target audio data from the original sample rate and the variable sample rate audio data comprises:
and sampling the variable sampling rate audio data according to the original sampling rate to obtain target audio data.
8. A bandwidth adaptive network audio transmission device, characterized in that the device comprises a memory, a processor and a bandwidth adaptive network audio transmission program stored in the memory and executable on the processor, which when executed by the processor implements the bandwidth adaptive network audio transmission method according to any one of claims 1 to 7.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a bandwidth adaptive network audio transmission program which, when executed by a processor, implements the bandwidth adaptive network audio transmission method according to any one of claims 1 to 7.
10. A bandwidth adaptive network audio transmission system, comprising:
an audio transmitting end, comprising a memory, a processor and a bandwidth adaptive network audio transmission program stored in the memory and operable on the processor, the bandwidth adaptive network audio transmission program, when executed by the processor, implementing the bandwidth adaptive network audio transmission method according to any one of claims 1 to 4;
an audio sink comprising a memory, a processor, and a bandwidth adaptive network audio transport program stored in the memory and executable on the processor, the bandwidth adaptive network audio transport program when executed by the processor implementing the bandwidth adaptive network audio transport method of any one of claims 5-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110059382.5A CN112786062A (en) | 2021-01-15 | 2021-01-15 | Bandwidth adaptive network audio transmission method, device, medium and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110059382.5A CN112786062A (en) | 2021-01-15 | 2021-01-15 | Bandwidth adaptive network audio transmission method, device, medium and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112786062A true CN112786062A (en) | 2021-05-11 |
Family
ID=75756946
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110059382.5A Pending CN112786062A (en) | 2021-01-15 | 2021-01-15 | Bandwidth adaptive network audio transmission method, device, medium and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112786062A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113555024A (en) * | 2021-07-30 | 2021-10-26 | 北京达佳互联信息技术有限公司 | Real-time communication audio processing method and device, electronic equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010005173A1 (en) * | 1998-12-30 | 2001-06-28 | At&T Corporation | Method and apparatus for sample rate pre-and post-processing to achieve maximal coding gain for transform-based audio encoding and decoding |
| CN102694584A (en) * | 2011-03-21 | 2012-09-26 | 冯汉英 | System for audio transmission via wireless network |
| CN102833000A (en) * | 2012-08-14 | 2012-12-19 | 电信科学技术研究院 | Method and equipment for data transmission |
| CN104049119A (en) * | 2014-06-18 | 2014-09-17 | 南京信息职业技术学院 | Method and device for signal collection of dual channels with self-adaptive sampling rates |
| CN105187167A (en) * | 2015-09-28 | 2015-12-23 | 广州市百果园网络科技有限公司 | Voice data communication method and device |
| CN107343105A (en) * | 2017-07-21 | 2017-11-10 | 维沃移动通信有限公司 | The processing method and mobile terminal of a kind of voice data |
-
2021
- 2021-01-15 CN CN202110059382.5A patent/CN112786062A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010005173A1 (en) * | 1998-12-30 | 2001-06-28 | At&T Corporation | Method and apparatus for sample rate pre-and post-processing to achieve maximal coding gain for transform-based audio encoding and decoding |
| CN102694584A (en) * | 2011-03-21 | 2012-09-26 | 冯汉英 | System for audio transmission via wireless network |
| CN102833000A (en) * | 2012-08-14 | 2012-12-19 | 电信科学技术研究院 | Method and equipment for data transmission |
| CN104049119A (en) * | 2014-06-18 | 2014-09-17 | 南京信息职业技术学院 | Method and device for signal collection of dual channels with self-adaptive sampling rates |
| CN105187167A (en) * | 2015-09-28 | 2015-12-23 | 广州市百果园网络科技有限公司 | Voice data communication method and device |
| CN107343105A (en) * | 2017-07-21 | 2017-11-10 | 维沃移动通信有限公司 | The processing method and mobile terminal of a kind of voice data |
Non-Patent Citations (1)
| Title |
|---|
| 魏零等: ""大学计算机应用基础教程"", "大学计算机应用基础教程", pages 252 - 256 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113555024A (en) * | 2021-07-30 | 2021-10-26 | 北京达佳互联信息技术有限公司 | Real-time communication audio processing method and device, electronic equipment and storage medium |
| CN113555024B (en) * | 2021-07-30 | 2024-02-27 | 北京达佳互联信息技术有限公司 | Real-time communication audio processing method, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11349900B2 (en) | Voice encoding and sending method and apparatus | |
| EP2137883B1 (en) | Method of transmitting data in a communication system | |
| US9137530B2 (en) | Video communication method and system for dynamically modifying video encoding | |
| US11146611B2 (en) | Lip synchronization of audio and video signals for broadcast transmission | |
| US10080231B2 (en) | Channel bandwidth optimization for dynamic network conditions | |
| US10715617B2 (en) | Stream reservation class converter | |
| CN114363667B (en) | Client, server, receiving method and transmitting method | |
| KR101570660B1 (en) | Adjusting physical layer transmission properties | |
| CN105142002A (en) | Audio/video live broadcasting method and device as well as control method and device | |
| CN109495660B (en) | Audio data coding method, device, equipment and storage medium | |
| JP2009253981A (en) | Managing method of tti bundling transmission, and communicating equipment | |
| WO2012161652A1 (en) | Methods for transmitting and receiving a digital signal, transmitter and receiver | |
| CN112786062A (en) | Bandwidth adaptive network audio transmission method, device, medium and system | |
| KR20070026109A (en) | System for transmitting and receiving data, transmitting apparatus, receiving apparatus, and method for transmitting and receiving data | |
| CN113573062B (en) | Traffic shaping method and device and electronic equipment | |
| KR102001014B1 (en) | Network apparatus, transmitter and packet transmitting method for next-generation terrestrial broadcasting service | |
| CN110545556B (en) | MAC CE, information sending method, information receiving method and communication equipment | |
| KR101871879B1 (en) | Method and device for adjusting data transmission rate | |
| CN113891393A (en) | Link self-adaptive transmission method, device, equipment and storage medium | |
| JP2016219928A (en) | Communication system | |
| JP4991661B2 (en) | Video data converter | |
| KR20160072394A (en) | Can frame transform method and can frame transform device | |
| CN114726803B (en) | Method, communication device, apparatus and storage medium for measuring and feeding back delay information | |
| US20230389011A1 (en) | Management of uplink transmission of user data | |
| JP7284266B2 (en) | Audio stream switching method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |