WO2022160608A1

WO2022160608A1 - Low-delay audio distribution method, module and apparatus based on network card

Info

Publication number: WO2022160608A1
Application number: PCT/CN2021/104539
Authority: WO
Inventors: 赵定金
Original assignee: 广州市保伦电子有限公司
Priority date: 2021-01-26
Filing date: 2021-07-05
Publication date: 2022-08-04
Also published as: CN112929114B; CN112929114A

Abstract

Disclosed are a low-delay audio distribution method, module and apparatus based on a network card. The method comprises the following steps: S1: acquiring an audio distribution instruction sent by a master control module, and requesting audio data from the master control module; S2: acquiring audio data sent by the master control module, and storing the audio data in a cache memory; S3: acquiring timing information of a timer, and periodically sending the audio data to a target device; and S4: determining whether a cache amount in the cache memory is lower than a preset value, if so, executing S1, and if not, executing S3. In the present invention, by means of the precise timing of a timer, the apparatus can accurately send audio data to a target device in real time, such that a stable playing effect is brought about to system audio distribution.

Description

A network card-based low-latency audio distribution method, module and device

technical field

The present invention relates to the technical field of audio data distribution, in particular to a network card-based low-latency audio distribution method, module and device.

Background technique

With the development of the broadcasting industry, the area and scale of broadcasting management are also getting larger and larger. Many broadcasting projects have begun to use network digital audio broadcasting instead of traditional analog audio broadcasting. At the same time, the scale of broadcasting equipment can reach as many as one hundred. . However, due to the limitation of computer performance in general network broadcasting equipment, the number of audio distribution channels cannot meet the requirements, and it is difficult to ensure the real-time performance of audio distribution, resulting in intermittent audio during the playback process, even affecting the entire broadcast. system stability.

SUMMARY OF THE INVENTION

In order to overcome the deficiencies of the prior art, one of the objects of the present invention is to provide a low-latency audio distribution method based on a network card, which can solve the problem that the real-time performance of audio distribution cannot be guaranteed, resulting in intermittent audio during playback. situation, and even affect the stability of the entire broadcasting system.

The second purpose of the present invention is to provide a low-latency audio distribution module based on a network card, which can solve the problem that the real-time performance of audio distribution cannot be guaranteed, resulting in intermittent audio during the playback process, and even affects the entire broadcast system. stability issues.

The third object of the present invention is to provide a low-latency audio distribution device based on a network card, which can solve the problem that the real-time performance of audio distribution cannot be guaranteed, resulting in intermittent audio during the playback process, and even affects the entire broadcast system. stability issues.

In order to achieve one of the above objects, the technical scheme adopted in the present invention is as follows:

A low-latency audio distribution method based on a network card, comprising the following steps:

S1: Obtain the distribution audio instruction sent by the main control module, and request audio data from the main control module;

S2: Obtain the audio data sent by the main control module and save it to the cache memory;

S3: Obtain the timing information of the timer, and regularly send audio data to the target device;

S4: Determine whether the buffer amount in the buffer memory is lower than the preset value, if yes, execute S1, and if not, execute S3.

Preferably, the following steps are also included before the S1:

S01: Obtain the audio channel opening instruction sent by the main control module through the broadcast network, so that the specified audio channel is in an open state;

S02: Obtain the target device instruction sent by the main control module, and configure the audio channel to perform data interaction with the target device.

Preferably, the following steps are also included between the S2 and S3:

S21: Obtain the forwarding instruction of the main control module;

S22: Acquire the audio data sent by the second device, and save it in the cache storage.

Preferably, the S3 is specifically implemented by the following steps:

The timing information of the corresponding timer is obtained according to the sampling rate of the audio data, and the audio data is sent to the target device regularly.

In order to achieve the second above-mentioned purpose, the technical scheme adopted in the present invention is as follows:

A low-latency audio distribution module based on a network card, comprising a storage and a processor;

a memory for storing program instructions;

The processor is configured to run the program instructions to execute the above-mentioned network card-based low-latency audio distribution method.

In order to achieve the third above-mentioned purpose, the technical scheme adopted in the present invention is as follows:

A low-latency audio distribution device based on a network card, comprising a main control module for an external computer and the above-mentioned low-latency audio distribution module based on the network card, the main control module and the low-latency audio distribution module based on the network card pass through Internet connection.

Preferably, it also includes an audio distributor for distributing audio data to the target device, an audio data transceiver and a timer for connecting to the main control module, the audio data transceiver and timer, and the audio distributor are all related to the The low-latency audio distribution module of the network card is connected.

Preferably, the timer is an audio clock crystal oscillator.

Preferably, a repeater for forwarding the audio data sent by the second device is also included, and the repeater is connected to the network card-based low-latency audio distribution module.

Preferably, a buffer storage for buffering audio data is also included, and the buffer storage is connected with the network card-based low-latency audio distribution module.

Compared with the prior art, the present invention has the beneficial effects that: through the timing information of the timer, the audio data can be distributed to the target device regularly, so that the distribution has high real-time and accuracy, and the broadcast can play the audio stably. At the same time, it is determined whether it is necessary to actively request audio data from the main control module by judging whether the buffer amount in the buffer memory is lower than the preset value, so as to avoid the discontinuous audio data caused by the lack of real-time performance of the main control module, resulting in audio Playback is stuck.

Description of drawings

Fig. 1 is the flow chart of the low-latency audio distribution method based on the network card described in the present invention.

FIG. 2 is a circuit diagram of the main control module described in the present invention.

FIG. 3 is a circuit diagram of the network card-based low-latency audio distribution module described in the present invention.

FIG. 4 is an enlarged schematic diagram of the area A in FIG. 3 .

FIG. 5 is an enlarged schematic diagram of region B in FIG. 3 .

FIG. 6 is a schematic structural diagram of the network card-based low-latency audio distribution apparatus described in the present invention.

FIG. 7 is a schematic diagram of a practical application of the network card-based low-latency audio distribution apparatus described in the present invention.

Detailed ways

The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, but not to limit the present invention.

In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. The indicated orientation or positional relationship is based on the orientation or positional relationship shown in the accompanying drawings, which is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the indicated device or element must have a specific orientation or a specific orientation. construction and operation, and therefore should not be construed as limiting the invention. Furthermore, the terms "first", "second", and "third" are used for descriptive purposes only and should not be construed to indicate or imply relative importance.

In the description of the present invention, it should be noted that the terms "installed", "connected" and "connected" should be understood in a broad sense, unless otherwise expressly specified and limited, for example, it may be a fixed connection or a detachable connection Connection, or integral connection; it can be mechanical connection or electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be internal communication between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood in specific situations.

Below, in conjunction with accompanying drawing and specific embodiment, the present invention is further described:

As shown in Figure 1-7, in the present invention, the main control module may be a single-chip microcomputer or other integrated circuit chips. In this embodiment, the main control module adopts a single-chip microcomputer whose model is ARM-LINUXRK 3399. The network card-based low-latency audio distribution module can be a gigabit network card with model REALTEK-RTL8211E-VB-CG or a network card with PCI/PCIE interface, which can distribute up to 128 independent audio channels and distribute audio to up to 200 playback devices , the timer is a high-precision audio clock crystal oscillator. As the clock source of the network card-based low-latency audio distribution module, it provides precise timing, so that the audio jitter and clock deviation of the system are very low, and the audio playback stability of the system is improved. , in this embodiment, the low-latency audio distribution module based on the network card uses the CDC-ECM mode in the USB protocol, and is provided to the main control module as a driver-free network card, so that the low-latency audio distribution module based on the network card is used. It can be used as either a network card or an audio distribution device. The target device is a playback device, such as a speaker, and the second device can be a playback device (eg, a speaker) or an audio collection device (eg, a microphone).

Example 1:

As shown in Figure 1, a network card-based low-latency audio distribution method includes the following steps:

Specifically, the main control module sends a broadcast network control instruction packet to the designated port in the application program, configures the network card-based low-latency audio distribution module (hereinafter referred to as the audio distribution module), and then sends the data packet through the broadcast network, The audio distribution module intercepts data packets through hardware, and then separates network data and configuration data to ease the configuration difficulty of the main control module on the audio distribution module. At the same time, audio forwarding and distribution are directly processed by the underlying hardware, and network data is processed by the computer. The system runs Will be more efficient and independent, and use the audio channel open command in the configuration data to drive the specified audio channel to be open.

Specifically, the audio distribution module obtains the target device that receives the audio data from the data packet sent by the main control module, and then establishes a connection with the target device in the designated audio channel in the open state to perform data interaction, that is, the distribution of audio data no longer requires the main The participation of the control module (computer application layer) is carried out directly inside the audio distribution module, which simplifies the distribution process and can effectively improve the distribution performance of the audio distribution module, making it suitable for multi-task audio streaming environments in complex broadcasting systems.

Specifically, after the audio distribution module establishes a connection with the target device, the main control module sends an audio distribution instruction to the audio distribution module, so that the audio distribution module starts to actively request audio data from the main control module.

Specifically, after the audio distribution module acquires the audio data sent by the main control module, it saves the acquired audio data in the cache memory, so that the audio distribution module acquires the audio data in advance, so as to avoid the main The real-time performance of the control module is insufficient, resulting in discontinuous audio data, resulting in the problem of sound stuttering.

Preferably, the audio distribution module can also intercept the audio data sent by the second device and store it. Specifically, the following steps are also included between S2 and S3:

S21: Obtain the forwarding instruction of the main control module;

Specifically, the audio distribution module obtains the forwarding instruction of the main control module, and enables the function of forwarding the audio data sent by the second device to the target device, that is, the distribution or forwarding of the audio data no longer requires the main control module (computer application layer). Participate in, the audio data sent by the second device will not be sent to the main control module, but directly inside the audio distribution module, simplifying the distribution or forwarding process, reducing the processing pressure of the main control module (computer) and reducing the main control module (computer) Non-real time brings the effect of audio jitter.

Specifically, after the audio distribution module acquires the audio data sent by the second device, it saves the acquired audio data in the cache storage, so that the audio distribution module acquires the audio data in advance and avoids the forwarding of the audio data due to the The real-time performance of the second device is insufficient, causing discontinuous audio data, resulting in the problem of sound stuttering.

Specifically, the timer is a high-precision audio clock crystal oscillator, and the audio clock crystal oscillator is used as a precise timer, so that the audio distribution module has high real-time performance and can distribute audio data to the target device on time. In this embodiment, , the S3 is specifically realized by the following steps: the audio distribution module obtains the sampling rate of each audio data, and then obtains the timing information of the corresponding timer according to the sampling rate of the audio data, so as to realize the timing of sending the audio data to the target device, thereby realizing Steady playback of audio.

Specifically, it is determined whether the audio distribution module needs to actively request audio data from the main control module by actively judging whether the buffer amount in the buffer memory is lower than the preset value by the audio distribution module, so as to avoid the lack of real-time performance of the main control module. The audio data is discontinuous, causing the problem of sound freezing; preferably, when there is still audio data with forwarding in the cache memory, the audio data will continue to be forwarded to the target device.

Embodiment 2:

As shown in Figure 3-5, a network card-based low-latency audio distribution module includes a storage and a processor;

a memory for storing program instructions;

The processor is configured to run the program instructions to execute and implement the low-latency audio distribution method based on a network card.

Embodiment three:

As shown in Figure 2-7, a low-latency audio distribution device based on a network card includes a main control module for an external computer and the low-latency audio distribution module based on a network card in Embodiment 2. The main control The module is connected with the low-latency audio distribution module based on the network card through the network.

Specifically, it also includes an audio distributor for distributing audio data to the target device, an audio data transceiver and a timer for connecting to the main control module, the audio data transceiver and timer, and the audio distributor are all related to the The low-latency audio distribution module of the network card is connected. In this embodiment, the audio distribution module obtains the control instruction from the main control module through the audio data transceiver, establishes a connection with the target device, and distributes the audio data sent by the main control module in an orderly manner according to the time information of the timer To the target device, in this embodiment, the main control module and the audio data transceiver are connected through a USB interface, the audio distribution module intercepts the data packet sent by the main control module through the audio data transceiver, and then separates network data and configuration data, In order to reduce the difficulty of configuring the audio distribution module by the main control module, and use the audio channel opening instruction in the configuration data to drive the designated audio channel of the audio distributor to be in an open state, and then establish a connection between the designated audio channel in the open state and the target device, Perform data interaction, that is, the distribution of audio data no longer requires the participation of the main control module (computer application layer), and is directly performed inside the audio distribution module (audio distributor), which simplifies the distribution process and can effectively improve the distribution performance of the audio distribution module. This makes it suitable for multi-tasking audio streaming environments in complex broadcast systems.

Preferably, the timer is an audio clock crystal oscillator, so as to realize precise timing, so that the distribution operation has high accuracy and real-time performance, and brings the effect of stable playback for the system audio distribution. In this embodiment, the audio distribution module obtains the sampling rate of each audio data, and then obtains the timing information of the corresponding timer according to the sampling rate of the audio data, so as to send the audio data to the target device regularly, so as to realize the stable playback of the audio.

Preferably, a repeater for forwarding the audio data sent by the second device is also included, and the repeater is connected to the network card-based low-latency audio distribution module. In this embodiment, the audio distribution module obtains the forwarding instruction of the main control module, and enables the function of forwarding the audio data sent by the second device to the target device, that is, the distribution or forwarding of the audio data does not require the main control module (computer application). layer), the audio data sent by the second device will not be sent to the main control module, but directly in the audio distribution module (audio distributor), which simplifies the distribution or forwarding process and reduces the processing pressure of the main control module (computer). And reduce the influence of audio jitter caused by the non-real-time nature of the main control module (computer).

Preferably, a buffer storage for buffering audio data is also included, and the buffer storage is connected with the network card-based low-latency audio distribution module. In this embodiment, after the audio distribution module acquires the audio data sent by the main control module or forwarded by the second device, the acquired audio data is stored in the cache memory, so that the audio distribution module can acquire the audio data in advance , to avoid the problem that the audio data is discontinuous due to the lack of real-time performance of the device during distribution, resulting in the problem of sound stuttering.

For those skilled in the art, various other corresponding changes and deformations can be made according to the technical solutions and concepts described above, and all these changes and deformations should fall within the protection scope of the claims of the present invention.

Claims

A network card-based low-latency audio distribution method, comprising the following steps:

S1: Obtain the distribution audio instruction sent by the main control module, and request audio data from the main control module;

S2: Obtain the audio data sent by the main control module and save it to the cache memory;

S3: Obtain the timing information of the timer, and regularly send audio data to the target device;

S4: Determine whether the buffer amount in the buffer memory is lower than the preset value, if yes, execute S1, and if not, execute S3.
The network card-based low-latency audio distribution method according to claim 1, further comprising the following steps before the S1:

S01: Obtain the audio channel opening instruction sent by the main control module through the broadcast network, so that the specified audio channel is in an open state;

S02: Obtain the target device instruction sent by the main control module, and configure the audio channel to perform data interaction with the target device.
The network card-based low-latency audio distribution method according to claim 1, wherein the step between S2 and S3 further comprises the following steps:

S21: Obtain the forwarding instruction of the main control module;

S22: Acquire the audio data sent by the second device, and save it in the cache storage.
The network card-based low-latency audio distribution method according to claim 1, wherein the S3 is specifically implemented by the following steps:

The timing information of the corresponding timer is obtained according to the sampling rate of the audio data, and the audio data is sent to the target device regularly.
A network card-based low-latency audio distribution module, characterized in that it comprises a storage and a processor;

a memory for storing program instructions;

The processor is configured to run the program instructions to execute the network card-based low-latency audio distribution method according to any one of claims 1-4.
A low-latency audio distribution device based on a network card, characterized in that it comprises a main control module for an external computer and the low-latency audio distribution module based on a network card according to claim 5, the main control module and the network card-based low-latency audio distribution module. The low-latency audio distribution module is connected via a network.
The network card-based low-latency audio distribution device according to claim 6, further comprising an audio distributor for distributing audio data to the target device, an audio data transceiver and a timer for connecting to the main control module The audio data transceiver, the timer, and the audio distributor are all connected with a network card-based low-latency audio distribution module.
The low-latency audio distribution device based on a network card according to claim 7, wherein the timer is an audio clock crystal oscillator.
The network card-based low-latency audio distribution device according to claim 7, further comprising a repeater for forwarding the audio data sent by the second device, the repeater being connected to the network-card-based low-latency audio distribution device Module connection.
The network card-based low-latency audio distribution device according to claim 7, further comprising a cache storage for buffering audio data, the cache storage being connected to the network-card-based low-latency audio distribution module.