WO2021227028A1

WO2021227028A1 - Signal transmission method, apparatus and system, and storage medium

Info

Publication number: WO2021227028A1
Application number: PCT/CN2020/090556
Authority: WO
Inventors: 张立斌; 袁庭球
Original assignee: 华为技术有限公司
Priority date: 2020-05-15
Filing date: 2020-05-15
Publication date: 2021-11-18
Also published as: CN114946177A

Abstract

Disclosed are a signal transmission method, apparatus and system, and a storage medium, which belong to the technical field of communications. The method comprises: acquiring an audio signal collected by a first audio device; when an audio signal sent by the previous-hop device of the first audio device is received, mixing the audio signal collected by the first audio device and the audio signal sent by the previous-hop device, so as to obtain a mixed audio signal; and sending the mixed audio signal to the next-hop device of the first audio device, wherein the first audio device, the previous-hop device and the next-hop device are adjacent audio devices on a first transmission path in an audio processing network. The present application facilitates reducing a transmission bandwidth of an audio signal.

Description

Signal transmission method, device, system and storage medium

Technical field

This application relates to the field of communication technology, and in particular to a signal transmission method, device and system, and storage medium.

Background technique

Audio collaborative processing is a way of audio processing based on an audio processing network. Audio collaborative processing is an important trend in future audio processing, which can be applied to audio processing scenarios such as multi-device cooperative voice enhancement, multi-device cooperative three-dimensional (3D) sound field acquisition.

The audio processing network includes multiple distributed audio devices. For a certain audio service, the multiple audio devices can include an application audio device and multiple cooperative audio devices. Each cooperative audio device can send the collected audio signal to the application audio device. , The application audio device performs audio applications based on the audio signals collected by itself and the audio signals sent by each cooperative audio device. At present, multiple cooperative audio devices each send audio signals to the application audio device. Such an audio signal transmission method causes the transmission bandwidth of the audio signal (that is, the network bandwidth occupied by the transmission of the audio signal) to be relatively large.

Summary of the invention

The embodiments of the present application provide a signal transmission method, device, system, and storage medium, which help reduce the transmission bandwidth of audio signals. The technical solution of this application is as follows:

In a first aspect, a signal transmission method is provided. The method includes: acquiring an audio signal collected by a first audio device; The audio signal collected by the device and the audio signal sent by the previous hop device are mixed to obtain a mixed audio signal; the mixed audio signal is sent to the next hop device of the first audio device; wherein, the first audio device and the previous hop device The device and the next hop device are adjacent audio devices on the first transmission path in the audio processing network, and the first audio device is on the first transmission path except for the audio device at the starting point and the audio device at the destination point. Any audio device.

In the technical solution provided by the embodiments of the present application, the audio device can mix the collected audio signal with the audio signal sent by the previous hop device and then send it to the next hop device until the audio signal collected by each audio device is sent to the target audio device (That is, the audio device at the destination point), therefore, compared to the solution in which each audio device sends the audio signal to the target audio device separately, it helps to reduce the transmission bandwidth of the audio signal.

Optionally, mixing the audio signal collected by the first audio device and the audio signal sent by the previous hop device to obtain the mixed audio signal includes: using the audio processing function of the first audio device to collect the audio signal from the first audio device The audio signal is processed to obtain the processed signal of the first audio device; the processed signal of the first audio device and the audio signal sent by the previous hop device are superimposed to obtain a mixed audio signal.

In the technical solution provided by the embodiments of the present application, after the first audio device processes the audio signal collected by the first audio device to obtain the processed signal of the first audio device, the processed signal of the first audio device and the first audio The audio signal sent by the previous hop device of the device is superimposed to obtain the mixed audio signal, without the need to restore the audio signal sent by the previous hop device of the first audio device, which helps to reduce the calculation of signal mixing by the first audio device quantity.

Optionally, the audio signal sent by the previous hop device is a mixed signal of audio signals collected by at least two audio devices; the audio signal collected by the first audio device and the audio signal sent by the previous hop device are mixed to obtain a mixture The audio signal includes: recovering the audio signal collected by the at least two audio devices from the audio signal sent by the last hop device; for each audio device of the first audio device and the at least two audio devices, The audio processing function of the audio device processes the audio signal collected by the audio device to obtain the processed signal of the audio device; superimposes the processed signal of the first audio device and the processed signal of the at least two audio devices to obtain a mixed audio signal .

In the technical solution provided by the embodiments of the present application, when the first audio device mixes the audio signal collected by the first audio device with the audio signal sent by the previous hop device of the first audio device, the audio signal from the previous hop device of the first audio device is mixed. The audio signals collected by at least two audio devices are recovered from the audio signals sent by the hop device (that is, the audio signals collected by each audio device are recovered from the audio signals sent by the previous hop device of the first audio device). It is convenient for the first audio device to use the audio signals collected by the at least two audio devices.

Optionally, before the audio signals collected by the at least two audio devices are recovered from the audio signals sent by the last hop device, the method further includes: determining according to the source information carried in the audio signals sent by the last hop device The audio signal sent by the previous hop device is a mixed signal of the audio signals collected by the at least two audio devices; accordingly, the audio signal collected by the at least two audio devices is recovered from the audio signal sent by the previous hop device , Including: recovering the audio signals collected by the at least two audio devices from the audio signals sent by the last hop device according to the audio processing functions of the at least two audio devices.

In the technical solution provided by the embodiments of the present application, the first audio device determines at least one of the sources of the audio signal sent by the previous hop device of the first audio device according to the source information carried by the audio signal sent by the previous hop device of the first audio device Two audio devices can facilitate the first audio device to determine the audio processing functions of the at least two audio devices, so that the audio sent from the previous hop device of the first audio device according to the audio processing functions of the at least two audio devices The audio signals collected by the at least two audio devices are recovered from the signal.

Optionally, the audio signal sent by the previous hop device is an audio signal collected by the previous hop device; the audio signal collected by the first audio device and the audio signal sent by the previous hop device are mixed to obtain a mixed audio signal, It includes: for each audio device of the first audio device and the previous hop device, using the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device; The processed signal of the first audio device and the processed signal of the previous hop device are superimposed to obtain a mixed audio signal.

In the technical solution provided by the embodiment of the present application, the first audio device processes the audio signal collected by the first audio device according to the audio processing function of the first audio device, and according to the audio signal of the previous hop device of the first audio device The processing function processes the audio signal collected by the previous hop device of the first audio device, which can facilitate the audio signal collected by the first audio device by the first audio device and the audio signal collected by the previous hop device of the first audio device Signal mixing.

Optionally, the audio signal sent by the previous hop device is obtained by processing the audio signal collected by the previous hop device; the audio signal collected by the first audio device is mixed with the audio signal sent by the previous hop device Obtaining the mixed audio signal includes: recovering the audio signal collected by the previous hop device from the audio signal sent by the previous hop device; for each audio device in the first audio device and the previous hop device, using The audio processing function of the audio device processes the audio signal collected by the audio device to obtain the processed signal of the audio device; superimposes the processed signal of the first audio device and the processed signal of the previous hop device to obtain a mixed audio signal.

In the technical solution provided by the embodiments of the present application, when the first audio device mixes the audio signal collected by the first audio device with the audio signal sent by the previous hop device of the first audio device, the audio signal from the previous hop device of the first audio device is mixed. The audio signal collected by the previous hop device of the first audio device is recovered from the audio signal sent by the hop device, which may facilitate the first audio device to use the audio signal collected by the previous hop device of the first audio device.

Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, the audio processing function of each audio device in the audio processing network is The function is generated by the function processing device in the audio processing network and sent to each audio device in the audio processing network.

In the technical solution provided by the embodiments of the present application, the audio device generates its own audio processing function and sends its own audio processing function to other audio devices, or the function processing device generates the audio processing function of each audio device and sends the audio processing to each audio device Function, it is convenient for each audio device to obtain the audio processing function of itself and other audio devices, so as to process the corresponding audio signal according to the audio processing function.

Optionally, before using the audio processing function of the first audio device to process the audio signal collected by the first audio device, the method further includes: generating the audio processing function of the first audio device; or, receiving the function processing device The sent audio processing function of the first audio device.

In the technical solution provided by the embodiments of the present application, the first audio device generates the audio processing function of the first audio device or receives the audio processing function of the first audio device sent by the function processing device, which can facilitate the first audio device to obtain its own audio processing function. Audio processing function.

Optionally, generating the audio processing function of the first audio device includes: using a random number generation function to generate multiple random numbers; and generating the audio processing function of the first audio device according to the multiple random numbers.

In the technical solution provided by the embodiments of the present application, the first audio device generates the audio processing function of the first audio device in a randomized manner, which can ensure that the audio processing function of the first audio device and the audio processing functions of other audio devices are as small as possible. Related.

In a second aspect, a signal transmission method is provided. The method includes: receiving a mixed audio signal sent by a previous hop device of a target audio device, where the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices; The audio signals collected by the at least two audio devices are recovered from the mixed audio signal; wherein the target audio device and the previous hop device are adjacent audio devices on the first transmission path in the audio processing network.

In the technical solution provided by the embodiments of the present application, the audio device on the first transmission path can mix the collected audio signal and the received audio signal and then send it to the next hop device, until the audio signal collected by each audio device is sent to the target Audio equipment, therefore, the mixed audio signal sent by the previous hop device of the target audio device received by the target audio device is a mixed signal of the audio signals collected by at least two audio devices. In the scheme of sending audio signals, the target audio device can receive the audio signals collected by each audio device by receiving the mixed audio signal, which helps to reduce the transmission bandwidth of the audio signal.

Optionally, before recovering the audio signals collected by the at least two audio devices from the mixed audio signal, the method further includes: determining, according to the source information carried by the mixed audio signal, that the mixed audio signal is collected by the at least two audio devices Correspondingly, recovering from the mixed audio signal the audio signal collected by the at least two audio devices includes: recovering from the mixed audio signal according to the audio processing functions of the at least two audio devices Audio signals collected by the at least two audio devices.

In the technical solution provided by the embodiments of the present application, the target audio device determines that the mixed audio signal originates from at least two audio devices according to the source information carried by the mixed audio signal, which can facilitate the target audio device to determine the audio processing functions of the at least two audio devices, Thus, the audio signals collected by the at least two audio devices are recovered from the mixed audio signal according to the audio processing functions of the at least two audio devices.

Optionally, before recovering the audio signals collected by the at least two audio devices from the mixed audio signal according to the audio processing functions of the at least two audio devices, the method includes: receiving the audio processing functions of the at least two audio devices.

In the technical solution provided by the embodiments of the present application, the target audio device receives the audio processing functions of at least two audio devices, which can facilitate the target audio device to recover the at least two audio signals from the mixed audio signal according to the audio processing functions of the at least two audio devices. Audio signals collected by an audio device.

Optionally, before receiving the mixed audio signal sent by the previous hop device of the target audio device, the method further includes: determining from the audio processing network that the destination point is at least one target transmission path of the target audio device, and the at least one target audio device The transmission path includes a first transmission path; sending transmission instruction information to an audio device on each target transmission path, and the audio device on the target transmission path is used to transmit audio signals through the target transmission path according to the received transmission instruction information.

In the technical solution provided by the embodiments of the present application, the target audio device determines at least one target transmission path to the target audio device, so that the audio device in the audio processing network transmits the audio signal to the target audio device through the at least one target transmission path, There is no need to transmit the audio signal to the target audio device through a transmission path other than the at least one target transmission path, which helps to reduce the transmission bandwidth of the audio signal.

Optionally, determining from the audio processing network that the destination point is at least one target transmission path of the target audio device includes: selecting at least one transmission path from a plurality of transmission paths whose destination point is the target audio device in the audio processing network As the at least one target transmission path; correspondingly, sending transmission instruction information to the audio device on each target transmission path includes: sending removal instruction information to the audio device on each target transmission path, wherein The removal instruction information sent by the audio device instructs the audio device to remove the redundant transmission path in the multiple transmission paths and transmit the audio signal through the target transmission path, and the redundant transmission path is at least one of the multiple transmission paths A transmission path other than the target transmission path.

In the technical solution provided by the embodiments of the present application, the target audio device instructs the audio device on the target transmission path to remove the redundant transmission path, which can prevent the audio device on the target transmission path from transmitting audio to the target audio device through the redundant transmission path Signal, helps reduce the transmission bandwidth of audio signals.

Optionally, selecting at least one transmission path as the at least one target transmission path from the multiple transmission paths whose destination point is the target audio device in the audio processing network includes: receiving transmission through each transmission path of the multiple transmission paths Path detection signal, wherein the path detection signal transmitted through each transmission path contains the information of each audio device on the transmission path; according to the path detection signal transmitted through the multiple transmission paths, select from the multiple transmission paths At least one transmission path is used as the at least one target transmission path, where the at least one target transmission path is the transmission path with the least number of paths and the largest number of audio devices among the plurality of transmission paths.

In the technical solution provided by the embodiments of the present application, the target audio device selects the transmission path with the smallest number of paths and the largest number of audio devices among the multiple transmission paths as the target transmission path, which helps to ensure the minimization of the transmission bandwidth of the audio signal.

Optionally, selecting at least one transmission path as the at least one target transmission path from multiple transmission paths whose destination point is the target audio device in the audio processing network includes: for each transmission path in the multiple transmission paths, obtaining The current processing capabilities of each audio device on the transmission path; according to the current processing capabilities of the audio devices on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path, wherein, The current processing capability of the audio device on each target transmission path is stronger than the preset processing capability.

In the technical solution provided by the embodiments of the present application, the target audio device selects the transmission path of the audio device whose current processing capability is stronger than the preset processing capability among multiple transmission paths as the target transmission path, which helps maintain the system stability of the audio processing network .

Optionally, determining the destination point from the audio processing network as at least one target transmission path of the target audio device includes: acquiring topology information of the audio processing network and the current processing capabilities of each audio device in the audio processing network; The current processing capabilities of each audio device in the network, determine at least one cooperative audio device required by the target audio device from the audio processing network; according to the topology information of the audio processing network, set the destination point as the target audio device and include the at least one audio device At least one transmission path of the cooperative audio device is determined as the at least one target transmission path; accordingly, sending transmission instruction information to the audio device on each target transmission path includes: sending a device instruction to the audio device on each target transmission path Information, wherein the device indication information sent to the audio device indicates the next hop device of the audio device on the target transmission path.

In a third aspect, a signal transmission device is provided. The signal transmission device includes: modules for executing the signal transmission method provided by the first aspect or any optional implementation of the first aspect.

In a fourth aspect, a signal transmission device is provided. The signal transmission device includes: modules for executing the signal transmission method provided by the second aspect or any optional implementation of the second aspect.

In a fifth aspect, a signal transmission device is provided. The signal transmission device includes a processor and a memory, the memory storing a program, and the processor is configured to call the program stored in the memory so that the signal transmission device executes A signal transmission method provided by one aspect or any optional implementation of the first aspect.

In a sixth aspect, a signal transmission device is provided. The signal transmission device includes a processor and a memory. The memory stores a program. The processor is used to call the program stored in the memory to make the signal transmission device execute The second aspect or any optional implementation of the second aspect provides a signal transmission method.

In a seventh aspect, a signal transmission system is provided, the signal transmission system includes: at least two audio devices, at least one of the at least two audio devices includes the signal transmission device as provided in the third or fourth aspect, or At least one of the at least two audio devices includes the signal transmission device as provided in the fifth aspect or the sixth aspect.

In an eighth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program. When the computer program runs on a computer, the computer can execute any of the first aspect or the first aspect. The signal transmission method provided in an optional manner, or the computer is caused to execute the signal transmission method provided in the second aspect or any optional manner of the second aspect.

In a ninth aspect, a computer program product containing instructions is provided. When the computer program product runs on a computer, the computer executes the signal transmission method as provided in the first aspect or any of the optional methods of the first aspect Or, make the computer execute the signal transmission method as provided in the second aspect or any optional manner of the second aspect.

In a tenth aspect, a chip is provided. The chip includes a programmable logic circuit and/or program instructions. When the chip is running, it is used to implement signal transmission as provided in the first aspect or any of the optional methods of the first aspect. Method, or implement the signal transmission method as provided in the second aspect or any optional manner of the second aspect.

The beneficial effects brought about by the technical solutions provided by the embodiments of the present application may at least include:

In the technical solution provided by the embodiment of the present application, after the first audio device collects the audio signal, when the audio signal sent by the previous hop device of the first audio device is received, the audio signal collected by the first audio device and the first audio device are The audio signal sent by the previous hop device of an audio device is mixed to obtain a mixed audio signal, and the mixed audio signal is sent to the next hop device of the first audio device. Since the audio device can mix the collected audio signal and the received audio signal and send it to the next hop device, until the audio signal collected by each audio device is sent to the target audio device, it is compared with each audio device separately to the target audio device. The scheme of sending audio signals by audio equipment helps to reduce the transmission bandwidth of audio signals.

Description of the drawings

FIG. 1 is a schematic diagram of an implementation environment involved in various embodiments of the present application;

FIG. 2 is a flowchart of a method for determining a target transmission path from an audio processing network according to an embodiment of the present application;

FIG. 3 is a flowchart of a method for selecting a target transmission path from multiple transmission paths according to an embodiment of the present application;

FIG. 4 is a flowchart of another method for selecting a target transmission path from multiple transmission paths according to an embodiment of the present application;

FIG. 5 is a flowchart of a method for determining a destination point as a target transmission path of a target audio device according to an embodiment of the present application;

FIG. 6 is a schematic diagram of at least one target transmission path in an audio processing network provided by an embodiment of the present application;

FIG. 7 is a method flowchart of a signal transmission method provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of transmitting audio signals through a first transmission path according to an embodiment of the present application;

FIG. 9 is another schematic diagram of transmitting audio signals through a first transmission path according to an embodiment of the present application;

FIG. 10 is another schematic diagram of transmitting audio signals through a first transmission path according to an embodiment of the present application;

FIG. 11 is a flowchart of a method for mixing an audio signal collected by a first audio device with an audio signal sent by a previous hop device of the first audio device according to an embodiment of the present application;

FIG. 12 is a flowchart of another method for mixing an audio signal collected by a first audio device with an audio signal sent by a previous hop device of the first audio device according to an embodiment of the present application;

FIG. 13 is a flowchart of yet another method for mixing an audio signal collected by a first audio device with an audio signal sent by a previous hop device of the first audio device according to an embodiment of the present application;

FIG. 14 is a flowchart of yet another method for mixing an audio signal collected by a first audio device with an audio signal sent by a previous hop device of the first audio device according to an embodiment of the present application;

15 is a schematic diagram of the logical structure of a signal transmission device provided by an embodiment of the present application;

16 is a schematic diagram of the logical structure of another signal transmission device provided by an embodiment of the present application;

FIG. 17 is a schematic diagram of the hardware structure of a signal transmission device provided by an embodiment of the present application.

Detailed ways

In order to make the principles, technical solutions, and advantages of the present application clearer, the implementation manners of the present application will be described in further detail below in conjunction with the accompanying drawings.

Please refer to FIG. 1, which shows a schematic diagram of an implementation environment involved in various embodiments of the present application. The implementation environment provides an audio processing network. The audio processing network may include multiple audio devices. Connect through wired network or wireless network communication. According to business needs, the multiple audio devices can be fully interconnected (that is, each audio device in the multiple audio devices is communicatively connected with all other audio devices in the multiple audio devices) or partially interconnected (that is, , At least one of the plurality of audio devices is communicatively connected with some of the plurality of audio devices, and not communicatively connected with some of the audio devices). In the embodiment of the application, the audio processing network includes audio equipment 01 to 05 (that is, audio equipment 01, audio equipment 02, audio equipment 03, audio equipment 04, and audio equipment 05) as an example. As shown in FIG. 1, audio Device 02 is communicatively connected with audio device 01, audio device 03, and audio device 04, but is not communicatively connected with audio device 05, so audio devices 01 to 05 are partially interconnected. The wireless network may include, but is not limited to, a wireless fidelity (WIFI) network, a Bluetooth network, an infrared network, and a zigbee network. The wired network may include, but is not limited to, a universal serial bus (universal serial bus, USB) network.

Among them, the audio device can be any device that can collect audio signals and/or process audio signals. For example, the audio device can be a smart phone, a tablet computer, a notebook computer, a desktop computer, a TV, a video expert compresses standard audio Level 3 (moving picture experts group audio layer Ⅲ, MP3) players, motion picture experts compress standard audio level 4 (moving picture experts group audio layer IV, MP4) players, e-book readers, smart home equipment, headphones, smart toys , Smart bracelets, smart watches, virtual reality (VR) equipment and augmented reality (AR) equipment, etc. In the audio processing network provided by the embodiment of the present application, the multiple audio devices may be the same type of audio devices. For example, the audio devices 01 to 05 are all smart phones, or the types of the multiple audio devices are not all the same. For example, the audio device 01 and the audio device 02 are both smart phones, the audio device 03 is a smart toy, the audio device 04 is a TV, and the audio device 05 is a headset, which is not limited in the embodiment of the present application.

Optionally, the multiple audio devices may be deployed in the same sound field space in a distributed manner, and the multiple audio devices may include an application audio device and a cooperative audio device. The application audio device refers to a device that needs to apply audio signals. A device refers to a device that processes audio signals with a cooperative application audio device. The cooperative audio device can send the collected audio signal to the application audio device, and the supply audio device performs audio applications. It is easy to understand that the application audio device has at least the function of processing audio signals, and the cooperative audio device has at least the function of collecting audio signals. Optionally, the application audio device may also have the function of collecting audio signals. The cooperative audio device It can also have the function of processing audio signals. For example, in the embodiment of the present application, audio device 04 is an application audio device, audio devices 01 to 03 and audio device 05 are cooperative audio devices, and audio devices 01 to 05 have audio collection functions and audio processing functions as an example. Wherein, the same sound field space may be a space (such as a room) where the same sound source is located. For example, the audio devices 01 to 05 are located in the room where the sound source A is located, and the audio devices 01 to 05 are located in the sound field space emitted by the sound source A.

At present, in an audio processing network, multiple coordinated audio devices each send audio signals to the application audio device. Such an audio signal transmission method results in a relatively large transmission bandwidth of the audio signal. For example, audio devices 01 to 03 and audio device 05 each send audio signals to audio device 04, so that audio devices 01 to 03 and audio device 05 send audio signals to audio device 04 will occupy the four-channel bandwidth of the audio processing network (audio Devices 01 to 03 and audio device 05 each occupy one channel of bandwidth), and the transmission bandwidth of audio signals is relatively large. In the signal transmission solution provided by the embodiment of the present application, the audio signals collected by multiple cooperative audio devices can be mixed and sent to the application audio device through the target transmission path, so there is no need for each cooperative audio device to send audio signals to the application audio device separately. Helps reduce the transmission bandwidth of audio signals. For example, audio device 03 can send the collected audio signal to audio device 02, audio device 02 mixes the audio signal sent by audio device 03 with the audio signal collected by itself and sends it to audio device 01, audio device 01 sends audio device 02 The audio signal and the audio signal collected by itself are mixed and sent to the audio device 04. In this way, there is no need for the audio device 03 and the audio device 02 to send the audio signal to the audio device 04 respectively, compared to the audio device 03 and the audio device 02 respectively. The solution of sending audio signals by the audio equipment 04 can reduce the two-channel bandwidth and reduce the transmission bandwidth of the audio signals.

It is worth noting that the communication connection between different audio devices may be the underlying link between the different audio devices, and the link for transmitting audio signals established by different audio devices based on the underlying link may be an audio link. It is easy to understand that a bottom link is established between different audio devices that have an audio link, and an audio link is not necessarily established between different audio devices that have a bottom link. For example, as shown in Figure 1, a bottom link and an audio link are established between audio device 01 and audio device 02, and a bottom link is established between audio device 01 and audio device 03, but no audio link is established. . The audio link described in this paragraph is also the transmission path described in the following embodiments.

Those skilled in the art can easily understand that the audio processing network shown in FIG. 1 is only used as an example, and is not used to limit the technical solutions of the embodiments of the present application. In the implementation process, the number of audio devices can be configured as needed, and the Configure other devices in the audio processing network. For example, the audio processing network may also include a management device for managing the multiple audio devices. For another example, the audio processing network may also include a server, etc., which is not limited in the embodiment of the present application.

The solution provided by the embodiments of the present application may include a path determination process and a signal transmission process. The path determination process is used to determine from the audio processing network the destination point is at least one target transmission path of the target audio device, and the signal transmission process is used for each target. The audio device on the transmission path transmits the audio signal to the target audio device through the target transmission path. Wherein, the transmission path may be the audio link described above. The path determination process and the signal transmission process are separately described in two embodiments below.

First, the path determination process in the embodiment of the present application is introduced. The path determination process may be performed by a target audio device, and the target audio device may be an application audio device in an audio processing network.

For example, please refer to FIG. 2, which shows a flow chart of a method for determining a destination point as a target transmission path of a target audio device from an audio processing network provided by an embodiment of the present application. The method can be applied to the method shown in FIG. Implementation environment. Referring to Figure 2, the method may include the following steps:

Step 201: Determine from the audio processing network that the destination point is at least one target transmission path of the target audio device.

In the embodiment of the present application, the audio processing network may include multiple transmission paths whose destination points are the target audio device, and the target audio device may select at least one transmission path from the multiple transmission paths as the at least one target transmission path. Alternatively, the target audio device may determine the destination point from the audio processing network as at least one target transmission path (or in other words) of the target audio device according to the topology information of the audio processing network and the current processing capabilities of each audio device in the audio processing network. The establishment of the destination point is at least one target transmission path of the target audio device). Corresponding to the two cases, this step 201 may include the following two possible implementation manners:

The first implementation manner: the target audio device selects at least one transmission path as the at least one target transmission path from among multiple transmission paths whose destination point is the target audio device in the audio processing network.

Optionally, the target audio device may select at least one transmission path from the multiple transmission paths as the at least one target transmission path based on the path detection signal transmitted through the multiple transmission paths, or according to the audio on the multiple transmission paths For the current processing capability of the device, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path. Therefore, the first implementation manner of step 201 may include the following two optional implementation manners:

Embodiment 1: The target audio device selects at least one transmission path from the multiple transmission paths as the at least one target transmission path according to the path detection signal transmitted through the multiple transmission paths.

For example, please refer to FIG. 3, which shows a flow chart of a method for selecting at least one target transmission path from multiple transmission paths according to an embodiment of the present application. Referring to FIG. 3, the method may include the following steps:

Sub-step 2011A: Receive a path detection signal transmitted through each of the multiple transmission paths, and the path detection signal transmitted through each transmission path includes information about each audio device on the transmission path.

The audio device on each of the multiple transmission paths sends a path detection signal to the target audio device through the transmission path where it is located, and the target audio device can receive the path detection signal transmitted through each transmission path. Wherein, the path detection signal transmitted through each transmission path contains the information of each audio device on the transmission path. The information of the audio device may be, for example, the device identification of the audio device, which is not limited in the embodiment of the present application.

Optionally, the audio device on each transmission path sends a path detection signal to the target audio device through the transmission path where it is located may include: the audio device at the starting point of each transmission path generates information containing the audio device (such as device identification) ), and send the path detection signal to the next hop device of the audio device on the transmission path. After the next hop device receives the path detection signal, it can add its own information (such as device identification) In the path detection signal, the path detection signal added with its own information is sent to the next hop device of the next hop device on the transmission path until the path detection signal is transmitted to the target audio device. Wherein, the next hop device of each audio device may be an audio device that is adjacent to the audio device on the transmission path where the audio device is located and is located behind the audio device in the direction of the transmission path.

For example, taking FIG. 1 as an example, the audio device 04 may be a target audio device, and multiple transmission paths of the audio device 04 whose destination point is the audio device 04 in the audio processing network may include:

Transmission path 1: Audio equipment 03->Audio equipment 02->Audio equipment 01->Audio equipment 04;

Transmission path 2: Audio equipment 03->Audio equipment 02->Audio equipment 04;

Transmission path 3: Audio equipment 03->Audio equipment 04;

Transmission path 4: Audio equipment 05->Audio equipment 04;

Taking transmission path 1 as an example, the audio device on the transmission path 1 sending a path detection signal to the audio device 04 through the transmission path 1 may include: the audio device 03 generates a path detection signal containing the device identification ID-03 of the audio device 03 , And send the path detection signal to the audio device 02 (the next hop device of the audio device 03). After the audio device 02 receives the path detection signal, it adds the device identification ID-02 of the audio device 02 to the path detection signal And send a path detection signal with ID-02 added to the audio device 01 (the next hop device of the audio device 02). After the audio device 01 receives the path detection signal, the device ID of the audio device 01 is ID-01 is added to the path detection signal, and the path detection signal with ID-01 added to the audio device 04 (the next hop device of the audio device 01) is sent to the audio device 04 (the next hop device of the audio device 01). Finally, the audio device 04 receives the path detection signal through the The path detection signal sent by the transmission path 1 includes the device identification ID-03 of the audio device 03, the device identification ID-02 of the audio device 02, and the device identification ID-01 of the audio device 01.

Similarly, the path detection signal received by the audio device 04 and sent through the transmission path 2 includes the device identification ID-03 of the audio device 03 and the device identification ID-02 of the audio device 02. The path detection signal received by the audio device 04 and sent through the transmission path 3 contains the device identification ID-03 of the audio device 03. The path detection signal sent through the transmission path 4 received by the audio device 04 contains the device identification ID-05 of the audio device 05.

Sub-step 2012A, according to the path detection signal transmitted through the multiple transmission paths, select at least one transmission path from the multiple transmission paths as at least one target transmission path, and the at least one target transmission path is among the multiple transmission paths, The transmission path with the smallest number of paths and the largest number of audio devices.

Optionally, the target audio device may determine the number of audio devices on the transmission path based on the audio device information contained in the path detection signal transmitted through each transmission path, and according to the number of audio devices on the multiple transmission paths and The number of the plurality of transmission paths, at least one transmission path is selected from the plurality of transmission paths as at least one target transmission path, and the at least one target transmission path is among the plurality of transmission paths, the number of paths is the least and the number of audio devices included is the most The transmission path. Wherein, the at least one target transmission path is the transmission path with the smallest number of paths and the largest number of audio devices among the multiple transmission paths, which may refer to: the at least one target transmission path is a combination of the multiple transmission paths ( Each combination includes at least one transmission path), the number of audio devices is the largest (for example, the number of audio devices on the at least one target transmission path is equal to the sum of the number of all audio devices on the multiple transmission paths) and the number of paths is the least The transmission path in the combination.

For example, taking the above transmission path 1 to transmission path 4 as an example, the number of audio devices on transmission path 1 is 4, the number of audio devices on transmission path 2 is 3, and the number of audio devices on transmission path 3 and transmission path 4 According to the number of audio devices on transmission path 1 to transmission path 4 and the number of the 4 transmission paths, the audio equipment 04 can select transmission path 1 and transmission path 4 as the target from the 4 transmission paths. Transmission path. Among them, the combination of transmission path 1 and transmission path 4 contains the largest number of audio devices (a total of 5 audio devices), and the combination of transmission path 1 and transmission path 4 is the combination of transmission path 1 to transmission path 4 with the least number of paths combination.

In the embodiment of the present application, the path detection signal may be an audio signal, or a signal dedicated to path detection. The target audio device selects the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths as the target transmission path, which helps to ensure that the transmission bandwidth of the audio signal is minimized.

Embodiment 2: The target audio device selects at least one transmission path from the multiple transmission paths as the at least one target transmission path according to the current processing capabilities of the audio devices on the multiple transmission paths.

For example, please refer to FIG. 4, which shows a flowchart of another method for selecting at least one target transmission path from multiple transmission paths according to an embodiment of the present application. Referring to FIG. 4, the method may include the following steps :

Sub-step 2011B: For each of the multiple transmission paths, obtain the current processing capability of each audio device on the transmission path.

Optionally, each audio device in the audio processing network can send (for example, broadcast) its own processing capability information to other audio devices in the audio processing network in real time or periodically, and the processing capability that each audio device sends to other audio devices The information is used to characterize the current processing capability of the audio device. For example, each audio device can broadcast its processing capability information to other audio devices every 10 seconds or 60 seconds. For each transmission path, the target audio device may determine the current processing capability of each audio device on the transmission path according to the most recently received processing capability information sent by each audio device on the transmission path. Optionally, the processing capability information may include at least one of a central processing unit (CPU) occupancy rate and absolute capability information, such as million instructions per second (MIPS). ), million operations per second (MOPS), or megabit code per second (MCPS). Among them, MIPS is also called the average execution speed of single-word fixed-point instructions.

Sub-step 2012B. According to the current processing capabilities of the audio devices on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as at least one target transmission path, and the current processing of the audio equipment on each target transmission path Ability is stronger than the preset processing capacity.

The preset processing capability may be preset by the target audio device or the management device in the audio processing network before performing this sub-step 2012B, and the preset processing capability is used to measure the current processing capability of the audio device.

Optionally, the target audio device may select the transmission path where the audio device with the current processing capability is stronger than the preset processing capability from the multiple transmission paths according to the current processing capabilities of the audio devices on the multiple transmission paths as the target transmission path. Optionally, the current processing capabilities of all audio devices on the target transmission path are stronger than the preset processing capabilities, or the number of audio devices on the target transmission path whose current processing capabilities are stronger than the preset processing capabilities and the number of audio devices on the target transmission path The ratio of the number of all audio devices is greater than the preset ratio, that is, if the current processing capacity of a certain transmission path is stronger than the preset processing capacity of the audio equipment on the transmission path is greater than the preset ratio, the transmission The path may be used as the target transmission path. For example, the preset ratio may be 0.5, 0.6, 0.8, or the like. Optionally, the preset processing capability may be characterized by using preset processing capability information. The preset processing capability information may be at least one of a CPU occupancy rate and absolute capability information, such as MIPS number, MOPS number or MCPS number.

As an example, continue to take the above transmission path 1 to transmission path 4 as an example. Assuming that the CPU occupancy rate of audio device 01 is greater than the preset CPU occupancy rate, audio device 04 (target audio device) can select the transmission path where audio device 01 is located As the target transmission path, that is, the aforementioned transmission path 1 is selected as the target transmission path. Assuming that the MIPS number of the audio device 05 is greater than the preset MIPS number, the audio device 04 may select the transmission path where the audio device 05 is located as the target transmission path, that is, select the aforementioned transmission path 4 as the target transmission path.

In the embodiment of the present application, the target audio device selects the transmission path of the audio device whose current processing capability is stronger than the preset processing capability from multiple transmission paths as the target transmission path, which helps maintain the system stability of the audio processing network .

It is worth noting that, in the embodiment of this application, the audio device 04 selects the transmission path 1 and the transmission path 4 as the target transmission path as an example. In actual applications, the distance between the audio device 04 and the audio device 05 may be relatively close. The distance between the audio device 04 and the audio device 05 is relatively close. The audio signal collected by the audio device 05 has a strong correlation with the audio signal collected by the audio device 04. For the audio device 04, the audio signal collected by the audio device 05 is There is less useful information, so the audio device 04 may not select the transmission path 4, which is not limited in the embodiment of the present application.

The second implementation manner: According to the topology information of the audio processing network and the current processing capability of each audio device in the audio processing network, the destination point is determined from the audio processing network as at least one target transmission path of the target audio device.

For example, please refer to FIG. 5, which shows a flow chart of a method for determining at least one target transmission path with a destination point as a target audio device provided by an embodiment of the present application. Referring to FIG. 5, the method may include the following steps :

Sub-step 2011C: Acquire the topology information of the audio processing network and the current processing capabilities of each audio device in the audio processing network.

Optionally, the management device of the audio processing network can maintain the topology information of the audio processing network, and the target audio device can obtain the topology information of the audio processing network from the management device, and the topology information can include the audio devices in the audio processing network. The connection relationship between. The management device may be any audio device in the audio processing network (for example, it may be an application audio device) or a device dedicated to managing the audio processing network, which is not limited in the embodiment of the present application.

Optionally, each audio device in the audio processing network can send its processing capability information to other audio devices in the audio processing network in real time or periodically. For example, each audio device can send information to other audio devices every 10 seconds or 60 seconds. The audio device broadcasts its own processing capability information. The target audio device may determine the current processing capability of each audio device in the audio processing network according to the processing capability information sent by each audio device that was received last time. Wherein, the processing capability information may include at least one of a CPU occupancy rate and absolute capability information, the absolute capability information, for example, the number of MIPS, the number of MOPS, or the number of MCPS.

Sub-step 2012C: According to the current processing capabilities of each audio device in the audio processing network, determine at least one cooperative audio device required by the target audio device from the audio processing network.

Optionally, the target audio device may determine at least one cooperative audio device required by the target audio device from the audio processing network according to business needs and the current processing capabilities of each audio device. The at least one cooperative audio device may be capable of serving as the target audio device. The business of audio equipment requires audio equipment that provides audio signals and has strong processing capabilities.

Optionally, the target audio device can sort the audio devices that can provide audio signals to the target audio device in the audio processing network in the order of processing capability from strong to weak, and according to the sorting result, it will be able to provide audio to the target audio device. Among the audio devices of the signal, at least one audio device with the highest processing capability is determined to be the at least one cooperative audio device. Alternatively, the target audio device may determine at least one audio device whose current processing capability is stronger than a preset processing capability among audio devices capable of providing audio signals to the target audio device as the at least one cooperative audio device. The preset processing capability may be characterized by preset processing capability information. The preset processing capability information may be at least one of a CPU occupancy rate and absolute capability information, such as MIPS number, MOPS number, or MCPS. number.

For example, taking Figure 1 as an example, audio device 04 may be the target audio device, the MIPS number of audio device 01 is greater than the preset MIPS number, the MOPS number of audio device 02 is greater than the preset MOPS number, and the CPU of audio device 03 is occupied The rate is greater than the preset CPU occupancy rate, and the MCPS number of audio device 05 is greater than the preset MCPS number, so audio device 04 can determine audio device 01, audio device 02, audio device 03, and audio device 05 as the audio device 04 At least one cooperative audio device is required.

Sub-step 2013C: According to the topology information of the audio processing network, at least one transmission path including the at least one cooperative audio device with the destination point as the target audio device is determined as the at least one target transmission path.

Optionally, the target audio device may determine, according to the topology information of the audio processing network, that the destination point is the target audio device and includes multiple transmission paths of the at least one cooperative audio device, and then select at least one transmission path from the multiple transmission paths A path serves as the at least one target transmission path, and the at least one target transmission path is the transmission path with the least number of paths among the multiple transmission paths whose destination is the target audio device and includes the at least one cooperative audio device, for example, the at least one A target transmission path is a transmission path in a combination of multiple transmission paths (each combination includes at least one transmission path) that includes the at least one cooperative audio device and has the least number of paths.

For example, taking Figure 1 as an example, audio device 04 may be a target audio device, audio device 01, audio device 02, audio device 03, and audio device 05 are cooperative audio devices of audio device 04, and audio device 04 is based on the audio processing network The multiple transmission paths that determine the destination point is the audio device 04 and include audio device 01, audio device 02, audio device 03, and audio device 05 may include:

Transmission path 3: Audio equipment 03->Audio equipment 04;

Transmission path 4: Audio equipment 05->Audio equipment 04;

The audio device 04 may determine the transmission path 1 and the transmission path 4 as the target transmission path. The combination of the transmission path 1 and the transmission path 4 includes the audio device 01, the audio device 02, the audio device 03, and the audio device 05, and the transmission path The combination of 1 and the transmission path 4 is the combination with the least number of paths among the combinations of the transmission path 1 to the transmission path 4.

Step 202: Send transmission instruction information to the audio device on each target transmission path, and the audio device on each target transmission path is used to transmit the audio signal through the target transmission path according to the received transmission instruction information.

After the target audio device determines from the audio processing network that the destination point is at least one target transmission path of the target audio device, it can send transmission instruction information to the audio device on each target transmission path to indicate the audio on each target transmission path The device transmits audio signals through the target transmission path.

Optionally, this step 202 may include two possible implementation manners:

The first implementation method: the target audio device sends removal instruction information to the audio device on each target transmission path, and the removal instruction information sent by the target audio device to the audio device on each target transmission path indicates that the audio device removal destination is The redundant transmission path among the multiple transmission paths of the target audio device and the audio signal is transmitted through the target transmission path, wherein the redundant transmission path is a transmission of the multiple transmission paths other than the at least one target transmission path path. Optionally, the first implementation manner may correspond to the first implementation manner in step 201.

Optionally, the removal instruction information sent by the target audio device to each audio device may carry the path information of the at least one target transmission path (the path information of each transmission path may include the device identification of the audio device on the transmission path, and The connection relationship between audio devices on the transmission path), each audio device determines its own redundant transmission path according to the path information of the target transmission path carried in the received removal instruction information and the path information of the transmission path where it is located , And remove the redundant transmission path. Alternatively, the removal instruction information sent by the target audio device to each audio device may carry path information of the redundant transmission path, and each audio device removes the redundant transmission according to the path information of the redundant transmission path carried in the received removal instruction information path. After the redundant transmission path is removed, the remaining transmission paths whose destination point is the target audio device are all target transmission paths, and each audio device can transmit audio signals through the target transmission path where it is located.

For example, taking Figure 1 as an example, corresponding to the first implementation in step 201, the destination point is the transmission path 1 to the transmission path 4 of the audio device 04, and the transmission path 1 and the transmission path 4 are the target transmission paths. Path 2 and transmission path 3 are redundant transmission paths. Audio device 04 can send removal instruction information to audio device 01, audio device 02, audio device 03, and audio device 05 on the target transmission path. The removal instruction information can carry the transmission path 1 and the path information of transmission path 4 (or carry path information of transmission path 2 and transmission path 3), audio equipment 01, audio equipment 02, audio equipment 03, and audio equipment 05 remove transmission path 2 and transmission path according to the removal instruction information 3. After the transmission path 2 and the transmission path 3 are removed, the audio equipment 01, the audio equipment 02, and the audio equipment 03 transmit audio signals to the audio equipment 04 through the transmission path 1, and the audio equipment 05 transmits the audio signals to the audio equipment 04 through the transmission path 2.

It is worth noting that the implementation of removing redundant transmission paths provided by the embodiments of the present application is only exemplary. In actual applications, the target audio device can send the target audio device to the previous hop device of the target audio device on each redundant transmission path. Sending the removal instruction information, so that the previous hop device removes the transmission path with the target audio device, thereby removing the redundant transmission path. Wherein, the last hop device of the target audio device may be an audio device that is adjacent to the target audio device on the target transmission path and is located before the target audio device according to the direction of the target transmission path. Taking Figure 1 as an example, the audio device 04 can send to the audio device 02 (the previous hop device of the audio device 04 on the transmission path 2) and the audio device 03 (the previous hop device of the audio device 04 on the transmission path 3) respectively. The removal instruction information instructs the audio device 02 to remove the transmission path 2 and instructs the audio device 03 to remove the transmission path 3. In the embodiment of the present application, removing the redundant transmission path may refer to removing the audio link corresponding to the redundant transmission path, and the underlying link may not be removed. By removing the redundant transmission path, the audio device can be prevented from passing through the redundancy. The transmission path transmits the audio signal to the target audio device, which helps to reduce the transmission bandwidth of the audio signal.

The second implementation method: the target audio device sends device indication information to the audio device on each target transmission path, and the device indication information sent by the target audio device to the audio device on each target transmission path indicates the audio on the target transmission path The next hop device of the device, each audio device can transmit an audio signal to the next hop device of the audio device according to the received device indication information. The next hop device of the audio device may be an audio device adjacent to the audio device on the target transmission path and located behind the audio device in the direction of the target transmission path. Optionally, the second implementation manner may correspond to the second implementation manner in step 201.

Optionally, for each target transmission path, the target audio device may send device indication information to each audio device on the target transmission path, and the target audio device sends device indication information to each audio device including the target transmission path and the audio The device identifier of the next hop device of the device to indicate the next hop device. Or, for each target transmission path, the target audio device may send device indication information including its own device identifier to the previous hop device of the target audio device on the target transmission path, so as to indicate itself to the previous hop device (That is, the target audio device); after receiving the device indication information, the previous hop device can send the device indication information including its own device identifier to the previous hop device of the previous hop device on the target transmission path, In this way, it indicates itself to the previous hop device, and so on, until the audio device at the starting point of the target transmission path receives the device indication information.

Illustratively, taking FIG. 1 as an example, corresponding to the second implementation manner of step 201, the transmission path 1 and the transmission path 4 are the target transmission paths of the audio device 04 as destination points. For transmission path 1, the audio device 04 can send device indication information containing the device identification ID-04 of the audio device 04 to the audio device 01 to instruct the audio device 04 (that is, the audio device 01 on the transmission path 1). One-hop device), sending device indication information including the device identification ID-01 of the audio device 01 to the audio device 02 to indicate the audio device 01 (that is, the next hop device of the audio device 02 on the transmission path 1), The device indication information including the device identification ID-02 of the audio device 02 is sent to the audio device 03 to indicate the audio device 02 (that is, the next hop device of the audio device 03 on the transmission path 1). Alternatively, the audio device 04 may send device indication information including the device identification ID-04 of the audio device 04 to the audio device 01 (that is, the previous hop device of the audio device 04 on the transmission path 1) to indicate the audio device 04. After the audio device 01 receives the device instruction information, it can send the audio device 01's device identification ID-01 to the audio device 02 (that is, the previous hop device of the audio device 01 on the transmission path 1) The device instruction information indicates the audio device 01. After receiving the device instruction information, the audio device 02 can send the audio device to the audio device 03 (that is, the previous hop device of the audio device 02 on the transmission path 1). The device identification information of the device identification ID-03 of 03 indicates the audio device 03. The same is true for transmission path 4, and will not be repeated here.

The above steps 201 to 202 are the path determination process provided by the embodiment of the present application. After the above steps 201 to 202, the target audio device can determine at least one target transmission path from the audio processing network. For example, please refer to FIG. 6, which shows a schematic diagram of at least one target transmission path in an audio processing network provided by an embodiment of the present application. As shown in FIG. 6, the audio processing network includes a destination point of an audio device. The two target transmission paths of 04, the two target transmission paths are: transmission path 1: audio equipment 03->audio equipment 02->audio equipment 01->audio equipment 04, and transmission path 4: audio equipment 05- >Audio equipment 04. Among at least one target transmission path determined by the target audio device from the audio processing network, any target transmission path may be the first transmission path. For example, the first transmission path may be the transmission path 1 or the transmission path 4 shown in FIG. 6. The signal transmission process will be described below by taking the audio device on the first transmission path transmitting the audio signal to the target audio device as an example.

For example, please refer to FIG. 7, which shows a method flowchart of a signal transmission method provided by an embodiment of the present application, and the signal transmission method can be applied to the implementation environment shown in FIG. 1. Referring to Figure 7, the method may include the following steps:

Step 701: The previous hop device of the first audio device sends an audio signal to the first audio device.

Optionally, the first audio device and the previous hop device of the first audio device may be any two adjacent audio devices on the first transmission path, and according to the direction of the first transmission path, the first audio device The previous hop device is located before the first audio device. It is easy to understand that the previous hop device of the first audio device may also have a previous hop device, and the previous hop device of the previous hop device of the first audio device may be located on the previous hop device of the first audio device Before. In the embodiments of the present application, for ease of description, the previous hop device of the first audio device may be called the second audio device, and the previous hop device of the first audio device may be called the third audio device. That is, the second audio device and the previous hop device of the first audio device described in the embodiments of this application refer to the same audio device, and the third audio device and the previous hop device of the first audio device The one-hop device refers to the same audio device. For example, the third audio device, the second audio device, and the first audio device are arranged in the direction of the first transmission path.

Optionally, the audio signal sent by the previous hop device of the first audio device to the first audio device may be an audio signal collected by a single audio device, or a mixed signal of audio signals collected by at least two audio devices. For example, the audio signal sent by the previous hop device of the first audio device to the first audio device may be the audio signal collected by the previous hop device of the first audio device, or the previous hop device of the first audio device. The audio signal collected by the hop device is processed, or the audio signal sent by the previous hop device of the first audio device to the first audio device may be the audio signal collected by the previous hop device of the first audio device and the audio signal A mixed signal of the audio signal collected by the previous hop device of the first audio device, and even the audio signal sent by the previous hop device of the first audio device to the first audio device may be the first transmission A mixed signal of audio signals collected by n audio devices located before the first audio device on the path, where n is an integer greater than or equal to 3, which is not limited in the embodiment of the present application.

For example, please refer to FIG. 8 to FIG. 10, which show three schematic diagrams of transmitting audio signals through the first transmission path provided by the embodiments of the present application, and FIG. 8 to FIG. 10 provide two first transmission paths. As shown in Figures 8 and 9, the audio equipment at the starting point of the first transmission path is audio equipment 02, and the audio equipment at the destination point is 04. The direction of the first transmission path can be from audio equipment 02 to audio equipment 04. Direction, the first audio device can be audio device 01, the last hop device of the first audio device can be audio device 02, and the audio device 02 is the audio device at the starting point of the first transmission path, so the audio device 02 has no For the last hop device, the audio signal sent by the audio device 02 to the audio device 01 may be the audio signal collected by the audio device 02 or obtained by processing the audio signal collected by the audio device 02. As shown in Figure 10, the audio device at the starting point of the first transmission path is audio device 03, and the audio device at the destination point is 04. The direction of the first transmission path can be from audio device 03 to audio device 04. An audio device can be audio device 01, the previous hop device of the first audio device can be audio device 02, the previous hop device of the first audio device can be audio device 03, and audio device 03 is The audio device at the starting point of the first transmission path, so the audio device 03 has no previous hop device, and the audio signal sent by the audio device 02 to the audio device 01 can be the audio signal collected by the audio device 02 and the audio device 03. The mixed signal of the audio signal.

In the application embodiment, in view of the difference in the audio signal sent by the previous hop device of the first audio device to the first audio device, this step 701 may include three possible implementation manners:

The first implementation manner: the audio signal sent by the previous hop device of the first audio device to the first audio device is an audio signal collected by the previous hop device of the first audio device.

Optionally, the previous hop device of the first audio device may have an audio collection component, and the previous hop device of the first audio device can collect audio signals through the audio collection component, and send the audio signal to the first audio device . The audio signal collected by the previous hop device of the first audio device may be a digital signal. For example, the audio signal collected by the previous hop device of the first audio device may be a digitized audio sequence containing data of N sampling points. Wherein, each sampling point data may be represented by a fixed bit, and the fixed bit may be, for example, 16 bits.

For example, as shown in FIG. 8, the first audio device may be audio device 01, the previous hop device of the first audio device may be audio device 02, and the audio signal collected by audio device 02 may be g2(n), n =0,1,...,N-1, the audio device 02 can send the audio signal g2(n) to the audio device 01.

The second implementation manner: the audio signal sent by the previous hop device of the first audio device to the first audio device is obtained by processing the audio signal collected by the previous hop device of the first audio device.

Optionally, the previous hop device of the first audio device may collect the audio signal, then process the collected audio signal, and send the audio signal to the first audio device after the processing. Optionally, each audio device in the audio processing network may have an audio processing function, and the previous hop device of the first audio device may adopt the audio processing function of the previous hop device of the first audio device to the first audio The audio signal collected by the last hop of the device is processed. For example, the previous hop device of the first audio device uses the audio processing function of the previous hop device of the first audio device to convolve the audio signal collected by the previous hop device of the first audio device.

For example, as shown in FIG. 9, the first audio device may be audio device 01, the previous hop device of the first audio device may be audio device 02, and the audio signal collected by audio device 02 may be g2(n), which The audio processing function of audio device 02 can be h2(n), audio device 02 can send audio signal y2(n) to audio device 01, y2(n)=g2(n)*h2(n), the symbol "*" means Convolution, the audio signal y2(n) is obtained by convolving the audio signal g2(n) collected by the audio device 02 according to the audio processing function h2(n) of the audio device 02.

A third implementation manner: the audio signal sent by the previous hop device of the first audio device to the first audio device is a mixed signal of audio signals collected by at least two audio devices.

Optionally, the previous hop device of the first audio device may obtain audio signals collected by at least two audio devices, mix the audio signals collected by the at least two audio devices to obtain a mixed signal, and send the mixed signal to the first audio device The mixed signal. Optionally, each audio device in the audio processing network may have an audio processing function, and for each audio device of the at least two audio devices, the previous hop device of the first audio device may adopt the audio of the audio device The processing function processes the audio signal collected by the audio device to obtain a processed signal of the audio device, and superimposes the processed signals of the at least two audio devices to obtain a mixed signal. Optionally, for each audio device of the at least two audio devices, the previous hop device of the first audio device may use the audio processing function of the audio device to convolve the audio signal collected by the audio device to obtain the The processing signal of the audio device.

In the embodiment of the present application, the at least two audio devices may include the previous hop device (that is, the second audio device) of the first audio device and the previous hop device ( That is the third audio device). The at least two audio devices are the previous hop device of the first audio device (that is, the second audio device) and the previous hop device of the previous hop device of the first audio device (that is, the third audio device). Equipment) as an example. The second audio device can collect audio signals, and the second audio device can receive audio signals sent by the third audio device. The second audio device can use the audio processing function of the second audio device to collect audio from the second audio device. The signal is convolved to obtain the processed signal of the second audio device, and the audio processing function of the third audio device is used to convolve the audio signal collected by the third audio device to obtain the processed signal of the third audio device. The second audio device superimposes the processed signal of the second audio device and the processed signal of the third audio device to obtain a mixed signal.

For example, as shown in FIG. 10, the first audio device is audio device 01, and the previous hop device (that is, the second audio device) of the first audio device is audio device 02, and the previous hop device of the first audio device is audio device 02. The last hop device of the hop device (that is, the third audio device) is audio device 03, the audio signal collected by audio device 02 can be g2(n), the audio processing function of audio device 02 can be h2(n), audio The processing signal of device 02 can be g2(n)*h2(n), the audio signal collected by audio device 03 can be g3(n), the audio processing function of audio device 03 can be h3(n), the processing of audio device 03 The signal can be g3(n)*h3(n), audio device 02 can send audio signal y2(n) to audio device 01, y2(n)=g2(n)*h2(n)+g3(n)*h3 (n), the symbol "*" means convolution, means "+" means superposition, the audio signal y2(n) is the audio signal g2(n) collected by audio device 02 and the audio signal g3(n) collected by audio device 03 Mixed signal.

Those skilled in the art can easily understand that the audio signal g3(n) collected by the audio device 03 (that is, the previous hop device of the first audio device) may be a digital signal, and the audio signal g3(n) may Contains N sampling point data, and each sampling point data can be represented by a fixed bit. The audio signal g3(n) can be sent from the audio device 03 to the audio device 02 (that is, the previous hop device of the first audio device). The process of sending the audio signal from the audio device 03 to the audio device 02 can refer to the step 701. The first implementation manner and the second implementation manner are not described in detail in the embodiments of the present application. It is worth noting that if the audio device 03 refers to the second implementation of step 701 to send an audio signal to the audio device 02, as shown in FIG. ) The audio signal y3(n) obtained by processing, the audio device 02 can first restore the audio signal g3(n) from the audio signal y3(n). The embodiments of the present application describe the audio signal restoration process in detail below, and will not be repeated here.

It is worth noting that when the previous hop device of the first audio device (that is, the second audio device) sends an audio signal to the first audio device, source information can be added to the audio signal sent to the first audio device To indicate the source of the audio signal, the source information may be the device identifier of the audio device, indicating that the audio signal originates from the audio device indicated by the device identifier. Optionally, the source information added by the previous hop device of the first audio device to the audio signal sent to the first audio device includes at least the device identifier of the previous hop device of the first audio device, indicating the first audio device The audio signal sent by the previous hop device of the device includes the audio signal collected by the previous hop device of the first audio device. Optionally, the source information added by the previous hop device of the first audio device to the audio signal sent to the first audio device may also include the previous hop device of the previous hop device of the first audio device (also That is, the device identifier of the third audio device), indicating that the audio signal sent by the previous hop device of the first audio device includes the audio signal collected by the previous hop device of the first audio device. Exemplarily, the source information added by the previous hop device of the first audio device to the audio signal sent to the first audio device includes the device identifier of the previous hop device of the first audio device and the device identification of the first audio device. The device identifier of the previous hop device of the previous hop device, indicating that the audio signal sent by the previous hop device of the first audio device is the audio signal collected by the previous hop device of the first audio device and the audio signal of the first audio device The mixed signal of the audio signal collected by the previous hop device.

Step 702: The first audio device receives the audio signal sent by the previous hop device of the first audio device.

The previous hop device corresponding to the first audio device (that is, the second audio device) sends an audio signal to the first audio device, and the first audio device can receive the audio sent by the previous hop device of the first audio device Signal.

For example, as shown in FIG. 8, the audio device 01 receives the audio signal g2(n) sent by the audio device 02, or, as shown in FIGS. 9 and 10, the audio device 01 receives the audio signal y2(n) sent by the audio device 02. ).

Step 703: The first audio device obtains the audio signal collected by the first audio device.

Optionally, the first audio device may have an audio collection component, and the first audio device can collect audio signals through the audio collection component. The audio signal collected by the first audio device may be a digital signal, and the audio signal collected by the first audio device may include N sampling point data, and each sampling point data may be represented by a fixed bit, and the fixed bit may be, for example, 16 bits. .

For example, as shown in FIGS. 8 to 10, the first audio device may be audio device 01, and the audio signal collected by audio device 01 may be g1(n), n=0,1,...,N-1.

Step 704: The first audio device mixes the audio signal collected by the first audio device and the audio signal sent by the previous hop device of the first audio device to obtain a mixed audio signal.

As mentioned earlier, the audio signal sent by the previous hop device of the first audio device (that is, the second audio device) to the first audio device can be an audio signal collected by a single audio device, or at least two audio signals. The mixed signal of the audio signal collected by the device. In the embodiment of the present application, the first audio device may superimpose the audio signal collected by the first audio device and the audio signal sent to the first audio device by the previous hop device of the first audio device to obtain a mixed audio signal. The audio signal collected by each audio device can be recovered from the audio signal sent by the previous hop device of the first audio device to the first audio device, and then the recovered audio device can collect the audio signal with the first audio device. The audio signal is mixed to obtain a mixed audio signal. According to the difference in the audio signal sent by the previous hop device of the first audio device and the difference in the mixing mode, this step 704 may include the following four possible implementation modes:

The first implementation manner: the audio signal sent by the last hop device of the first audio device is a mixed signal of the audio signals collected by at least two audio devices (for example, the audio signal sent by the last hop device of the first audio device is the first audio signal). A mixed signal of the audio signal collected by the previous hop device of an audio device and the audio signal collected by the previous hop device of the first audio device), or sent by the previous hop device of the first audio device The audio signal is obtained by processing the audio signal collected by the previous hop device of the first audio device.

For example, please refer to FIG. 11, which shows a flow chart of a method for mixing an audio signal collected by a first audio device with an audio signal sent by the previous hop device of the first audio device according to an embodiment of the present application, see Figure 11, the method can include the following steps:

Sub-step 7041A: Use the audio processing function of the first audio device to process the audio signal collected by the first audio device to obtain the processed signal of the first audio device.

Optionally, the first audio device may use the audio processing function of the first audio device to convolve the audio signal collected by the first audio device to obtain the processed signal of the first audio device.

For example, the audio signal collected by the first audio device may be g1(n), and the audio processing function of the first audio device may be h1(n), so the processed signal of the first audio device may be g1(n)* h1(n), the symbol "*" means convolution.

Sub-step 7042A: superimpose the processed signal of the first audio device and the audio signal sent by the previous hop device of the first audio device to obtain a mixed audio signal.

For example, the mixed audio signal may be y1(n), y1(n)=y2(n)+g1(n)*h1(n), the symbol "*" represents convolution, and the symbol "+" represents superimposition.

It is worth noting that in the first implementation of step 704, the first audio device does not need to recover the original audio signal collected by each audio device from the audio signal sent by the previous hop device of the first audio device. Helps simplify the signal mixing process and reduce the amount of calculation in the signal mixing process.

The second implementation manner: the audio signal sent by the previous hop device of the first audio device is a mixed signal of audio signals collected by at least two audio devices.

For example, please refer to FIG. 12, which shows a flowchart of another method for mixing an audio signal collected by a first audio device with an audio signal sent by the previous hop device of the first audio device according to an embodiment of the present application. Referring to Figure 12, the method may include the following steps:

Sub-step 7041B: recover the audio signals collected by at least two audio devices from the audio signals sent by the last hop device of the first audio device.

Optionally, the audio signal sent by the previous hop device of the first audio device (that is, the second audio device) can carry source information, and the first audio device can be based on the audio signal sent by the previous hop device of the first audio device. The source information carried by the signal determines that the audio signal sent by the last hop device of the first audio device is a mixed signal of the audio signals collected by at least two audio devices, and then the first audio signal can be obtained from the first audio device according to the audio processing functions of the at least two audio devices. The audio signals collected by the at least two audio devices are recovered from the audio signals sent by the last hop device of an audio device. Optionally, the first audio device may respectively use the audio processing functions of the at least two audio devices to convolve the audio signal sent by the previous hop device of the first audio device to The audio signal sent by the jumping device is separated into at least two signal parts corresponding to the at least two audio devices one-to-one, and then the audio signal collected by the audio device is recovered from the signal part corresponding to each audio device.

Optionally, the first audio device separating the audio signal sent by the last hop device of the first audio device into at least two parts corresponding to the at least two audio devices one-to-one may include: For each audio device, the first audio device uses the audio processing function of the audio device to convolve the audio signal sent by the previous hop device of the first audio device to obtain the convolution signal corresponding to the audio device, and the audio device The corresponding convolution signal is also the signal part corresponding to the audio device separated from the audio signal sent by the previous hop device of the first audio device. The first audio device recovering the audio signal collected by the audio device from the signal portion corresponding to each audio device may include: the first audio device converts the convolution signal corresponding to the audio device to the frequency domain for processing to obtain the audio device After the corresponding audio signal in the frequency domain is converted into the time domain, the audio signal collected by the audio device can be obtained. Optionally, the first audio device may use fast Fourier transform (FFT) or discrete cosine transform (DCT) to convert the convolution signal to the frequency domain, and use FFT inverse transform or DCT inverse transform Convert the audio signal in the frequency domain to the time domain.

In the embodiment of the present application, the audio signal sent by the previous hop device of the first audio device to the first audio device may be a mixed signal of audio signals collected by at least two audio devices, and the at least two audio devices may include the The previous hop device of the first audio device (that is, the second audio device) and the previous hop device of the previous hop device of the first audio device (that is, the third audio device). The at least two audio devices are the previous hop device of the first audio device (that is, the second audio device) and the previous hop device of the previous hop device of the first audio device (that is, the third audio device). Equipment) as an example. The source information carried by the audio signal sent by the second audio device to the first audio device may include the device identification of the second audio device and the device identification of the third audio device, and the first audio device may be based on the device identification of the second audio device. The identifier and the device identifier of the third audio device determine that the audio signal sent by the second audio device is a mixed signal of the audio signal collected by the second audio device and the audio signal collected by the third audio device. The first audio device uses the audio processing function of the second audio device to convolve the audio signal sent by the second audio device to obtain the convolution signal corresponding to the second audio device, and uses the audio processing function of the third audio device Perform convolution on the audio signal sent by the third audio device to obtain a convolution signal corresponding to the third audio device. The first audio device converts the convolution signal corresponding to the second audio device to the frequency domain for processing, obtains the audio signal corresponding to the second audio device in the frequency domain, and converts the convolution signal corresponding to the third audio device to the frequency domain. Processing in the frequency domain to obtain the audio signal corresponding to the third audio device in the frequency domain. After that, the first audio device converts the audio signal corresponding to the second audio device in the frequency domain to the time domain to obtain the audio signal collected by the second audio device. The audio signal is converted to the time domain corresponding to the audio signal of the third audio device in the frequency domain to obtain the audio signal collected by the third audio device.

For example, as shown in FIG. 10, the first audio device is audio device 01, and the previous hop device (that is, the second audio device) of the first audio device is audio device 02, and the previous hop device of the first audio device is audio device 02. The last hop device of the hop device (that is, the third audio device) is audio device 03, and the audio signal y2(n) sent by audio device 02 to audio device 01 includes audio signal g2(n) and audio collected by audio device 02 The audio signal g3(n) collected by device 03, the audio processing function of audio device 02 can be h2(n), the audio processing function of audio device 03 can be h3(n), the audio signal sent by audio device 01 from audio device 02 The process of recovering the audio signal g2(n) collected by audio device 02 and the audio signal g3(n) collected by audio device 03 from y2(n) can be as follows:

1) The audio device 01 uses the audio processing function h2(n) of the audio device 02 and the audio processing function h3(n) of the audio device 03 to convolve the audio signal y2(n) sent by the audio device 02 to obtain the The audio signal y2(n) sent by the audio device 02 separates the signal part of the audio device 02 and the signal part of the audio device 03. Among them, the process of convolution is as follows:

y2(n)*h2(n)=[g2(n)*h2(n)+g3(n)*h3(n)]*h2(n) Formula (1);

y2(n)*h3(n)=[g2(n)*h2(n)+g3(n)*h3(n)]*h3(n) Formula (2);

In the embodiment of this application, the audio processing functions of different audio devices are uncorrelated, and the result of uncorrelated signal convolution is approximately 0. Therefore, in the above equations (1) and (2), g3(n)*h3(n )*h2(n) is approximately 0, g2(n)*h2(n)*h3(n) is approximately 0, so the above equations (1) and (2) can be approximately simplified to the following equations (3) and ( 4):

y2(n)*h2(n)=g2(n)*h2(n)*h2(n) Formula (3);

y2(n)*h3(n)=g3(n)*h3(n)*h3(n) Formula (4);

Among them, g2(n)*h2(n)*h2(n) is the signal part of audio device 02 (that is, the convolution signal corresponding to audio device 02), g3(n)*h3(n)*h3(n ) Is the signal part of the audio device 03 (that is, the convolution signal corresponding to the audio device 03).

2) Audio device 01 recovers the audio signal g2(n) collected by audio device 02 from the signal part of audio device 02 (that is, the convolution signal corresponding to audio device 02), from the signal part of audio device 03 (also That is, the audio signal g3(n) collected by the audio device 03 is recovered from the convolution signal corresponding to the audio device 03. Among them, the recovery process is as follows:

First, the following equations (5) and (6) are used to convert the convolution signal corresponding to audio device 02 and the convolution signal corresponding to audio device 03 to the frequency domain, respectively, to obtain the convolution signal and audio corresponding to audio device 02 in the frequency domain. The corresponding convolution signal of device 03 in the frequency domain.

y2(n)*h2(n)=g2(n)*h2(n)*h2(n)——>Y2(w)*H2(w)=G2(w)*H2(w)*H2(w ) Formula (5);

y2(n)*h3(n)=g3(n)*h3(n)*h3(n)——>Y2(W)*H3(W)=G3(W)*H3(W)*H3(W ) Formula (6);

Y2(W) represents the frequency domain signal of the audio signal y2(n) (that is, the signal corresponding to the audio signal y2(n) in the frequency domain), and G2(w) represents the frequency domain signal of the audio signal g2(n) (also That is, the audio signal g2(n) corresponds to the signal in the frequency domain), H2(w) represents the frequency domain function of the audio processing function h2(n) (that is, the audio processing function h2(n) corresponds to the function in the frequency domain) , G2(w)*H2(w)*H2(w) represents the frequency domain signal of the convolution signal g2(n)*h2(n)*h2(n), which is the corresponding volume of the audio device 02 in the frequency domain Product signal, G3(W) represents the frequency domain signal of the audio signal g3(n) (that is, the signal corresponding to the audio signal g3(n) in the frequency domain), H3(W) represents the frequency of the audio processing function h3(n) Domain function (that is, the corresponding function of the audio processing function h3(n) in the frequency domain), G3(w)*H3(w)*H3(w) represents the convolution signal g3(n)*h3(n)*h3 The frequency domain signal of (n) is the corresponding convolution signal of the audio device 03 in the frequency domain.

Next, use the following formula (7) to divide the corresponding convolution signal of the audio device 02 in the frequency domain by the square of the frequency domain function H2(w) of the audio processing function h2(n) of the audio device 02 to obtain the audio device 02 in For the corresponding audio signal G2(w) in the frequency domain, use the following formula (8) to divide the corresponding convolution signal of the audio device 03 in the frequency domain by the frequency domain function H3(w ) Is squared to obtain the audio signal G3(w) corresponding to the audio device 03 in the frequency domain. Among them, the symbol "/" represents the division sign.

Y2(w)*H2(w)/H2(w)*H2(w)=G2(w)*H2(w)*H2(w)/H2(w)*H2(w)=G2(w) (7);

Y2(W)*H3(W)/H3(W)*H3(W)=G3(W)*H3(W)*H3(W)/H3(W)*H3(W)=G3(W) (8);

Finally, the following formula (9) is used to convert the corresponding audio signal G2(w) of the audio device 02 in the frequency domain to the time domain to obtain the audio signal g2(n) collected by the audio device 02, and the following formula (10) is used to convert the audio device 03 The corresponding audio signal G3(w) in the frequency domain is converted to the time domain to obtain the audio signal g3(n) collected by the audio device 03.

G2(w)——>g2(n) Formula (9);

G3(w)——>g3(n) Formula (10).

Sub-step 7042B: For each audio device of the first audio device and the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device.

Optionally, the at least two audio devices are the previous hop device (that is, the second audio device) of the first audio device and the previous hop device (that is, the second audio device) of the first audio device The third audio device) is taken as an example. The first audio device may use the audio processing function of the first audio device to convolve the audio signal collected by the first audio device to obtain the processing signal of the first audio device, and use the audio processing function of the second audio device to The audio signal collected by the second audio device is convolved to obtain the processed signal of the second audio device, and the audio processing function of the third audio device is used to convolve the audio signal collected by the third audio device to obtain the first audio signal. Three audio equipment processing signals.

For example, as shown in FIG. 10, the first audio device is audio device 01, and the previous hop device (that is, the second audio device) of the first audio device is audio device 02, and the previous hop device of the first audio device is audio device 02. The last hop device of the hop device (that is, the third audio device) is the audio device 03. The audio signal collected by the audio device 01 may be g1(n), the audio processing function of the audio device 01 may be h1(n), and the processing signal of the audio device 01 may be g1(n)*h1(n). The audio signal collected by the audio device 02 may be g2(n), the audio processing function of the audio device 02 may be h2(n), and the processing signal of the audio device 02 may be g2(n)*h2(n). The audio signal collected by the audio device 03 may be g3(n), the audio processing function of the audio device 02 may be h3(n), and the audio processing signal of the audio device 03 may be g3(n)*h3(n). The symbol "*" means convolution.

Sub-step 7043B: superimpose the processed signal of the first audio device and the processed signal of the at least two audio devices to obtain a mixed audio signal.

For example, as shown in FIG. 10, the mixed audio signal may be y1(n), y1(n)=g1(n)*h1(n)+g2(n)*h2(n)+g3(n)* h3(n), the symbol "*" means convolution, and the symbol "+" means superimposition.

The third implementation manner: the audio signal sent by the previous hop device of the first audio device is the audio signal collected by the previous hop device of the first audio device.

For example, please refer to FIG. 13, which shows a flowchart of still another method for mixing audio signals collected by a first audio device with audio signals sent by a previous hop device of the first audio device according to an embodiment of the present application. Referring to Figure 13, the method may include the following steps:

Sub-step 7041C. For each audio device in the first audio device and the previous hop device of the first audio device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the audio device Processing signal.

Optionally, the audio signal sent by the previous hop device of the first audio device (that is, the second audio device) to the first audio device can carry source information, and the first audio device can be based on the previous hop of the first audio device. The source information carried in the audio signal sent by the one-hop device determines that the audio signal sent by the previous hop device of the first audio device is the audio signal collected by the previous hop device of the first audio device. For example, the source information carried in the audio signal sent by the previous hop device of the first audio device to the first audio device includes the device identifier of the previous hop device of the first audio device, and the first audio device is based on the first audio device. The device identifier of the previous hop device of the audio device determines that the audio signal sent by the previous hop device of the first audio device is the audio signal collected by the previous hop device of the first audio device.

Optionally, the first audio device may use the audio processing function of the first audio device to convolve the audio signal collected by the first audio device to obtain the processed signal of the first audio device. The audio processing function of the previous hop device convolves the audio signal collected by the previous hop device of the first audio device to obtain the processed signal of the previous hop device of the first audio device.

For example, as shown in FIG. 8, the first audio device is audio device 01, and the previous hop device (that is, the second audio device) of the first audio device is audio device 02. The audio signal collected by the audio device 01 may be g1(n), the audio processing function of the audio device 01 may be h1(n), and the processing signal of the audio device 01 may be g1(n)*h1(n). The audio signal collected by the audio device 02 may be g2(n), the audio processing function of the audio device 02 may be h2(n), and the processing signal of the audio device 02 may be g2(n)*h2(n). The symbol "*" means convolution.

Sub-step 7042C: superimpose the processed signal of the first audio device and the processed signal of the previous hop device of the first audio device to obtain a mixed audio signal.

For example, as shown in Fig. 8, the mixed audio signal may be y1(n), y1(n)=g1(n)*h1(n)+g2(n)*h2(n), and the symbol "*" means Convolution, the symbol "+" means superposition.

A fourth implementation manner: the audio signal sent by the previous hop device of the first audio device is obtained by processing the audio signal collected by the previous hop device of the first audio device.

For example, please refer to FIG. 14, which shows a flow chart of another method for mixing an audio signal collected by a first audio device with an audio signal sent by a previous hop device of the first audio device according to an embodiment of the present application. Referring to Figure 14, the method may include the following steps:

Sub-step 7041D: recover the audio signal collected by the previous hop device of the first audio device from the audio signal sent by the previous hop device of the first audio device.

Optionally, the audio signal sent by the previous hop device of the first audio device (that is, the second audio device) to the first audio device can carry source information, and the first audio device can be based on the previous hop of the first audio device. The source information carried by the audio signal sent by the one-hop device determines that the audio signal sent by the previous-hop device of the first audio device is obtained by processing the audio signal collected by the previous-hop device of the first audio device. For example, the source information carried in the audio signal sent by the previous hop device of the first audio device to the first audio device includes the device identifier of the previous hop device of the first audio device, and the first audio device is based on the first audio device. The device identifier of the previous hop device of the audio device determines that the audio signal sent by the previous hop device of the first audio device is obtained by processing the audio signal collected by the previous hop device of the first audio device.

Optionally, the first audio device may restore the previous audio signal of the first audio device from the audio signal sent by the previous hop device of the first audio device according to the audio processing function of the previous hop device of the first audio device. Jump the audio signal collected by the device. For example, the first audio device may use the audio processing function of the previous hop device of the first audio device to convolve the audio signal sent by the previous hop device of the first audio device to obtain the upper hop of the first audio device. The convolution signal corresponding to the one-hop device, and then the convolution signal corresponding to the previous hop device of the first audio device is converted to the frequency domain for processing, and the audio corresponding to the previous hop device of the first audio device in the frequency domain is obtained Then, the audio signal corresponding to the previous hop device of the first audio device in the frequency domain is converted to the time domain to obtain the audio signal collected by the previous hop device of the first audio device.

For example, taking Figure 9 as an example, the first audio device is audio device 01, the previous hop device of the first audio device (that is, the second audio device) is audio device 02, and audio device 02 sends audio device 01 The audio signal y2(n) is obtained by processing the audio signal g2(n) collected by the audio device 02, the audio processing function of the audio device 02 can be h2(n), the audio device 01 sends the audio signal from the audio device 02 The process of recovering the audio signal g2(n) collected by audio device 02 from y2(n) can be as follows:

1) The audio device 01 uses the audio processing function h2(n) of the audio device 02 to convolve the audio signal y2(n) sent by the audio device 02 to obtain the convolution signal corresponding to the audio device 02. Among them, the process of convolution is as follows:

y2(n)*h2(n)=[g2(n)*h2(n)]*h2(n)=g2(n)*h2(n)*h2(n) Formula (11);

Among them, g2(n)*h2(n)*h2(n) may be the convolution signal corresponding to the audio device 02.

2) The audio device 01 recovers the audio signal g2(n) collected by the audio device 02 from the convolution signal corresponding to the audio device 02. Among them, the recovery process is as follows:

First, the following equation (12) is used to convert the convolution signal corresponding to the audio device 02 to the frequency domain, and the convolution signal corresponding to the audio device 02 in the frequency domain is obtained.

y2(n)*h2(n)=g2(n)*h2(n)*h2(n)——>Y2(w)*H2(w)=G2(w)*H2(w)*H2(w ) Formula (12);

Then, use the following formula (13) to divide the corresponding convolution signal of the audio device 02 in the frequency domain by the square of the frequency domain function H2(w) of the audio processing function h2(n) of the audio device 02 to obtain the audio device 02 in The corresponding audio signal G2(w) in the frequency domain. Among them, the symbol "/" represents the division sign.

Y2(w)*H2(w)/H2(w)*H2(w)=G2(w)*H2(w)*H2(w)/H2(w)*H2(w)=G2(w) (13);

Finally, the following formula (14) is used to convert the corresponding audio signal G2(w) of the audio device 02 in the frequency domain to the time domain to obtain the audio signal g2(n) collected by the audio device 02.

G2(w)——>g2(n) Formula (14).

Sub-step 7042D. For each audio device in the first audio device and the previous hop device of the first audio device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the audio device Processing signal.

Optionally, the first audio device may use the audio processing function of the first audio device to convolve the audio signal collected by the first audio device to obtain the processed signal of the first audio device. The audio processing function of the previous hop device (that is, the second audio device) convolves the audio signal collected by the previous hop device of the first audio device to obtain the processed signal of the previous hop device of the first audio device .

For example, as shown in FIG. 9, the first audio device is audio device 01, the previous hop device (that is, the second audio device) of the first audio device is audio device 02, and the audio signal collected by audio device 01 can be If it is g1(n), the audio processing function of the audio device 01 can be h1(n), and the processing signal of the audio device 01 can be g1(n)*h1(n). The audio signal collected by the audio device 02 may be g2(n), the audio processing function of the audio device 02 may be h2(n), and the processing signal of the audio device 02 may be g2(n)*h2(n). Among them, the symbol "*" means convolution.

Sub-step 7043D: superimpose the processed signal of the first audio device and the processed signal of the previous hop device of the first audio device to obtain a mixed audio signal.

For example, as shown in Figure 9, the mixed audio signal may be y1(n), y1(n)=g1(n)*h1(n)+g2(n)*h2(n), and the symbol "*" means Convolution, the symbol "+" means superposition.

Step 705: The first audio device sends the mixed audio signal to the next hop device of the first audio device.

As described above, it is easy to understand that the mixed audio signal may be a mixed signal of audio signals collected by at least two audio devices. Wherein, the first audio device and the next hop device of the first audio device may be any two adjacent audio devices on the first transmission path, and according to the direction of the first transmission path, the next hop device of the first audio device The one-hop device is located after the first audio device. Optionally, the next hop device of the first audio device may be the target audio device or not the target audio device, the target audio device is the audio device at the destination point of the first transmission path, if the first audio device The next hop device of is the target audio device, and the first audio device is also the previous hop device of the target audio device.

Optionally, when the first audio device sends the mixed audio signal to the next hop device (for example, the target audio device) of the first audio device, source information may be added to the mixed audio signal to indicate the source of the mixed audio signal, The source information may be the device identifier of the audio device, indicating that the mixed audio signal originates from the audio device indicated by the device identifier. The source information added by the first audio device to the mixed audio signal at least includes the device identifier of the first audio device, indicating that the mixed audio signal includes the audio signal collected by the first audio device.

For example, for the first implementation in step 704, since the audio signal sent by the previous hop device of the first audio device (that is, the second audio device) to the first audio device already contains the first audio device The source information of the audio signal sent by the previous hop device (for example, the audio signal sent by the previous hop device of the first audio device to the first audio device already contains the device ID and the device ID of the previous hop device of the first audio device The device identifier of the last hop device of the first audio device), so the first audio device can add the device identifier of the first audio device to the mixed audio signal.

For example, for the second implementation in step 704, the first audio device can add the device identifier of the first audio device and the previous hop device of the first audio device (that is, the second audio device) to the mixed audio signal. ) And the device identification of the previous hop device (that is, the third audio device) of the previous hop device of the first audio device, indicating that the mixed audio signal is the audio signal collected by the first audio device, A mixed signal of the audio signal collected by the previous hop device of the audio device and the audio signal collected by the previous hop device of the first audio device. As shown in Figure 10, the source information in the mixed audio signal y1(n) can include the device identification ID-01 of the audio device 01, the device identification ID-02 of the audio device 02 and the device identification ID-03 of the audio device 03, indicating The mixed audio signal y1(n) is a mixed signal of the audio signal of the audio device 01, the audio signal of the audio device 02, and the audio signal of the audio device 03.

For example, for the third and fourth implementations in step 704, the first audio device may add the device identification of the first audio device and the previous hop device of the first audio device to the mixed audio signal ( That is, the device identifier of the second audio device), indicating that the mixed audio signal is a mixed signal of the audio signal collected by the first audio device and the audio signal collected by the previous hop device of the first audio device. As shown in Figures 8 and 9, the source information in the mixed audio signal y1(n) may include the device identification ID-01 of the audio device 01 and the device identification ID-02 of the audio device 02, indicating that the mixed audio signal y1(n ) Is a mixed signal of the audio signal of audio device 01 and the audio signal of audio device 02.

Step 706: The next hop device of the first audio device receives the mixed audio signal sent by the first audio device.

Corresponding to the first audio device sending the mixed audio signal to the next hop device of the first audio device (for example, the target audio device), the next hop device of the first audio device can receive the mixed audio signal sent by the first audio device .

Exemplarily, as shown in FIGS. 8 to 10, the audio device 04 receives the mixed audio signal y1(n) sent by the audio device 01.

Step 707: The next hop device of the first audio device recovers the audio signals collected by at least two audio devices from the mixed audio signal.

As mentioned above, it is easy to understand that in the embodiment of the present application, the mixed audio signal is the audio signal collected by the first audio device from the first audio device and the previous hop device of the first audio device (that is, the second The audio device is obtained by mixing the audio signal sent by the audio signal sent by the first audio device, so the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices. Optionally, the mixed audio signal may carry source information, and the next hop device of the first audio device (for example, the target audio device) may determine that the mixed audio signal is the at least two audio devices according to the source information carried by the mixed audio signal The collected audio signal is a mixed signal, and then the audio signal collected by the at least two audio devices is recovered from the mixed audio signal according to the audio processing functions of the at least two audio devices.

For example, the mixed audio signal is the audio signal collected by the first audio device, the audio signal collected by the previous hop device of the first audio device (that is, the second audio device), and the previous audio signal of the first audio device. Take the mixed signal of the audio signal collected by the previous hop device (that is, the third audio device) of the hop device as an example. The next hop device of the first audio device (for example, the target audio device) may determine, according to the source information carried by the mixed audio signal, that the mixed audio signal is the audio signal collected by the first audio device and the audio signal collected by the second audio device And the mixed signal of the audio signal collected by the third audio device, and then from the mixed audio signal according to the audio processing function of the first audio device, the audio processing function of the second audio device, and the audio processing function of the third audio device The audio signal collected by the first audio device, the audio signal collected by the second audio device, and the audio signal collected by the third audio device are recovered.

As another example, it is taken as an example that the mixed audio signal is the audio signal collected by the first audio device and the audio signal collected by the previous hop device of the first audio device (that is, the second audio device). The next hop device of the first audio device (for example, the target audio device) may determine, according to the source information carried by the mixed audio signal, that the mixed audio signal is the audio signal collected by the first audio device and the previous hop device of the first audio device The mixed signal of the collected audio signal, and then the audio collected by the first audio device is recovered from the mixed audio signal according to the audio processing function of the first audio device and the audio processing function of the previous hop device of the first audio device Signal and the audio signal collected by the previous hop device of the first audio device.

It is worth noting that, in this step 707, the next hop device of the first audio device (for example, the target audio device) recovers the audio signals collected by at least two audio devices from the mixed audio signal, which can refer to the foregoing sub-steps. The implementation process of 7041B will not be repeated in this embodiment of the application.

In the embodiment of the present application, the target audio device may be an application audio device in an audio processing network. After the target audio device recovers the audio signals collected by at least two audio devices from the mixed audio signal, the at least two audio devices may be used The collected audio signal. For example, the target audio device implements 3D sound playback or spatial voice enhancement based on the audio signals collected by the at least two audio devices.

In the embodiment of the present application, the audio signal recovered by the target audio device may have redundant signals. In this case, the target audio device may de-redundant the recovered audio signal before applying it. For example, if the audio signal recovered by the target audio device contains multiple audio signals of a certain audio device, then the audio signal of the certain audio device in the audio signal recovered by the target audio device has redundant signals, and the target audio device may De-redundancy of the audio signal of a certain audio device.

Optionally, the target audio device may select one piece of audio signal from the multiple audio signals of the certain audio device as the audio signal of the certain audio device, and discard other audio signals in the multiple audio signals, so as to Multiple audio signals are de-redundant. Alternatively, the target audio device may average multiple audio signals of the certain audio device, and use the averaged audio signal as the audio signal of the certain audio device to de-redundate the multiple audio signals. This application implements The example does not limit this. For example, as shown in FIGS. 8 to 10, the target audio device may be the audio device 04, and the audio signal recovered by the audio device 04 includes two audio signals x1(n), and the audio device 04 can obtain the audio signal from the two audio signals x1. (n) Select an audio signal x1(n) as the audio signal of the audio device 01. As another example, the audio signal recovered by the audio device 04 includes three audio signals x2(n), and the audio device 04 may use the audio signal obtained by averaging the three audio signals x2(n) as the audio signal of the audio device 02.

It is worth noting that the audio signal of each audio device recovered by the target audio device is an approximate signal of the audio signal collected by each audio device, and multiple audio signals of a certain audio device recovered by the target audio device may come from different sources. Mix the audio signal, the target audio device can select the audio signal recovered from the mixed audio signal with the least source as the audio signal of the certain audio device from the multiple audio signals, so as to reduce the selected audio signal and the certain audio signal. The difference in the audio signal collected by the audio device.

Based on the foregoing description, it is easy to understand that in the embodiment of the present application, each audio device in the audio processing network has an audio processing function, and each audio device in the audio processing network can learn the audio processing functions of other audio devices to implement audio Signal mixing and recovery process. Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, the audio processing function of each audio device in the audio processing network is The function is generated by the function processing device and sent to each audio device in the audio processing network. For example, after accessing the audio processing network, each audio device can generate its own audio processing function and broadcast its own audio processing function to other audio devices in the audio processing network, or each audio device is connected to the audio processing network. The post-audio processing network function processing device generates an audio processing function for the audio device, and broadcasts the audio processing function to the audio device in the audio processing network. The function processing device may be any device in the audio processing network. For example, the function processing device may be the audio device at the starting point of the first transmission path, or the audio device at the destination point of the first transmission path. , Or the management device of the audio processing network, which is not limited in the embodiment of the present application.

In the embodiment of the present application, before step 704, the first audio device needs to obtain at least the audio processing function of the first audio device, and the first audio device may also obtain the previous jump of the first audio device. The audio processing function of the device (that is, the second audio device) and the audio processing function of the previous hop device of the first audio device (that is, the third audio device). Before step 707, the next hop device of the first audio device (for example, the target audio device) needs to obtain the audio processing functions of the corresponding at least two audio devices, for example, the next hop device of the first audio device needs Acquire the audio processing function of the first audio device, the audio processing function of the second audio device, and the audio processing function of the third audio device. Optionally, acquiring the audio processing function of the first audio device by the first audio device may include: the first audio device generates the audio processing function of the first audio device; or, the first audio device receives the first audio processing function sent by the function processing device. An audio processing function of an audio device. Obtaining the audio processing functions of the at least two audio devices by the next hop device of the first audio device (for example, the target audio device) may include: receiving the audio processing functions of the at least two audio devices by the next hop device of the first audio device For example, the next hop device of the first audio device receives the audio processing function of the first audio device sent by the first audio device, receives the audio processing function of the second audio device sent by the second audio device, and receives the audio processing function of the second audio device sent by the second audio device. The audio processing function of the third audio device sent by the three audio equipment; or, the next hop device of the first audio device receives the audio processing function of the first audio device and the audio of the second audio device sent by the function processing device The processing function and the audio processing function of the third audio device are not limited in the embodiment of the present application.

The embodiment of the present application uses the first audio device to generate the audio processing function of the first audio device as an example to describe the generation process of the audio processing function. Optionally, generating the audio processing function of the first audio device by the first audio device may include: the first audio device generates a plurality of random numbers by using a random number generation function, and generates the output of the first audio device according to the plurality of random numbers. Audio processing function. Wherein, the random number generation function can be, for example, the rand() function in the c language, and the rand() function can generate random numbers in the range of [0,32767]. The audio processing function of the first audio device may be a multi-dimensional random sequence composed of the multiple random numbers. For example, the audio processing function is a 20-dimensional random sequence. It can be understood that the higher the dimensionality of the audio processing function , The better the quality of audio signal restoration, but the higher the computational complexity when restoring audio signals. For example, the first audio device generating multiple random numbers using a random number generation function may include: the first audio device generating multiple random numbers using a rand() function. The first audio device generating the audio processing function of the first audio device according to the multiple random numbers may include: the first audio device composes the multiple random numbers into a random sequence, and the random sequence is the audio of the first audio device Processing function.

It is worth noting that the embodiment of the present application takes the first audio device to generate the audio processing function of the first audio device as an example to describe the generation process of the audio processing function, the process of any audio device generating its own audio processing function, and the function The process of generating the audio processing function of each audio device by the processing device may refer to the process of generating the audio processing function of the first audio device by the first audio device, which will not be repeated in the embodiment of the present application. The embodiments of the present application generate audio processing functions in a randomized manner, which can ensure that the audio processing functions of various audio devices are as uncorrelated as possible, which facilitates the mixing and restoration of audio signals.

In the embodiment of the present application, after the embodiment shown in FIG. 2, the target audio device can determine from the audio processing network that the destination point is at least one target transmission path of the target audio device, and the audio device on each target transmission path can The audio signal is transmitted based on the signal transmission process provided by the embodiment shown in FIG. 7. It is easy to understand with reference to the embodiment shown in FIG. 7 that, on each target transmission path, each audio device except the audio device at the starting point and the audio device at the destination point can collect the audio signal collected by itself and the audio signal received. It is mixed into an audio mixed signal and transmitted to the next hop device until the signal is transmitted to the target audio device (the audio device at the destination point of the target transmission path), so that the target audio device can receive the required data through fewer transmission paths The audio signal is helpful to reduce the transmission bandwidth of the audio signal compared to the solution of each audio device sending the audio signal to the target audio device separately. The following describes the principle of reducing the transmission bandwidth of audio signals by the signal transmission method provided in the embodiments of the present application in conjunction with FIG. 1 and FIG. 10.

For example, as shown in Figures 1 and 10, it is assumed that the audio signals collected by audio device 01, audio device 02, and audio device 03 are audio signal x1(n), audio signal x2(n), and audio signal x3(n) in order , Audio signal x1(n), audio signal x2(n) and audio signal x3(n) all contain N sampling point data, n=0,1,...,N-1, each sampling point data uses 16 bits Express. Without considering compression, each of the audio signal x1(n), audio signal x2(n), and audio signal x3(n), when transmitted separately, occupies a network bandwidth of 16×N bits, and the symbol "×" means multiplication sign.

As shown in Figure 1, if audio device 01, audio device 02, and audio device 03 each send its own audio signal to audio device 04, audio device 01, audio device 02, and audio device 03 transmit audio signals to audio device 04. The network bandwidth of is 16×N×3 bits, and the symbol "×" represents the multiplication sign.

As shown in Figure 10, if the audio device 01 transmits the audio signal x1(n) to the audio device 02, and the audio device 02 mixes the audio signal x1(n) with the audio signal x2(n) and transmits it to the audio device 03, the audio device 03 The audio signal x1(n), audio signal x2(n) and audio signal x3(n) are mixed and transmitted to the audio device 04, then the mixed audio signal y1(n) received by the audio device 04 contains 3×N samples The mixed data of the 3×N sampling points are: 3 sample points 0 mixed data y1(0), 3 sample points 1 mixed data y1(1), 3 sample points 2 Mixed data y1(2)...mixed data y1(N-1) of 3 sampling points N-1, the symbol "×" represents the multiplication sign. in:

y1(0)=x1(0)*h1(0)+x2(0)*h2(0)+x3(0)*h3(0);

y1(1)=x1(1)*h1(1)+x2(1)*h2(1)+x3(1)*h3(1);

y1(2)=x1(2)*h1(2)+x2(2)*h2(2)+x3(2)*h3(2);

...

y1(N-1)=x1(N-1)*h1(N-1)+x2(N-1)*h2(N-1)+x3(N-1)*h3(N-1);

The symbol "*" means convolution, and the symbol "+" means superimposition. Take y1(0) as an example, x1(0)*h1(0), x2(0)*h2(0), x3(0)*h3(0) are 16 bits respectively, and y1(0) is 3 16 bits The bit sampling point data is obtained through mathematical operations, and y1(0) is still 16 bits. Similarly, y1(1), y1(2)...y1(N-1) are all 16 bits, including y1(0), y1(1), y1(2)...y1(N-1) The network bandwidth occupied by y1(n) during transmission is 16×N bits, and the symbol “×” represents the multiplication sign.

It can be seen that the network bandwidth occupied by the transmission of the mixed audio signal y1(1) is equal to the network bandwidth of the audio signal collected by a single audio device (for example, audio signal x1(n), audio signal x2(n) or audio signal x3(n)). Therefore, compared to the solution in which the audio device 01, the audio device 02, and the audio device 03 each send its own audio signal to the audio device 04, the embodiment of the present application mixes the audio signals and transmits it, ensuring that the audio device 01 and the audio device 02 And the effective transmission of the audio signal collected by the audio device 03, and can reduce the transmission bandwidth of the audio signal.

In summary, in the signal transmission method provided by the embodiments of the present application, after the first audio device collects the audio signal, when the audio signal sent by the previous hop device of the first audio device is received, the first audio device is collected The audio signal of is mixed with the audio signal sent by the previous hop device of the first audio device to obtain a mixed audio signal, and the mixed audio signal is sent to the next hop device of the first audio device. Since the audio device can mix the collected audio signal and the received audio signal and send it to the next hop device, until the audio signal collected by each audio device is sent to the target audio device, it is compared with each audio device separately to the target audio device. The scheme of sending audio signals by audio equipment helps to reduce the transmission bandwidth of audio signals.

The following are device embodiments of this application, which can be used to implement the method embodiments of this application. For details that are not disclosed in the device embodiments of this application, please refer to the method embodiments of this application.

Please refer to FIG. 15, which shows a schematic diagram of the logical structure of a signal transmission device 1500 provided by an embodiment of the present application. The signal transmission device 1500 may be any audio device or the audio device in the implementation environment shown in FIG. Functional components in. Referring to FIG. 15, the signal transmission device 1500 may include but is not limited to:

The obtaining module 1510 is used to obtain the audio signal collected by the first audio device;

The processing module 1520 is configured to, when the audio signal sent by the previous hop device of the first audio device is received, mix the audio signal collected by the first audio device and the audio signal sent by the previous hop device to obtain a mixed audio signal ；

The sending module 1530 is configured to send the mixed audio signal to the next hop device of the first audio device;

Wherein, the first audio device, the previous hop device, and the next hop device are adjacent audio devices on the first transmission path in the audio processing network.

Optionally, the processing module 1520 is configured to:

Use the audio processing function of the first audio device to process the audio signal collected by the first audio device to obtain the processed signal of the first audio device;

Superimposing the processed signal of the first audio device and the audio signal sent by the previous hop device to obtain a mixed audio signal.

Optionally, the audio signal sent by the last hop device is a mixed signal of audio signals collected by at least two audio devices; the processing module 1520 is configured to:

Recover the audio signal collected by the at least two audio devices from the audio signal sent by the last hop device;

For each audio device of the first audio device and the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device;

The processing signal of the first audio device and the processing signal of the at least two audio devices are superimposed to obtain a mixed audio signal.

Optionally, the processing module 1520 is configured to:

Determining, according to the source information carried in the audio signal sent by the last hop device, that the audio signal sent by the last hop device is a mixed signal of the audio signals collected by the at least two audio devices;

The audio signals collected by the at least two audio devices are recovered from the audio signals sent by the last hop device according to the audio processing functions of the at least two audio devices.

Optionally, the audio signal sent by the last hop device is an audio signal collected by the last hop device;

The processing module 1520 is used for:

For each audio device in the first audio device and the previous hop device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device;

The processing signal of the first audio device and the processing signal of the previous hop device are superimposed to obtain a mixed audio signal.

Optionally, the audio signal sent by the last hop device is obtained by processing the audio signal collected by the last hop device; the processing module 1520 is configured to:

Recover the audio signal collected by the previous hop device from the audio signal sent by the previous hop device;

Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or,

The audio processing function of each audio device in the audio processing network is generated by the function processing device in the audio processing network and sent to each audio device in the audio processing network.

Optionally, please continue to refer to FIG. 15, the signal transmission device 1500 further includes:

The generating module 1540 is used to generate the audio processing function of the first audio device; or,

The receiving module 1550 is configured to receive the audio processing function of the first audio device sent by the function processing device.

Optionally, the generating module 1540 is used to:

Use random number generating function to generate multiple random numbers;

The audio processing function of the first audio device is generated according to the plurality of random numbers.

In summary, in the signal transmission device provided by the embodiment of the present application, after the acquisition module acquires the audio signal collected by the first audio device, the processing module has the audio signal collected by the first audio device and the previous jump of the first audio device. The audio signal sent by the device is mixed to obtain a mixed audio signal, and the sending module sends the mixed audio signal to the next hop device of the first audio device. Since the audio device can mix the collected audio signal and the received audio signal and send it to the next hop device, until the audio signal collected by each audio device is sent to the target audio device, it is compared with each audio device separately to the target audio device. The scheme of sending audio signals by audio equipment helps to reduce the transmission bandwidth of audio signals.

Please refer to FIG. 16, which shows a schematic diagram of the logical structure of another signal transmission device 1600 provided by an embodiment of the present application. The signal transmission device 1600 may be any audio device or the audio device in the implementation environment shown in FIG. The functional components in the device. Referring to FIG. 16, the signal transmission device 1600 may include, but is not limited to:

The receiving module 1610 is configured to receive a mixed audio signal sent by a previous hop device of the target audio device, where the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices;

The processing module 1620 is configured to recover the audio signals of the at least two audio devices from the mixed audio signal;

Wherein, the target audio device and the last hop device are adjacent audio devices on the first transmission path in the audio processing network.

Optionally, the processing module 1620 is configured to:

Determining, according to the source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices;

The audio signal collected by the at least two audio devices is recovered from the mixed audio signal according to the audio processing functions of the at least two audio devices.

Optionally, the receiving module 1610 is further configured to receive audio processing functions of the at least two audio devices.

Optionally, please continue to refer to FIG. 16, the signal transmission device 1600 further includes:

The determining module 1630 is configured to determine from the audio processing network that the destination point is at least one target transmission path of the target audio device, and the at least one target transmission path includes the first transmission path;

The sending module 1640 is configured to send transmission instruction information to the audio device on each target transmission path, and the audio device on the target transmission path is used to transmit the audio signal through the target transmission path according to the received transmission instruction information.

Optionally, the determining module 1630 is configured to select at least one transmission path as the at least one target transmission path from among multiple transmission paths where the destination point is the target audio device in the audio processing network;

The sending module 1640 is configured to send removal instruction information to the audio device on each target transmission path, where the removal instruction information sent to the audio device on the target transmission path instructs the audio device to remove the audio device in the multiple transmission paths. The redundant transmission path and the audio signal are transmitted through the target transmission path, and the redundant transmission path is a transmission path other than the at least one target transmission path among the plurality of transmission paths.

Optionally, the determining module 1630 is configured to:

Receiving a path detection signal transmitted through each of the multiple transmission paths, where the path detection signal transmitted through each transmission path contains information about each audio device on the transmission path;

According to the path detection signal transmitted through the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as at least one target transmission path, where the at least one target transmission path is the number of paths among the multiple transmission paths The transmission path that contains the least number of audio devices.

Optionally, the determining module 1630 is configured to:

For each of the multiple transmission paths, acquiring the current processing capabilities of each audio device on the transmission path;

According to the current processing capabilities of the audio devices on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as at least one target transmission path, where the current processing capabilities of the audio devices on each target transmission path are strong In the default processing capacity.

Optionally, the determining module 1630 is configured to:

Acquire the topology information of the audio processing network and the current processing capabilities of each audio device in the audio processing network;

According to the current processing capabilities of each audio device in the audio processing network, determine from the audio processing network at least one cooperative audio device required by the target audio device;

Determining, according to the topology information of the audio processing network, at least one transmission path that is the target audio device and includes the at least one cooperative audio device as the at least one target transmission path;

The sending module 1640 is configured to send device indication information to the audio device on each target transmission path, where the device indication information sent to the audio device indicates the next hop device of the audio device on the target transmission path.

In summary, in the signal transmission device provided by the embodiment of the present application, the audio device on the first transmission path can mix the collected audio signal and the received audio signal and then send it to the next hop device until each audio device is collected. The audio signal is sent to the target audio device, so the mixed audio signal sent by the last hop device of the target audio device received by the target audio device is a mixed signal of the audio signals collected by at least two audio devices, compared to each audio device The solution of each sending audio signals to the target audio device separately, the target audio device can receive the audio signal collected by each audio device only by receiving the mixed audio signal, thereby helping to reduce the transmission bandwidth of the audio signal.

Please refer to FIG. 17, which shows a schematic diagram of the hardware structure of a signal transmission device 1700 provided by an embodiment of the present application. The signal transmission device 1700 may be any audio device in the implementation environment shown in FIG. 1. Referring to FIG. 17, the signal transmission device 1700 includes a processor 1702, a memory 1704, a communication interface 1706, an audio collection component 1708, a bus 1710, a processor 1702, a memory 1704, a communication interface 1706, and an audio collection component 1708 that are communicatively connected to each other through a bus 1710. . Those skilled in the art should understand that the connection between the processor 1702, the memory 1704, the communication interface 1706, and the audio collection component 1708 shown in FIG. 17 is only exemplary. The processor 1702, the memory 1704, the communication interface 1706 and the audio The collection components 1708 may also be communicatively connected to each other by using other connection methods other than the bus 1710.

Among them, the memory 1704 can be used to store instructions 17042 and data 17044. In the embodiment of the present application, the memory 1704 may be various types of storage media, such as random access memory (RAM), read-only memory (ROM), and non-volatile RAM (non-volatile RAM). -volatile RAM, NVRAM), programmable ROM (programmable ROM, PROM), erasable PROM (erasable PROM, EPROM), electrically erasable PROM (electrically erasable PROM, EEPROM), flash memory, optical memory and registers, etc. In addition, the memory 1704 may include a hard disk and/or a memory.

Among them, the processor 1702 may be a general-purpose processor or a special-purpose processor. The general-purpose processor may be a processor that executes specific steps and/or operations by reading and executing instructions (for example, instructions 17042) stored in a memory (for example, the memory 1704). The general-purpose processor is in the process of executing the above-mentioned steps and/or operations. Data (such as data 17044) stored in a memory (such as memory 1704) may be used in. The general-purpose processor may be, for example, but not limited to a CPU. The dedicated processor may be a processor specially designed to perform specific steps and/or operations. The dedicated processor may be, for example, but not limited to, a digital signal processor (digital signal processor, DSP), an application specific integrated circuit ( application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), programmable logic array (PLA), etc. In addition, the processor 1702 may also be a combination of multiple processors, such as a multi-core processor. The processor 1702 may include one or more circuits to execute all or part of the steps of the signal transmission method provided in the foregoing embodiments.

Wherein, the communication interface 1706 may include input/output (input/output, I/O) interfaces, physical interfaces, logical interfaces, and other interfaces used to realize the interconnection of devices within the signal transmission device 1700, and used to realize the signal transmission device 1700. Interface for interconnection with other devices. The physical interface can be a gigabit ethernet (GE), which can be used to interconnect the signal transmission device 1700 with other devices, and the logical interface is an interface inside the signal transmission device 1700, which can be used to implement a signal transmission device The internal devices of the 1700 are interconnected. It is easy to understand that the communication interface 1706 may be used for the signal transmission apparatus 1700 to communicate with other devices. For example, the communication interface 1706 is used for sending and receiving information between the signal transmission apparatus 1700 and other devices.

The audio collection component 1708 may be any component capable of collecting audio signals, and the audio collection component 1708 may be, for example, but not limited to, a microphone or a microphone array. Optionally, the signal transmission device 1700 may include a plurality of audio collection components 1708, and the multiple audio collection components 1708 may be arranged at different parts of the signal transmission device 1700 to collect stereo audio signals.

The bus 1710 may be of any type, and is used to implement the communication bus interconnecting the processor 1702, the memory 1704, the communication interface 1706, and the audio collection component 1708. For example, the bus 1710 may be a system bus.

The above-mentioned devices may be respectively arranged on independent chips, or at least partly or fully arranged on the same chip. Whether each device is independently arranged on different chips or integratedly arranged on one or more chips often depends on the requirements of product design, and the embodiments of the present application do not limit the implementation form of the above-mentioned devices.

The signal transmission device 1700 shown in FIG. 17 is only exemplary. In the implementation process, the signal transmission device 1700 may further include other components, which are not listed in the embodiment of the present application. The signal transmission device 1700 shown in FIG. 17 may perform audio signal transmission by executing all or part of the steps of the signal transmission method provided in the foregoing embodiment.

An embodiment of the present application provides a signal transmission system. The signal transmission system includes at least two audio devices, and at least one of the at least two audio devices includes the signal transmission device shown in any one of FIGS. 15 to 17.

The embodiments of the present application provide a computer-readable storage medium in which a computer program is stored, and when the computer program is run on a computer, the computer is caused to execute part of the signal transmission method provided by the above-mentioned embodiment Or all steps.

The embodiments of the present application provide a computer program product containing instructions. When the computer program product runs on a computer, the computer executes part or all of the steps of the signal transmission method provided in the above embodiments.

The embodiments of the present application provide a chip that includes a programmable logic circuit and/or program instructions, and when the chip is running, it is used to implement part or all of the steps of the signal transmission method provided in the foregoing embodiments.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in the form of a computer program product in whole or in part, and the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data. The center transmits to another website, computer, server, or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium, or a semiconductor medium (for example, a solid state hard disk).

In this application, the terms "first" and "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance. The term "at least one" refers to one or more, and "multiple" refers to two or more, unless expressly defined otherwise. The term "and/or" is merely an association relationship that describes associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone. three conditions.

Different types of embodiments such as method embodiments and device embodiments provided in the embodiments of the present application can be referred to each other, which is not limited in the embodiments of the present application. The sequence of operations of the method embodiments provided in the embodiments of this application can be appropriately adjusted, and the operations can also be increased or decreased in response to the situation. Any person skilled in the art can easily think of changes within the technical scope disclosed in this application. The methods should all be covered in the scope of protection of this application, so I won’t repeat them here.

In the corresponding embodiments provided in the present application, it should be understood that the disclosed device and the like can be implemented in other structural manners. For example, the device embodiments described above are merely illustrative, for example, the division of units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or integrated. To another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.

The units described as separate components may or may not be physically separate, and the components described as units may or may not be physical units, and may be located in one place or distributed to multiple network devices (such as terminal devices). )superior. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

The above are only exemplary implementations of this application, but the scope of protection of this application is not limited to this. Anyone familiar with this technical field can easily think of various equivalents within the technical scope disclosed in this application. Modifications or replacements, these modifications or replacements shall be covered within the scope of protection of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims

A signal transmission method, characterized in that the method includes:

Acquiring the audio signal collected by the first audio device;

When receiving the audio signal sent by the previous hop device of the first audio device, mixing the audio signal collected by the first audio device and the audio signal sent by the previous hop device to obtain a mixed audio signal;

Sending the mixed audio signal to the next hop device of the first audio device;

Wherein, the first audio device, the previous hop device, and the next hop device are adjacent audio devices on the first transmission path in the audio processing network.
The method of claim 1, wherein:

The mixing the audio signal collected by the first audio device and the audio signal sent by the previous hop device to obtain a mixed audio signal includes:

Using the audio processing function of the first audio device to process the audio signal collected by the first audio device to obtain the processed signal of the first audio device;

The mixed audio signal is obtained by superimposing the processed signal of the first audio device and the audio signal sent by the previous hop device.
The method of claim 1, wherein:

The audio signal sent by the last hop device is a mixed signal of audio signals collected by at least two audio devices;

The mixing the audio signal collected by the first audio device and the audio signal sent by the previous hop device to obtain a mixed audio signal includes:

Recover the audio signal collected by the at least two audio devices from the audio signal sent by the last hop device;

For each audio device of the first audio device and the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processing of the audio device Signal;

The mixed audio signal is obtained by superimposing the processed signal of the first audio device and the processed signal of the at least two audio devices.
The method of claim 3, wherein:

Before recovering the audio signals collected by the at least two audio devices from the audio signals sent by the last hop device, the method further includes:

Determining, according to the source information carried in the audio signal sent by the last hop device, that the audio signal sent by the last hop device is a mixed signal of audio signals collected by the at least two audio devices;

The recovering the audio signals collected by the at least two audio devices from the audio signals sent by the last hop device includes:

The audio signals collected by the at least two audio devices are recovered from the audio signals sent by the last hop device according to the audio processing functions of the at least two audio devices.
The method of claim 1, wherein:

The audio signal sent by the last hop device is an audio signal collected by the last hop device;

The mixing the audio signal collected by the first audio device and the audio signal sent by the previous hop device to obtain a mixed audio signal includes:

For each audio device in the first audio device and the previous hop device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device ；

The mixed audio signal is obtained by superimposing the processing signal of the first audio device and the processing signal of the previous hop device.
The method of claim 1, wherein:

The audio signal sent by the last hop device is obtained by processing the audio signal collected by the last hop device;

The mixing the audio signal collected by the first audio device and the audio signal sent by the previous hop device to obtain a mixed audio signal includes:

Recover the audio signal collected by the last hop device from the audio signal sent by the last hop device;

For each audio device in the first audio device and the previous hop device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device ；

The mixed audio signal is obtained by superimposing the processing signal of the first audio device and the processing signal of the previous hop device.
The method according to any one of claims 2 to 6, wherein:

The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or,

The audio processing function of each audio device in the audio processing network is generated by the function processing device in the audio processing network and sent to each audio device in the audio processing network.
The method according to claim 7, wherein:

Before using the audio processing function of the first audio device to process the audio signal collected by the first audio device, the method further includes:

Generate the audio processing function of the first audio device; or,

Receiving the audio processing function of the first audio device sent by the function processing device.
The method of claim 8, wherein:

The generating the audio processing function of the first audio device includes:

Use random number generating function to generate multiple random numbers;

The audio processing function of the first audio device is generated according to the plurality of random numbers.
A signal transmission method, characterized in that the method includes:

Receiving a mixed audio signal sent by a previous hop device of the target audio device, where the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices;

Recovering the audio signals collected by the at least two audio devices from the mixed audio signal;

Wherein, the target audio device and the last hop device are adjacent audio devices on the first transmission path in the audio processing network.
The method of claim 10, wherein:

Before recovering the audio signals collected by the at least two audio devices from the mixed audio signal, the method further includes:

Determining, according to the source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of audio signals collected by the at least two audio devices;

The recovering the audio signals collected by the at least two audio devices from the mixed audio signal includes:

The audio signals collected by the at least two audio devices are recovered from the mixed audio signal according to the audio processing functions of the at least two audio devices.
The method of claim 11, wherein:

The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or,

The audio processing function of each audio device in the audio processing network is generated by the function processing device in the audio processing network and sent to each audio device in the audio processing network.
The method of claim 12, wherein:

Before recovering the audio signals collected by the at least two audio devices from the mixed audio signal according to the audio processing functions of the at least two audio devices, the method further includes:

Receiving audio processing functions of the at least two audio devices.
The method according to any one of claims 10 to 13, characterized in that,

Before receiving the mixed audio signal sent by the previous hop device of the target audio device, the method further includes:

Determining from the audio processing network that a destination point is at least one target transmission path of the target audio device, and the at least one target transmission path includes the first transmission path;

Send transmission instruction information to each audio device on the target transmission path, and the audio device on the target transmission path is used to transmit the audio signal through the target transmission path according to the received transmission instruction information.
The method of claim 14, wherein:

The determining from the audio processing network that the destination point is at least one target transmission path of the target audio device includes:

Selecting at least one transmission path as the at least one target transmission path from a plurality of transmission paths whose destination point is the target audio device in the audio processing network;

The sending transmission instruction information to each audio device on the target transmission path includes:

Sending removal instruction information to each audio device on the target transmission path, wherein the removal instruction information sent to the audio device on the target transmission path instructs the audio device to remove the redundancy in the multiple transmission paths And the audio signal is transmitted through the target transmission path, and the redundant transmission path is a transmission path other than the at least one target transmission path among the plurality of transmission paths.
The method of claim 15, wherein:

The selecting at least one transmission path as the at least one target transmission path from among the multiple transmission paths whose destination point is the target audio device in the audio processing network includes:

Receiving a path detection signal transmitted through each of the multiple transmission paths, where the path detection signal transmitted through each of the transmission paths includes information about each audio device on the transmission path;

According to the path detection signal transmitted through the plurality of transmission paths, at least one transmission path is selected from the plurality of transmission paths as the at least one target transmission path, wherein the at least one target transmission path is the plurality of transmission paths. Among the transmission paths, the transmission path with the least number of paths and the largest number of audio devices.
The method of claim 15, wherein:

The selecting at least one transmission path as the at least one target transmission path from among the multiple transmission paths whose destination point is the target audio device in the audio processing network includes:

For each of the multiple transmission paths, acquiring the current processing capability of each audio device on the transmission path;

According to the current processing capabilities of the audio equipment on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path, wherein the audio on each target transmission path The current processing capacity of the device is stronger than the preset processing capacity.
The method of claim 14, wherein:

The determining from the audio processing network that the destination point is at least one target transmission path of the target audio device includes:

Acquiring topology information of the audio processing network and current processing capabilities of each audio device in the audio processing network;

Determine from the audio processing network at least one cooperative audio device required by the target audio device according to the current processing capabilities of each audio device in the audio processing network;

Determining, according to the topology information of the audio processing network, at least one transmission path whose destination point is the target audio device and including the at least one cooperative audio device as the at least one target transmission path;

The sending transmission instruction information to each audio device on the target transmission path includes:

Sending device indication information to each audio device on the target transmission path, where the device indication information sent to the audio device indicates the next hop device of the audio device on the target transmission path.
A signal transmission device, characterized in that the device includes:

An acquisition module, which is used to acquire the audio signal collected by the first audio device;

The processing module is used for mixing the audio signal collected by the first audio device and the audio signal sent by the previous hop device when receiving the audio signal sent by the previous hop device of the first audio device. audio signal;

A sending module, configured to send the mixed audio signal to the next hop device of the first audio device;

Wherein, the first audio device, the previous hop device, and the next hop device are adjacent audio devices on the first transmission path in the audio processing network.
The device of claim 19, wherein:

The processing module is used for:

Using the audio processing function of the first audio device to process the audio signal collected by the first audio device to obtain the processed signal of the first audio device;

The mixed audio signal is obtained by superimposing the processed signal of the first audio device and the audio signal sent by the previous hop device.
The device of claim 19, wherein:

The audio signal sent by the last hop device is a mixed signal of audio signals collected by at least two audio devices;

The processing module is used for:

Recover the audio signal collected by the at least two audio devices from the audio signal sent by the last hop device;

For each audio device of the first audio device and the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processing of the audio device Signal;

The mixed audio signal is obtained by superimposing the processed signal of the first audio device and the processed signal of the at least two audio devices.
The device of claim 21, wherein:

The processing module is used for:

Determining, according to the source information carried in the audio signal sent by the last hop device, that the audio signal sent by the last hop device is a mixed signal of audio signals collected by the at least two audio devices;

The audio signals collected by the at least two audio devices are recovered from the audio signals sent by the last hop device according to the audio processing functions of the at least two audio devices.
The device of claim 19, wherein:

The audio signal sent by the last hop device is an audio signal collected by the last hop device;

The processing module is used for:

For each audio device in the first audio device and the previous hop device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device ；

The mixed audio signal is obtained by superimposing the processing signal of the first audio device and the processing signal of the previous hop device.
The device of claim 19, wherein:

The audio signal sent by the last hop device is obtained by processing the audio signal collected by the last hop device;

The processing module is used for:

Recover the audio signal collected by the last hop device from the audio signal sent by the last hop device;

For each audio device in the first audio device and the previous hop device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device ；

The mixed audio signal is obtained by superimposing the processing signal of the first audio device and the processing signal of the previous hop device.
The device according to any one of claims 20 to 24, wherein:

The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or,

The audio processing function of each audio device in the audio processing network is generated by the function processing device in the audio processing network and sent to each audio device in the audio processing network.
The device according to claim 25, wherein the device further comprises:

A generating module for generating the audio processing function of the first audio device; or,

The receiving module is configured to receive the audio processing function of the first audio device sent by the function processing device.
The device of claim 26, wherein:

The generating module is used for:

Use random number generating function to generate multiple random numbers;

The audio processing function of the first audio device is generated according to the plurality of random numbers.
A signal transmission device, characterized in that the device includes:

A receiving module, configured to receive a mixed audio signal sent by a previous hop device of the target audio device, where the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices;

A processing module, configured to recover the audio signals collected by the at least two audio devices from the mixed audio signal;

Wherein, the target audio device and the last hop device are adjacent audio devices on the first transmission path in the audio processing network.
The device of claim 28, wherein:

The processing module is used for:

Determining, according to the source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of audio signals collected by the at least two audio devices;

The audio signals collected by the at least two audio devices are recovered from the mixed audio signal according to the audio processing functions of the at least two audio devices.
The device of claim 29, wherein:

The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or,

The audio processing function of each audio device in the audio processing network is generated by the function processing device in the audio processing network and sent to each audio device in the audio processing network.
The device of claim 30, wherein:

The receiving module is further configured to receive audio processing functions of the at least two audio devices.
The device according to any one of claims 28 to 31, wherein the device further comprises:

A determining module, configured to determine from the audio processing network that a destination point is at least one target transmission path of the target audio device, and the at least one target transmission path includes the first transmission path;

The sending module is configured to send transmission instruction information to each audio device on the target transmission path, and the audio device on the target transmission path is used to transmit audio signals through the target transmission path according to the received transmission instruction information.
The device of claim 32, wherein:

The determining module is configured to select at least one transmission path as the at least one target transmission path from among multiple transmission paths whose destination point is the target audio device in the audio processing network;

The sending module is configured to send removal instruction information to each audio device on the target transmission path, wherein the removal instruction information sent to the audio device on the target transmission path instructs the audio device to remove the multiple The redundant transmission path among the transmission paths and the audio signal is transmitted through the target transmission path, and the redundant transmission path is a transmission path other than the at least one target transmission path among the plurality of transmission paths.
The device of claim 33, wherein:

The determining module is used to:

Receiving a path detection signal transmitted through each of the multiple transmission paths, where the path detection signal transmitted through each of the transmission paths includes information about each audio device on the transmission path;

According to the path detection signal transmitted through the plurality of transmission paths, at least one transmission path is selected from the plurality of transmission paths as the at least one target transmission path, wherein the at least one target transmission path is the plurality of transmission paths. Among the transmission paths, the transmission path with the least number of paths and the largest number of audio devices.
The device of claim 33, wherein:

The determining module is used to:

For each of the multiple transmission paths, acquiring the current processing capability of each audio device on the transmission path;

According to the current processing capabilities of the audio equipment on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path, wherein the audio on each target transmission path The current processing capacity of the device is stronger than the preset processing capacity.
The device of claim 32, wherein:

The determining module is used to:

Acquiring topology information of the audio processing network and current processing capabilities of each audio device in the audio processing network;

Determine from the audio processing network at least one cooperative audio device required by the target audio device according to the current processing capabilities of each audio device in the audio processing network;

Determining, according to the topology information of the audio processing network, at least one transmission path whose destination point is the target audio device and including the at least one cooperative audio device as the at least one target transmission path;

The sending module is configured to send device indication information to each audio device on the target transmission path, wherein the device indication information sent to the audio device indicates the next step of the audio device on the target transmission path. Jump equipment.
A signal transmission device, characterized in that the signal transmission device comprises a processor and a memory, the memory is stored with a program, and the processor is used to call the program stored in the memory so that the signal transmission device The signal transmission method according to any one of claims 1 to 9 is implemented.
A signal transmission device, characterized in that the signal transmission device comprises a processor and a memory, the memory is stored with a program, and the processor is used to call the program stored in the memory so that the signal transmission device Implement the signal transmission method according to any one of claims 10 to 18.
A signal transmission system, characterized in that it includes at least two audio devices;

At least one of the at least two audio devices includes the signal transmission device according to any one of claims 19 to 27, and at least the other one includes the signal transmission device according to any one of claims 28 to 36; or,

At least one of the at least two audio devices includes the signal transmission device according to claim 37, and at least the other includes the signal transmission device according to claim 38.
A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and when the computer program runs on a computer, the computer executes any one of claims 1 to 9 The signal transmission method described.
A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, and when the computer program runs on a computer, the computer executes any one of claims 10 to 18 The signal transmission method described.