CN110740416B - Audio signal processing method and device - Google Patents
Audio signal processing method and device Download PDFInfo
- Publication number
- CN110740416B CN110740416B CN201910926726.0A CN201910926726A CN110740416B CN 110740416 B CN110740416 B CN 110740416B CN 201910926726 A CN201910926726 A CN 201910926726A CN 110740416 B CN110740416 B CN 110740416B
- Authority
- CN
- China
- Prior art keywords
- audio
- audio signals
- audio signal
- sub
- signal processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
The embodiment of the invention relates to the technical field of audio processing, and discloses an audio signal processing method and an audio signal processing device, wherein the method is applied to the audio signal processing device which is connected with a plurality of pickup equipment and a plurality of public address equipment, each pickup equipment corresponds to an audio input channel, and each public address equipment corresponds to an audio output channel; the method comprises the following steps: obtaining reverberation audio signals of a plurality of audio input channels; assigning each reverberant audio signal to a plurality of audio output channels such that each audio output channel obtains a plurality of sub-audio signals; updating phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated; a plurality of processed audio signals are output through the audio output channels. By implementing the embodiment of the invention, the effect of adjusting the audio simulation reverberation can be improved.
Description
Technical Field
The invention relates to the technical field of audio processing, in particular to an audio signal processing method and device.
Background
In order to ensure that various program performances have the optimal visual and audio effects, a plurality of professional theaters such as theaters, operas and multifunctional halls are built at home and abroad. These professional theaters often need to adjust the reverberation time of the audio signal for different performance purposes (such as opera, concert, etc.) to optimize the acoustic environment. At present, the common reverberation adjusting method mainly adjusts the reverberation time of the indoor audio signal through a mechanical sound creating method, for example, changing the indoor space volume, increasing a space coupling cavity, or changing sound absorbing materials on a ceiling, a wall, and the like. However, in practice it has been found that the range of reverberation times that can be adjusted in this way is small, so that the reverberation adjustment effect is limited.
Disclosure of Invention
The embodiment of the invention discloses an audio signal processing method and device, which can improve the reverberation adjusting effect.
The first aspect of the embodiment of the invention discloses an audio signal processing method, which is applied to an audio signal processing device, wherein the audio signal processing device is connected with a plurality of pickup equipment and a plurality of public address equipment, each pickup equipment corresponds to an audio input channel, and each public address equipment corresponds to an audio output channel; the method comprises the following steps:
obtaining reverberant audio signals for a plurality of the audio input channels;
assigning each of the reverberant audio signals to a plurality of the audio output channels such that each of the audio output channels obtains a plurality of sub-audio signals;
updating phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;
outputting the plurality of processed audio signals through the audio output channel.
As an alternative implementation manner, in the first aspect of the embodiments of the present invention, the allocating each of the reverberant audio signals to a plurality of the audio output channels so that each of the audio output channels obtains a plurality of sub-audio signals includes:
for each audio input channel, acquiring a current gain value set by the audio input channel for each audio output channel at the current moment; wherein the current gain value of each audio output channel is periodically changed; in each period, the current gain value of each audio output channel is in a linear correlation relationship with the current moment, and the sum of the current gain values of the audio output channels is 1;
and distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel, so that each audio output channel obtains a plurality of sub audio signals.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the updating phases of the plurality of sub audio signals to obtain a plurality of processed audio signals includes:
randomly setting initial phase values and change frequencies corresponding to the plurality of sub audio signals;
and updating the phases of the plurality of sub audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub audio signals respectively to obtain a plurality of processed audio signals.
As an alternative implementation manner, in the first aspect of the embodiment of the present invention, the obtaining the reverberated audio signals of a plurality of the audio input channels includes:
acquiring original audio signals of a plurality of audio input channels;
performing reverberation processing on the original audio information according to preset reverberation space simulation parameters to obtain reverberation audio signals of the audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the audio signal processing apparatus is communicatively connected to a terminal device for controlling the audio signal processing apparatus; before the obtaining of the original audio signals of the plurality of audio input channels, the method further comprises:
acquiring performance mode information transmitted by the terminal equipment; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;
and configuring the audio signal processing device according to the target configuration information, and executing the step of acquiring the original audio signals of the plurality of audio input channels when the configuration is completed.
A second aspect of the embodiments of the present invention discloses an audio signal processing apparatus, where the apparatus is connected to a plurality of sound pickup devices and a plurality of sound amplification devices, each of the sound pickup devices corresponds to an audio input channel, and each of the sound amplification devices corresponds to an audio output channel; the device comprises:
a first obtaining unit, configured to obtain reverberation audio signals of a plurality of the audio input channels;
a distribution unit for distributing each of the reverberant audio signals to a plurality of the audio output channels such that each of the audio output channels obtains a plurality of sub-audio signals;
an updating unit for updating the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;
an output unit for outputting the plurality of processed audio signals through the audio output channel.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the allocation unit includes:
the first acquisition subunit is configured to acquire, for each audio input channel, a current gain value set by the audio input channel for each audio output channel at a current time; wherein the current gain value of each audio output channel is periodically changed; in each period, the current gain value of each audio output channel is in a linear correlation relationship with the current moment, and the sum of the current gain values of the audio output channels is 1;
and the distribution subunit is used for distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel so that each audio output channel obtains a plurality of sub audio signals.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the update unit includes:
a setting subunit, configured to randomly set an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals;
and the updating subunit is used for updating the phases of the plurality of sub-audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub-audio signals respectively so as to obtain a plurality of processed audio signals.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the first obtaining unit includes:
a second obtaining subunit, configured to obtain original audio signals of a plurality of the audio input channels;
the processing subunit is configured to perform reverberation processing on the multiple pieces of original audio information according to a preset reverberation space simulation parameter to obtain reverberation audio signals of multiple audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
As an alternative implementation manner, in the second aspect of the embodiment of the present invention, the apparatus is communicatively connected to a terminal device for controlling the apparatus; the first obtaining unit further includes:
a third acquiring subunit, configured to acquire performance mode information transmitted by the terminal device before the second acquiring subunit acquires original audio signals of the multiple audio input channels; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
the calling subunit is used for calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;
and the configuration subunit is configured to configure the audio signal processing apparatus according to the target configuration information, and trigger the second acquisition subunit to perform the acquisition of the original audio signals of the plurality of audio input channels when the configuration is completed.
A third aspect of an embodiment of the present invention discloses an audio signal processing apparatus, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the audio signal processing method disclosed by the first aspect of the embodiment of the invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute an audio signal processing method disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.
A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where the computer program product is configured to, when running on a computer, cause the computer to perform part or all of the steps of any one of the methods in the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the audio signal processing method is applied to an audio signal processing device, and the audio signal processing device is connected with a plurality of pickup equipment and a plurality of public address equipment, wherein each pickup equipment corresponds to one audio input channel, and each public address equipment corresponds to one audio output channel. By acquiring the reverberation audio signals of the audio input channels and distributing each reverberation audio signal to the audio output channels, each audio output channel can acquire sub audio signals from different audio input channels, and the sound field uniformity can be improved; in addition, the phases of the plurality of sub audio signals are updated, so that each audio output channel outputs a processed audio signal with a plurality of irrelevant phases, and the relevance of the audio signals can be reduced, so that the reverberation gain is improved, and the reverberation adjusting effect is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an acoustic system according to an embodiment of the present invention;
FIG. 2 is a flow chart of an audio signal processing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of the distribution of a reverberant audio signal according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the distribution of another reverberant audio signal disclosed in an embodiment of the invention;
FIG. 5 is a flow chart of another audio signal processing method disclosed in the embodiment of the invention;
FIG. 6 is a schematic structural diagram of an audio signal processing apparatus according to an embodiment of the disclosure;
FIG. 7 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the disclosure;
fig. 8 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the disclosure.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first", "second", "third", "fourth", and the like in the description and the claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses an audio signal processing method and an audio signal processing device, which can improve the effect of reverberation adjustment, and is applied to the audio signal processing device. Referring to fig. 1, fig. 1 is a schematic structural diagram of an acoustic system according to an embodiment of the present invention. In the acoustic system shown in fig. 1, the audio signal processing apparatus is connected to a plurality of sound collecting devices (such as microphones) and a plurality of sound amplifying devices (such as sound boxes), and the number of the sound collecting devices and the number of the sound amplifying devices are not limited. The audio signal processing device is used for receiving audio signals picked up by a plurality of pickup devices and processing the audio signals; and outputting the processed audio signals to a plurality of public address equipment for audio playing. In addition, each sound pickup apparatus corresponds to one audio input channel, and each sound amplification apparatus corresponds to one audio output channel. The following detailed description is made in conjunction with the other figures.
Example one
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating an audio signal processing method according to an embodiment of the present invention. As shown in fig. 2, the audio signal processing method may include the following steps.
201. An audio signal processing apparatus acquires reverberant audio signals of a plurality of audio input channels.
202. The audio signal processing means assigns each reverberant audio signal to a plurality of audio output channels, such that each audio output channel obtains a plurality of sub-audio signals.
In the embodiment of the present invention, the audio signal processing apparatus may equally distribute each of the reverberant audio signals to a plurality of audio output channels, that is, if the audio signal processing apparatus is connected to N (N is a positive integer) audio output channels, for one reverberant audio signal P, the sub-audio signal distributed to any one of the audio output channels is
Referring to fig. 3, fig. 3 is a schematic diagram illustrating the distribution of a reverberation audio signal according to an embodiment of the present invention. In fig. 3, it is assumed that the audio signal processing apparatus is connected to three audio input channels and three audio output channels, and after receiving the first reverberant audio signal of the audio input channel a, the audio signal processing apparatus divides the first reverberant audio signal into a first sub audio signal, a second sub audio signal and a third sub audio signal, wherein the gain values of the first sub audio signal, the second sub audio signal and the third sub audio signal are all one third of the first reverberant audio signal; thereafter, the audio signal processing apparatus transmits the first sub audio signal to the audio output channel a through the sub link 31, transmits the second sub audio signal to the audio output channel B through the sub link 32, and transmits the third sub audio signal to the audio output channel C through the sub link 33.
Similarly, after dividing the second reverberant audio signal of the audio input channel B into the fourth sub audio signal, the fifth sub audio signal, and the sixth sub audio signal equally, the audio signal processing apparatus transmits the fourth sub audio signal to the audio output channel B through the sub-link 34, transmits the fifth sub audio signal to the audio output channel a through the sub-link 35, and transmits the sixth sub audio signal to the audio output channel C through the sub-link 36; the audio signal processing apparatus equally divides the third reverberant audio signal of the audio input channel C into a seventh sub audio signal, an eighth sub audio signal, and a ninth sub audio signal, and then transmits the seventh sub audio signal to the audio output channel C through the sub link 37, the eighth sub audio signal to the audio output channel a through the sub link 38, and the ninth sub audio signal to the audio output channel B through the sub link 39. At this time, the audio output channel a pre-receives the first sub audio signal, the fifth sub audio signal, and the eighth sub audio signal, the audio output channel B pre-receives the second sub audio signal, the fourth sub audio signal, and the ninth sub audio signal, and the audio output channel C pre-receives the third sub audio signal, the sixth sub audio signal, and the seventh sub audio signal.
As an optional implementation manner, step 202 may specifically include:
aiming at each audio input channel, the audio signal processing device acquires a current gain value set for each audio output channel by the audio input channel at the current moment; wherein, the current gain value of each audio output channel is changed periodically; in each period, the current gain value of each audio output channel is in linear correlation with the current moment, and the sum of the current gain values of the audio output channels is 1;
the audio signal processing means assigns the reverberant audio signal to each audio output channel according to the current gain value of each audio output channel, so that a plurality of sub-audio signals are obtained for each audio output channel.
It is understood that since the current gain value set for any one audio output channel by each audio input channel is a periodic time-varying value, the audio signal processing apparatus may equally distribute the reverberant audio signal of each audio input channel to a plurality of audio output channels in a certain proportion over time.
Referring to fig. 4, fig. 4 is a schematic diagram illustrating another allocation of reverberant audio signals according to an embodiment of the present invention. In fig. 4, let the gain change frequency be T (e.g. 1ms), if the current time T corresponds to the time T of the first gain change, the gains set for the audio input channel a and the audio output channel A, B, C are 1, 0, and 0, respectively, and at this time, the audio signal processing apparatus transmits all the first reverberation audio signals of the audio input channel a to the audio output channel a; similarly, the audio signal processing means passes the second reverberated audio signal of audio input channel B all to audio output channel B, and the third reverberated audio signal of audio input channel C all to audio output channel C.
If the current time T corresponds to the time 2T of the second gain change, the audio input channel a is the audio output channel A, B, C, and the set gains are 0.9, 0.1, and 0, at this time, the audio signal processing apparatus divides the fourth reverberation audio signal S of the audio input channel a into the first sub audio signal 0.9S and the second sub audio signal 0.1S, and transmits the first sub audio signal 0.9S to the audio output channel a, and transmits the second sub audio signal 0.1S to the audio output channel B; similarly, the audio signal processing apparatus divides the fifth reverberant audio signal Q of the audio input channel B into a third sub audio signal 0.9Q and a fourth sub audio signal 0.1Q, and transmits the third sub audio signal 0.9Q to the audio output channel B and the fourth sub audio signal 0.1Q to the audio output channel C; and the audio signal processing device divides the sixth reverberation audio signal R of the audio input channel C into a fifth sub audio signal 0.9R and a sixth sub audio signal 0.1R, and transmits the fifth sub audio signal 0.9R to the audio output channel C and the sixth sub audio signal 0.1R to the audio output channel a.
It should also be understood that, assuming that T is 0-2T as the first period, in the next period (i.e., T is 2-4T), the gain variation rule of each audio output channel is consistent with the gain variation rule of each audio output channel in the first period (i.e., T is 0-2T), and will not be described herein again.
Therefore, in the implementation of the optional embodiment, since the sum of the gain values set for the plurality of audio output channels by each audio input channel is 1, the reverberation audio signal input by each audio input channel can be distributed to the plurality of audio output channels, and the distribution mode of the audio signal can be adjusted in real time based on the periodic time-varying characteristic of the gain values, which is beneficial to improving the sound field uniformity.
203. The audio signal processing device updates the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated.
In this embodiment of the present invention, the fact that the phases of the processed audio signals are not all correlated means that the difference between the cross spectra of any two processed audio signals in the processed audio signals is greater than a preset difference (for example, 0.5), which is not specifically limited.
It will be appreciated that the closer the relationship between the phases of the audio signals, the stronger the correlation of the audio signals. For example, two audio signals have the same phase or the ratio between the phases of the two audio signals is an integer, and the two audio signals have strong correlation at this time, and if the two audio signals are directly output through a public address device, distortion of the audio signals may be caused. Furthermore, the human ear is less sensitive to phase changes, so in the embodiment of the present invention, the audio signal processing apparatus can update the phases of a plurality of sub-audio signals from different audio input channels, thereby reducing the correlation of the sub-audio signals.
204. The audio signal processing apparatus outputs a plurality of processed audio signals through an audio output channel.
It can be seen that implementing the method described in fig. 2, by obtaining the reverberant audio signals of multiple audio input channels and distributing each reverberant audio signal to multiple audio output channels, so that each audio output channel obtains sub audio signals from different audio input channels, the sound field uniformity can be improved; in addition, the phases of the plurality of sub audio signals are updated, so that each audio output channel outputs a processed audio signal with a plurality of irrelevant phases, and the relevance of the audio signals can be reduced, so that the reverberation gain is improved, and the reverberation adjusting effect is greatly improved.
Example two
Referring to fig. 5, fig. 5 is a schematic flowchart illustrating another audio signal processing method according to an embodiment of the disclosure. As shown in fig. 5, the audio signal processing method may include the following steps.
501. An audio signal processing apparatus acquires original audio signals of a plurality of audio input channels.
In the embodiment of the present invention, the original audio signal may be an audio signal collected at the actual performance location and not reproduced by the public address device and not reflected (such as direct sound), or may be an audio signal reproduced by multiple reflections (such as early reflected sound) or by a public address device (such as reverberant sound), which is not limited herein.
502. The audio signal processing device performs reverberation processing on a plurality of original audio information according to preset reverberation space simulation parameters to obtain reverberation audio signals of a plurality of audio input channels.
In the embodiment of the invention, the reverberation space simulation parameters comprise reverberation time, bass ratio, delay time and intensity factor. It will be appreciated that the hall shows are targeted differently, as are the optimum reverberation parameters (such as the optimum reverberation time) required by the hall. Therefore, by implementing the above steps 501 and 502, reverberation processing is performed on the original audio signal of the hall according to the preset reverberation space simulation parameters, and the acoustic environment meeting the purpose of a specific performance can be simulated, so as to bring optimal hearing experience to the audience.
As an alternative embodiment, the audio signal processing apparatus is also communicatively connected to a terminal device for controlling the audio signal processing apparatus; prior to step 501, the present scheme may further include:
the audio signal processing device acquires performance mode information transmitted by the terminal equipment; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
the audio signal processing device calls target configuration information matched with the performance mode information according to the performance mode information; the target configuration information comprises preset reverberation space simulation parameters;
the audio signal processing device configures the audio signal processing device according to the target configuration information;
the audio signal processing apparatus acquires original audio signals of a plurality of audio input channels when configuration is completed.
The terminal device may include, but is not limited to, a mobile terminal device, a remote control device, and an overall control server associated with the audio signal processing apparatus. The performance mode may include, but is not limited to, a concert, a music play, a drama, a dance, a magic, and a synthesis art. And each performance mode is stored in association with the target configuration information matched with the performance mode. Therefore, by implementing the optional implementation mode, the audio signal processing device is adjusted to the optimal working mode indicated by the target configuration information by calling the target configuration information matched with the performance mode selected by the user, so that the intelligent degree of the audio signal processing device can be improved; in addition, redundant manual debugging steps can be reduced, and remote interactivity with the user is improved.
Further, as an optional implementation manner, the target configuration information may further include preset device information, where the preset device information includes the number of enabled sound pickup devices and the positions of the sound pickup devices required by the performance mode, and the number of enabled sound amplification devices and the positions of the sound amplification devices. For example, the preset device information is used to indicate that 9 sound pickup devices and 9 sound amplification devices in the stage area, 10 sound pickup devices and 10 sound amplification devices in the audience area need to be activated in the current performance mode. Therefore, when the audio signal processing apparatus completes the configuration, the scheme may further include:
the audio signal processing device acquires current equipment information of a plurality of pickup equipment and a plurality of public address equipment; wherein the current device information includes a device type (such as a sound pickup device or a sound amplification device) and a device location;
the audio signal processing device judges whether the current equipment information of the plurality of pickup equipment and the plurality of public address equipment is consistent with the preset equipment information;
if the audio signal processing device does not accord with the equipment adjusting instruction, the audio signal processing device sends the equipment adjusting instruction to the terminal equipment, so that the terminal equipment responds to the equipment adjusting instruction and outputs an equipment adjusting page; the equipment adjusting page comprises a floor plan of the current performance place, and the actual positions of the plurality of pickup equipment, the actual positions of the plurality of sound amplifying equipment, the number of the pickup equipment indicated by preset equipment information, the preset positions of the plurality of sound amplifying equipment, the number of the sound amplifying equipment indicated by the preset equipment information and the preset positions of the plurality of sound amplifying equipment are marked on the floor plan so as to guide a user to adjust the equipment distribution of the current performance place according to the indication of the floor plan;
the audio signal processing device acquires original audio signals of a plurality of audio input channels when configuration is completed, and comprises the following components:
and when the configuration of the audio signal processing device is finished and the current equipment information conforms to the preset equipment information, acquiring original audio signals of a plurality of audio input channels.
As another optional implementation, before step 501, the present scheme may further include:
when the audio signal processing device enters the manual configuration mode, restoring to default configuration according to default configuration information corresponding to the manual configuration mode;
the audio signal processing device acquires the real-time configuration information transmitted by the terminal equipment, configures and debugs the audio signal processing device according to the real-time configuration information until the manual configuration is detected to be completed, and stores the corresponding performance mode and configuration information as new configuration information in a correlation manner when the manual configuration is completed.
Therefore, the optional implementation mode can also store the performance mode and the configuration information configured manually by the user, so that more actual performance requirements of the user are met.
503. The audio signal processing means assigns each reverberant audio signal to a plurality of audio output channels, such that each audio output channel obtains a plurality of sub-audio signals.
504. The audio signal processing device randomly sets an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals.
505. The audio signal processing device updates the phases of the plurality of sub audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub audio signals, so as to obtain a plurality of processed audio signals.
In the embodiment of the present invention, the phases of the plurality of processed audio signals are uncorrelated with each other. It can be seen that, by implementing the above steps 504 and 505, the initial phase values and the variation frequencies of the plurality of sub audio signals are randomly set, so that the frequency of the phase update and the initial phase value of each sub audio signal are not fixed at each phase update, which can further reduce the correlation between the plurality of sub audio signals.
506. The audio signal processing apparatus outputs a plurality of processed audio signals through an audio output channel.
It can be seen that implementing the method described in fig. 5, by obtaining the reverberant audio signals of multiple audio input channels and distributing each reverberant audio signal to multiple audio output channels, the sound field uniformity can be improved; in addition, the initial phase value and the change frequency of the plurality of sub audio signals are randomly set, so that the frequency of phase updating and the initial phase value of each sub audio signal are not fixed during each phase updating, and the correlation among the plurality of sub audio signals can be further reduced, thereby improving the reverberation gain and greatly improving the reverberation adjustment effect; furthermore, an acoustic environment meeting the purpose of specific performance can be simulated, and optimal hearing experience is brought to audiences; furthermore, the audio signal processing device is adjusted to the optimal working mode indicated by the target configuration information, so that the intelligent degree of the audio signal processing device can be improved, redundant manual debugging steps are reduced, and the remote interactivity between the audio signal processing device and the user is improved.
EXAMPLE III
Referring to fig. 6, fig. 6 is a schematic structural diagram of an audio signal processing apparatus according to an embodiment of the present invention. The audio signal processing apparatus shown in fig. 6 is connected to a plurality of sound pickup devices each corresponding to one audio input channel and a plurality of sound amplification devices each corresponding to one audio output channel. As shown in fig. 6, the electronic device may include a first obtaining unit 601, an assigning unit 602, an updating unit 603, and an output unit 604, wherein:
a first obtaining unit 601, configured to obtain reverberant audio signals of multiple audio input channels.
A distribution unit 602 for distributing each reverberant audio signal to a plurality of audio output channels such that a plurality of sub-audio signals are obtained for each audio output channel.
An updating unit 603 for updating the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated.
An output unit 604 for outputting a plurality of processed audio signals through the audio output channel.
As an alternative embodiment, the distribution unit 602 includes:
the first acquisition subunit is used for acquiring a current gain value set by each audio input channel for each audio output channel at the current moment; wherein, the current gain value of each audio output channel is changed periodically; in each period, the current gain value of each audio output channel is in linear correlation with the current moment, and the sum of the current gain values of the audio output channels is 1;
and the distribution subunit is used for distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel, so that each audio output channel obtains a plurality of sub audio signals.
It can be seen that implementing the apparatus described in fig. 6, by obtaining the reverberant audio signals of multiple audio input channels, and distributing each reverberant audio signal to multiple audio output channels, so that each audio output channel obtains sub audio signals from different audio input channels, the sound field uniformity can be improved; in addition, the phases of the plurality of sub audio signals are updated, so that each audio output channel outputs a processed audio signal with a plurality of irrelevant phases, and the relevance of the audio signals can be reduced, so that the reverberation gain is improved, and the reverberation adjusting effect is greatly improved.
Example four
Referring to fig. 7, fig. 7 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the disclosure. The audio signal processing apparatus shown in fig. 7 is optimized by the audio signal processing apparatus shown in fig. 6. In comparison with the audio signal processing apparatus shown in fig. 6, in the audio signal processing apparatus shown in fig. 7:
the updating unit 603 includes:
a setting stator unit 6031 configured to randomly set an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals;
an updating sub-unit 6032, configured to perform update processing on the phases of the multiple sub-audio signals according to the initial phase values and the change frequencies corresponding to the multiple sub-audio signals, so as to obtain multiple processed audio signals.
The first acquisition unit 601 includes:
a second obtaining subunit 6011, configured to obtain original audio signals of a plurality of audio input channels;
a processing subunit 6012, configured to perform reverberation processing on the multiple pieces of original audio information according to a preset reverberation space simulation parameter, so as to obtain reverberation audio signals of multiple audio input channels; the reverberation space simulation parameters comprise reverberation time, frequency power distribution of reverberation sound energy, delay time and channel transmission frequency.
As an alternative embodiment, the audio signal processing apparatus is also communicatively connected to a terminal device for controlling the audio signal processing apparatus; the first acquiring unit 601 further includes:
a third acquiring subunit 6013, configured to acquire performance mode information transmitted by the terminal device before the second acquiring subunit 6011 acquires original audio signals of multiple audio input channels; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
a calling subunit 6014, configured to call, according to the performance mode information, target configuration information matched with the performance mode information; the target configuration information comprises preset reverberation space simulation parameters;
a configuration subunit 6015, configured to configure the audio signal processing apparatus according to the target configuration information, and trigger the second acquisition subunit 6011 to perform acquiring the original audio signals of the multiple audio input channels when the configuration is completed.
Further, as an optional implementation manner, the target configuration information may further include preset device information, where the preset device information includes the number of enabled sound pickup devices and the positions of the sound pickup devices required by the performance mode, and the number of enabled sound amplification devices and the positions of the sound amplification devices. For example, the preset device information is used to indicate that 9 sound pickup devices and 9 sound amplification devices in the stage area, 10 sound pickup devices and 10 sound amplification devices in the audience area need to be activated in the current performance mode. Accordingly, the audio signal processing apparatus may further include:
the second acquisition unit is used for acquiring current equipment information of the plurality of pickup equipment and the plurality of public address equipment when configuration is completed; wherein the current device information includes a device type (such as a sound pickup device or a sound amplification device) and a device location;
a determining unit, configured to determine whether current device information of the multiple sound pickup devices and the multiple sound amplifying devices matches preset device information, and if so, trigger the second obtaining subunit 6011 to perform obtaining of original audio signals of the multiple audio input channels;
the sending unit is used for sending a device adjusting instruction to the terminal device when the judging unit judges that the current device information is not accordant with the preset device information, so that the terminal device responds to the device adjusting instruction and outputs a device adjusting page; the equipment adjusting page comprises a floor plan of the current performance place, and the actual positions of the pickup equipment, the actual positions of the sound amplifying equipment, the number of the pickup equipment indicated by the preset equipment information, the preset positions of the sound amplifying equipment, the number of the sound amplifying equipment indicated by the preset equipment information and the preset positions of the sound amplifying equipment are marked on the floor plan, so that a user can be guided to adjust the equipment distribution of the current performance place according to the indication of the floor plan.
As another optional implementation, the audio signal processing apparatus may further include:
the recovery unit is used for recovering to the default configuration according to the default configuration information corresponding to the manual configuration mode when entering the manual configuration mode;
and the debugging unit is used for acquiring the real-time configuration information transmitted by the terminal equipment, configuring and debugging the audio information processing device according to the real-time configuration information until the manual configuration is detected to be completed, and performing associated storage on the corresponding performance mode and the configuration information as new configuration information when the manual configuration is completed.
Therefore, the optional implementation mode can also store the performance mode and the configuration information configured manually by the user, so that more actual performance requirements of the user are met.
It can be seen that implementing the apparatus described in fig. 7, by obtaining the reverberant audio signals of multiple audio input channels and distributing each reverberant audio signal to multiple audio output channels, the sound field uniformity can be improved; in addition, the initial phase value and the change frequency of the plurality of sub audio signals are randomly set, so that the frequency of phase updating and the initial phase value of each sub audio signal are not fixed during each phase updating, and the correlation among the plurality of sub audio signals can be further reduced, thereby improving the reverberation gain and greatly improving the reverberation adjustment effect; furthermore, an acoustic environment meeting the purpose of specific performance can be simulated, and optimal hearing experience is brought to audiences; furthermore, the audio signal processing device is adjusted to the optimal working mode indicated by the target configuration information, so that the intelligent degree of the audio signal processing device can be improved, redundant manual debugging steps are reduced, and the remote interactivity between the audio signal processing device and the user is improved.
EXAMPLE five
Referring to fig. 8, fig. 8 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the disclosure. As shown in fig. 8, the audio signal processing apparatus may include:
a memory 801 in which executable program code is stored;
a processor 802 coupled with the memory 801;
the processor 802 calls the executable program code stored in the memory 801 to execute an audio signal processing method shown in fig. 2 or 5.
An embodiment of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute an audio signal processing method shown in fig. 2 or 5.
Embodiments of the present invention also disclose a computer program product, wherein, when the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the method as in the above method embodiments.
The embodiment of the present invention also discloses an application publishing platform, which is used for publishing a computer program product, wherein when the computer program product runs on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The audio signal processing method and apparatus disclosed in the embodiments of the present invention are described in detail above, and the principle and the embodiments of the present invention are explained herein by applying specific examples, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (8)
1. An audio signal processing method is applied to an audio signal processing device, wherein the audio signal processing device is connected with a plurality of pickup devices and a plurality of public address devices, each pickup device corresponds to an audio input channel, and each public address device corresponds to an audio output channel; the method comprises the following steps:
obtaining reverberant audio signals for a plurality of the audio input channels;
for each audio input channel, acquiring a current gain value set by the audio input channel for each audio output channel at the current moment; wherein the current gain value of each audio output channel is periodically changed; in each period, the current gain value of each audio output channel is in a linear correlation relationship with the current moment, and the sum of the current gain values of the audio output channels is 1;
assigning the reverberant audio signal to each of the audio output channels according to a current gain value of each of the audio output channels, such that each of the audio output channels obtains a plurality of sub-audio signals;
updating phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;
outputting the plurality of processed audio signals through the audio output channel.
2. The method of claim 1, wherein the updating the phases of the plurality of sub-audio signals to obtain a plurality of processed audio signals comprises:
randomly setting initial phase values and change frequencies corresponding to the plurality of sub audio signals;
and updating the phases of the plurality of sub audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub audio signals respectively to obtain a plurality of processed audio signals.
3. The method of claim 1 or 2, wherein said obtaining reverberant audio signals for a plurality of said audio input channels comprises:
acquiring original audio signals of a plurality of audio input channels;
performing reverberation processing on the plurality of original audio signals according to preset reverberation space simulation parameters to obtain reverberation audio signals of the plurality of audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
4. The method of claim 3, wherein the audio signal processing apparatus is communicatively connected to a terminal device for controlling the audio signal processing apparatus; before the obtaining of the original audio signals of the plurality of audio input channels, the method further comprises:
acquiring performance mode information transmitted by the terminal equipment; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;
and configuring the audio signal processing device according to the target configuration information, and executing the step of acquiring the original audio signals of the plurality of audio input channels when the configuration is completed.
5. An audio signal processing apparatus, wherein said apparatus is connected to a plurality of sound pick-up devices and a plurality of sound amplification devices, each of said sound pick-up devices corresponding to an audio input channel and each of said sound amplification devices corresponding to an audio output channel; the device comprises:
a first obtaining unit, configured to obtain reverberation audio signals of a plurality of the audio input channels;
the distribution unit is used for acquiring a current gain value set by the audio input channel for each audio output channel at the current moment aiming at each audio input channel; wherein the current gain value of each audio output channel is periodically changed; in each period, the current gain value of each audio output channel is in a linear correlation relationship with the current moment, and the sum of the current gain values of the audio output channels is 1; assigning the reverberant audio signal to each of the audio output channels according to a current gain value of each of the audio output channels, such that each of the audio output channels obtains a plurality of sub-audio signals;
an updating unit for updating the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;
an output unit for outputting the plurality of processed audio signals through the audio output channel.
6. The apparatus of claim 5, wherein the updating unit comprises:
a setting subunit, configured to randomly set an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals;
and the updating subunit is used for updating the phases of the plurality of sub-audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub-audio signals respectively so as to obtain a plurality of processed audio signals.
7. The apparatus according to claim 5 or 6, wherein the first obtaining unit comprises:
a second obtaining subunit, configured to obtain original audio signals of a plurality of the audio input channels;
the processing subunit is configured to perform reverberation processing on the multiple original audio signals according to preset reverberation space simulation parameters to obtain reverberation audio signals of the multiple audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
8. The apparatus of claim 7, wherein the apparatus is communicatively connected to a terminal device for controlling the apparatus; the first obtaining unit further includes:
a third acquiring subunit, configured to acquire performance mode information transmitted by the terminal device before the second acquiring subunit acquires original audio signals of the multiple audio input channels; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
the calling subunit is used for calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;
and the configuration subunit is configured to configure the audio signal processing apparatus according to the target configuration information, and trigger the second acquisition subunit to perform the acquisition of the original audio signals of the plurality of audio input channels when the configuration is completed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910926726.0A CN110740416B (en) | 2019-09-27 | 2019-09-27 | Audio signal processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910926726.0A CN110740416B (en) | 2019-09-27 | 2019-09-27 | Audio signal processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110740416A CN110740416A (en) | 2020-01-31 |
| CN110740416B true CN110740416B (en) | 2021-04-06 |
Family
ID=69268265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910926726.0A Active CN110740416B (en) | 2019-09-27 | 2019-09-27 | Audio signal processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110740416B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402593A (en) * | 2002-07-23 | 2003-03-12 | 华南理工大学 | 5.1 path surround sound earphone repeat signal processing method |
| CN1781338A (en) * | 2003-04-30 | 2006-05-31 | 编码技术股份公司 | Advanced processing based on a complex-exponential-modulated filterbank and adaptive time signalling methods |
| CN101223820A (en) * | 2005-07-15 | 2008-07-16 | 松下电器产业株式会社 | Signal processing device |
| CN101477797A (en) * | 2008-11-24 | 2009-07-08 | 广州励丰声光科技有限公司 | Simulation system for hall acoustic environment |
| CN101543098A (en) * | 2007-04-17 | 2009-09-23 | 弗劳恩霍夫应用研究促进协会 | Generation of decorrelated signals |
| CN103269474A (en) * | 2007-07-19 | 2013-08-28 | 弗劳恩霍夫应用研究促进协会 | Method and apparatus for generating a stereo signal with enhanced perceptual quality |
| CN104995676A (en) * | 2013-02-14 | 2015-10-21 | 杜比实验室特许公司 | Signal decorrelation in an audio processing system |
| CN106714040A (en) * | 2017-01-17 | 2017-05-24 | 宁波音王电声股份有限公司 | Digital variable reverberation audio system and realization method thereof |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2847376B1 (en) * | 2002-11-19 | 2005-02-04 | France Telecom | METHOD FOR PROCESSING SOUND DATA AND SOUND ACQUISITION DEVICE USING THE SAME |
| US8335331B2 (en) * | 2008-01-18 | 2012-12-18 | Microsoft Corporation | Multichannel sound rendering via virtualization in a stereo loudspeaker system |
| KR101844336B1 (en) * | 2011-08-01 | 2018-04-02 | 삼성전자주식회사 | Signal processing apparatus and method for providing spatial |
| CN108885877B (en) * | 2016-01-22 | 2023-09-08 | 弗劳恩霍夫应用研究促进协会 | Apparatus and method for estimating inter-channel time difference |
| CN107479030B (en) * | 2017-07-14 | 2020-11-17 | 重庆邮电大学 | Frequency division and improved generalized cross-correlation based binaural time delay estimation method |
-
2019
- 2019-09-27 CN CN201910926726.0A patent/CN110740416B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402593A (en) * | 2002-07-23 | 2003-03-12 | 华南理工大学 | 5.1 path surround sound earphone repeat signal processing method |
| CN1781338A (en) * | 2003-04-30 | 2006-05-31 | 编码技术股份公司 | Advanced processing based on a complex-exponential-modulated filterbank and adaptive time signalling methods |
| CN101223820A (en) * | 2005-07-15 | 2008-07-16 | 松下电器产业株式会社 | Signal processing device |
| CN101543098A (en) * | 2007-04-17 | 2009-09-23 | 弗劳恩霍夫应用研究促进协会 | Generation of decorrelated signals |
| CN103269474A (en) * | 2007-07-19 | 2013-08-28 | 弗劳恩霍夫应用研究促进协会 | Method and apparatus for generating a stereo signal with enhanced perceptual quality |
| CN101477797A (en) * | 2008-11-24 | 2009-07-08 | 广州励丰声光科技有限公司 | Simulation system for hall acoustic environment |
| CN104995676A (en) * | 2013-02-14 | 2015-10-21 | 杜比实验室特许公司 | Signal decorrelation in an audio processing system |
| CN106714040A (en) * | 2017-01-17 | 2017-05-24 | 宁波音王电声股份有限公司 | Digital variable reverberation audio system and realization method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 电声可调混响技术在多功能剧院中的应用;丁雷;《电声技术》;20171231;第41卷(第11/12期);第1-6页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110740416A (en) | 2020-01-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9918174B2 (en) | Wireless exchange of data between devices in live events | |
| US8219394B2 (en) | Adaptive ambient sound suppression and speech tracking | |
| US8676361B2 (en) | Acoustical virtual reality engine and advanced techniques for enhancing delivered sound | |
| CN106572419B (en) | A kind of stereo audio enhancing system | |
| JPS63183495A (en) | Sound field controller | |
| US9930469B2 (en) | System and method for enhancing virtual audio height perception | |
| KR20170115079A (en) | Apparatus and live sound system for receiving and reading audio signals | |
| CN110989968A (en) | Intelligent sound effect processing method, electronic equipment, storage medium and multi-sound effect sound box | |
| US20160125871A1 (en) | Reverberant Sound Adding Apparatus, Reverberant Sound Adding Method, and Reverberant Sound Adding Program | |
| CN111554317A (en) | Voice broadcasting method, device, computer storage medium and system | |
| JP2009530680A (en) | Audio processing and equipment | |
| CN113077771B (en) | Asynchronous chorus sound mixing method and device, storage medium and electronic equipment | |
| CN110534079B (en) | Method and system for multi-sound-effect karaoke | |
| CN116437268B (en) | Adaptive frequency division surround sound upmixing method, device, equipment and storage medium | |
| CN110740416B (en) | Audio signal processing method and device | |
| CN110740404B (en) | Audio correlation processing method and audio processing device | |
| EP3607658B1 (en) | Limiter for bass enhancement | |
| US11670319B2 (en) | Enhancing artificial reverberation in a noisy environment via noise-dependent compression | |
| CN111800729B (en) | Audio signal processing device and audio signal processing method | |
| CN104599694A (en) | Volume adjusting method and device | |
| US8934996B2 (en) | Transmission apparatus and transmission method | |
| US11659330B2 (en) | Adaptive structured rendering of audio channels | |
| CN110753297B (en) | Mixing processing method and processing device for audio signals | |
| CN112511962B (en) | Control method of sound amplification system, sound amplification control device and storage medium | |
| CN113286249B (en) | Sound signal processing method and sound signal processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |