CN110740416A - audio signal processing method and device - Google Patents
audio signal processing method and device Download PDFInfo
- Publication number
- CN110740416A CN110740416A CN201910926726.0A CN201910926726A CN110740416A CN 110740416 A CN110740416 A CN 110740416A CN 201910926726 A CN201910926726 A CN 201910926726A CN 110740416 A CN110740416 A CN 110740416A
- Authority
- CN
- China
- Prior art keywords
- audio
- audio signals
- sub
- audio signal
- signal processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Stereophonic System (AREA)
Abstract
The embodiment of the invention relates to the technical field of audio processing, and discloses audio signal processing methods and devices, wherein the methods are applied to an audio signal processing device which is connected to a plurality of pickup equipment and a plurality of public address equipment, each pickup equipment corresponds to audio input channels, and each public address equipment corresponds to audio output channels.
Description
Technical Field
The invention relates to the technical field of audio processing, in particular to audio signal processing methods and devices.
Background
In order to ensure that various program performances have the optimal visual and audio effects, a plurality of professional theaters such as theaters, operas and multifunctional halls are built at home and abroad. These professional theaters often need to adjust the reverberation time of the audio signal for different performance purposes (such as opera, concert, etc.) to optimize the acoustic environment. At present, the common reverberation adjusting method mainly adjusts the reverberation time of the indoor audio signal through a mechanical sound creating method, for example, changing the indoor space volume, increasing a space coupling cavity, or changing sound absorbing materials on a ceiling, a wall, and the like. However, in practice it has been found that the range of reverberation times that can be adjusted in this way is small, so that the reverberation adjustment effect is limited.
Disclosure of Invention
The embodiment of the invention discloses audio signal processing methods and devices, which can improve the effect of reverberation adjustment.
The th aspect of the embodiment of the invention discloses a audio signal processing method, which is applied to an audio signal processing device, wherein the audio signal processing device is connected with a plurality of sound pickup equipment and a plurality of public address equipment, each sound pickup equipment corresponds to audio input channels, and each public address equipment corresponds to audio output channels, the method comprises the following steps:
obtaining reverberant audio signals for a plurality of the audio input channels;
assigning each of the reverberant audio signals to a plurality of the audio output channels such that each of the audio output channels obtains a plurality of sub-audio signals;
updating phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;
outputting the plurality of processed audio signals through the audio output channel.
As alternative implementation manners, in aspect according to an embodiment of the present invention, the allocating each of the reverberant audio signals to a plurality of the audio output channels so that each of the audio output channels obtains a plurality of sub-audio signals includes:
for each audio input channel, acquiring a current gain value set by the audio input channel for each audio output channel at the current moment; wherein the current gain value of each audio output channel is periodically changed; in each period, the current gain value of each audio output channel is in a linear correlation relationship with the current moment, and the sum of the current gain values of the audio output channels is 1;
and distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel, so that each audio output channel obtains a plurality of sub audio signals.
As alternative implementation manners, in aspect according to an embodiment of the present invention, the updating phases of the plurality of sub audio signals to obtain a plurality of processed audio signals includes:
randomly setting initial phase values and change frequencies corresponding to the plurality of sub audio signals;
and updating the phases of the plurality of sub audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub audio signals respectively to obtain a plurality of processed audio signals.
As alternative implementation manners, in aspect of embodiment of the present invention, the obtaining reverberant audio signals of a plurality of the audio input channels includes:
acquiring original audio signals of a plurality of audio input channels;
performing reverberation processing on the original audio information according to preset reverberation space simulation parameters to obtain reverberation audio signals of the audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
As an alternative implementation manner of , in the embodiment of the present invention, the audio signal processing apparatus is communicatively connected to a terminal device for controlling the audio signal processing apparatus, and before the original audio signals of a plurality of the audio input channels are acquired, the method further includes:
acquiring performance mode information transmitted by the terminal equipment; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;
and configuring the audio signal processing device according to the target configuration information, and executing the step of acquiring the original audio signals of the plurality of audio input channels when the configuration is completed.
The second aspect of the embodiment of the invention discloses audio signal processing devices, which are connected with a plurality of sound pickup equipment and a plurality of public address equipment, wherein each sound pickup equipment corresponds to audio input channels, and each public address equipment corresponds to audio output channels, and the device comprises:
an th obtaining unit, for obtaining the reverberation audio signals of a plurality of the audio input channels;
a distribution unit for distributing each of the reverberant audio signals to a plurality of the audio output channels such that each of the audio output channels obtains a plurality of sub-audio signals;
an updating unit for updating the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;
an output unit for outputting the plurality of processed audio signals through the audio output channel.
As optional implementation manners, in the second aspect of the embodiment of the present invention, the allocation unit includes:
, an obtaining subunit, configured to obtain, for each audio input channel, a current gain value that is set by the audio input channel for each audio output channel at a current time, where the current gain value of each audio output channel changes periodically, and in each period, the current gain value of each audio output channel is linearly related to the current time, and a sum of the current gain values of the audio output channels is 1;
and the distribution subunit is used for distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel so that each audio output channel obtains a plurality of sub audio signals.
As optional implementation manners, in the second aspect of the embodiment of the present invention, the updating unit includes:
a setting subunit, configured to randomly set an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals;
and the updating subunit is used for updating the phases of the plurality of sub-audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub-audio signals respectively so as to obtain a plurality of processed audio signals.
As alternative implementation manners, in the second aspect of the embodiment of the present invention, the th obtaining unit includes:
a second obtaining subunit, configured to obtain original audio signals of a plurality of the audio input channels;
the processing subunit is configured to perform reverberation processing on the multiple pieces of original audio information according to a preset reverberation space simulation parameter to obtain reverberation audio signals of multiple audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
As optional implementation manners, in the second aspect of the embodiment of the present invention, the apparatus is communicatively connected to a terminal device for controlling the apparatus, and the obtaining unit further includes:
a third acquiring subunit, configured to acquire performance mode information transmitted by the terminal device before the second acquiring subunit acquires original audio signals of the multiple audio input channels; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
the calling subunit is used for calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;
and the configuration subunit is configured to configure the audio signal processing apparatus according to the target configuration information, and trigger the second acquisition subunit to perform the acquisition of the original audio signals of the plurality of audio input channels when the configuration is completed.
The third aspect of the embodiment of the present invention discloses audio signal processing apparatuses, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program codes stored in the memory to execute the audio signal processing method disclosed by aspect of the embodiment of the invention.
The fourth aspect of the present embodiment discloses computer-readable storage media storing a computer program, wherein the computer program causes a computer to execute the audio signal processing methods disclosed in the aspect of the present embodiment.
A fifth aspect of embodiments of the present invention discloses computer program products for, when run on a computer, causing the computer to perform some or all of the steps of any of the methods of aspect .
A sixth aspect of an embodiment of the present invention discloses application publication platforms for publishing a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform some or all of the steps of any of the methods of aspect .
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the audio signal processing method is applied to an audio signal processing device, the audio signal processing device is connected with a plurality of sound pickup devices and a plurality of sound amplifying devices, each sound pickup device corresponds to audio input channels, and each sound amplifying device corresponds to audio output channels.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic structural diagram of acoustic systems disclosed in an embodiment of the present invention;
FIG. 2 is a flow chart of audio signal processing methods disclosed in the embodiments of the present invention;
FIG. 3 is a schematic diagram of the distribution of types of reverberation audio signals disclosed by the embodiment of the invention;
FIG. 4 is a schematic diagram of the distribution of another types of reverberant audio signals disclosed in the embodiments of the present invention;
FIG. 5 is a flow chart of another audio signal processing methods disclosed in the embodiments of the present invention;
FIG. 6 is a schematic structural diagram of audio signal processing devices according to an embodiment of the disclosure;
FIG. 7 is a schematic structural diagram of another audio signal processing devices according to the disclosure of the present invention;
fig. 8 is a schematic structural diagram of another audio signal processing devices disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only partial embodiments of of the present invention, rather than all embodiments.
It should be noted that the terms "," "second," "third," "fourth," and the like in the description and claims of the present invention are used for distinguishing between different objects and not necessarily for describing a particular order, the terms "comprising" and "having" and any variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a series of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Please refer to fig. 1, which is a schematic structural diagram of a acoustic system disclosed in the embodiment of the present invention, in the acoustic system shown in fig. 1, the audio signal processing apparatus is configured to receive audio signals picked up by a plurality of pickup devices (such as microphones) and a plurality of sound amplification devices (such as sound boxes), process the audio signals, and output the processed audio signals to the sound amplification devices for audio playing.
Example
Referring to fig. 2, fig. 2 is a flowchart illustrating audio signal processing methods according to an embodiment of the invention, and as shown in fig. 2, the audio signal processing method may include the following steps.
201. An audio signal processing apparatus acquires reverberant audio signals of a plurality of audio input channels.
202. The audio signal processing means assigns each reverberant audio signal to a plurality of audio output channels, such that each audio output channel obtains a plurality of sub-audio signals.
In the embodiment of the present invention, the audio signal processing apparatus may equally distribute each of the reverberant audio signals to a plurality of audio output channels, that is, if the audio signal processing apparatus is connected to N (N is a positive integer) audio output channels, for reverberant audio signals P, the sub-audio signals distributed to any audio output channels are
Referring to fig. 3, fig. 3 is a schematic diagram illustrating distribution of types of reverberant audio signals according to an embodiment of the present invention, in fig. 3, it is assumed that an audio signal processing apparatus is connected to three audio input channels and three audio output channels, after receiving a th reverberant audio signal of an audio input channel a, the audio signal processing apparatus divides a th reverberant audio signal into a th sub-audio signal, a second sub-audio signal and a third sub-audio signal, wherein gain values of the th sub-audio signal, the second sub-audio signal and the third sub-audio signal are times of a th reverberant audio signal, and then the audio signal processing apparatus transmits the th sub-audio signal to the audio output channel a through a sub-link 31, transmits the second sub-audio signal to an audio output channel B through the sub-link 32, and transmits the third sub-audio signal to an audio output channel C through the sub-link 33.
Similarly, the audio signal processing apparatus equally divides the second reverberated audio signal of the audio input channel B into the fourth sub audio signal, the fifth sub audio signal, and the sixth sub audio signal, then transmits the fourth sub audio signal to the audio output channel B through the sub link 34, transmits the fifth sub audio signal to the audio output channel A through the sub link 35, and transmits the sixth sub audio signal to the audio output channel C through the sub link 36, after equally dividing the third reverberated audio signal of the audio input channel C into the seventh sub audio signal, the eighth sub audio signal, and the ninth sub audio signal, then transmits the seventh sub audio signal to the audio output channel C through the sub link 37, transmits the eighth sub audio signal to the audio output channel A through the sub link 38, and transmits the ninth sub audio signal to the audio output channel B through the sub link 39, at this time, the audio output channel A pre-receives the fourth sub audio signal, the fifth sub audio signal, the eighth sub audio signal, the sixth sub audio signal, the ninth sub audio signal, and the ninth sub audio signal.
As optional embodiments, step 202 may specifically include:
aiming at each audio input channel, the audio signal processing device acquires a current gain value set for each audio output channel by the audio input channel at the current moment; wherein, the current gain value of each audio output channel is changed periodically; in each period, the current gain value of each audio output channel is in linear correlation with the current moment, and the sum of the current gain values of the audio output channels is 1;
the audio signal processing means assigns the reverberant audio signal to each audio output channel according to the current gain value of each audio output channel, so that a plurality of sub-audio signals are obtained for each audio output channel.
It is to be understood that since the current gain value set for any audio output channel by each audio input channel is a periodic time-varying value, the audio signal processing apparatus may equally distribute the reverberant audio signal of each audio input channel to a plurality of audio output channels in scaling ratios over time.
Referring to fig. 4, fig. 4 is a schematic diagram illustrating distribution of another types of reverberant audio signals according to an embodiment of the present invention, in fig. 4, assuming that the gain variation frequency is T (e.g., 1ms), if the current time T corresponds to the time T of th gain variation, the gains of the audio input channel a and the audio output channel A, B, C are respectively set to 1, 0, and at this time, the audio signal processing apparatus transmits all of the th reverberant audio signal of the audio input channel a to the audio output channel a, and similarly, the audio signal processing apparatus transmits all of the second reverberant audio signal of the audio input channel B to the audio output channel B, and transmits all of the third reverberant audio signal of the audio input channel C to the audio output channel C.
If the current time T corresponds to the time 2T of the second gain change, the audio input channel a sets the gains of 0.9, 0.1 and 0 for the audio output channel A, B, C, respectively, and the audio signal processing apparatus divides the fourth reverberation audio signal S of the audio input channel a into the st sub-audio signal 0.9S and the second sub-audio signal 0.1S and transmits the th sub-audio signal 0.9S to the audio output channel a and the second sub-audio signal 0.1S to the audio output channel B, and similarly, the audio signal processing apparatus divides the fifth reverberation audio signal Q of the audio input channel B into the third sub-audio signal 0.9Q and the fourth sub-audio signal 0.1Q and transmits the third sub-audio signal 0.9Q to the audio output channel B and transmits the fourth sub-audio signal 0.1Q to the audio output channel C, and the audio signal processing apparatus divides the sixth reverberation audio signal R of the audio input channel C into the sixth reverberation signal R0.9R 0.1R and the sixth sub-audio signal R0.9R 1R 0.1R and outputs the sixth sub-audio signal R1 to the audio output channel C.
It should be further understood that, assuming that T is 0-2T as the th period, in the next periods (i.e., T is 2T-4T), the gain variation rule of each audio output channel corresponds to the gain variation rule of each audio output channel in th period (i.e., T is 0-2T), and will not be described herein again.
Therefore, in the implementation of the optional embodiment, since the sum of the gain values set for the plurality of audio output channels by each audio input channel is 1, the reverberation audio signal input by each audio input channel can be distributed to the plurality of audio output channels, and the distribution mode of the audio signal can be adjusted in real time based on the periodic time-varying characteristic of the gain values, which is beneficial to improving the sound field uniformity.
203. The audio signal processing device updates the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated.
In this embodiment of the present invention, the fact that the phases of the processed audio signals are not all correlated means that the difference between the cross spectra of any two processed audio signals in the processed audio signals is greater than a preset difference (for example, 0.5), which is not specifically limited.
It will be appreciated that the closer the relationship between the phases of the audio signals, the stronger the correlation of the audio signals. For example, two audio signals have the same phase or the ratio between the phases of the two audio signals is an integer, and the two audio signals have strong correlation at this time, and if the two audio signals are directly output through a public address device, distortion of the audio signals may be caused. Furthermore, the human ear is less sensitive to phase changes, so in the embodiment of the present invention, the audio signal processing apparatus can update the phases of a plurality of sub-audio signals from different audio input channels, thereby reducing the correlation of the sub-audio signals.
204. The audio signal processing apparatus outputs a plurality of processed audio signals through an audio output channel.
It can be seen that implementing the method described in fig. 2, by obtaining the reverberant audio signals of multiple audio input channels and distributing each reverberant audio signal to multiple audio output channels, so that each audio output channel obtains sub audio signals from different audio input channels, the sound field uniformity can be improved; in addition, the phases of the plurality of sub audio signals are updated, so that each audio output channel outputs a processed audio signal with a plurality of irrelevant phases, and the relevance of the audio signals can be reduced, so that the reverberation gain is improved, and the reverberation adjusting effect is greatly improved.
Example two
Referring to fig. 5, fig. 5 is a flowchart illustrating another audio signal processing methods according to an embodiment of the present invention, and as shown in fig. 5, the audio signal processing method may include the following steps.
501. An audio signal processing apparatus acquires original audio signals of a plurality of audio input channels.
In the embodiment of the present invention, the original audio signal may be an audio signal collected at the actual performance location and not reproduced by the public address device and not reflected (such as direct sound), or may be an audio signal reproduced by multiple reflections (such as early reflected sound) or by a public address device (such as reverberant sound), which is not limited herein.
502. The audio signal processing device performs reverberation processing on a plurality of original audio information according to preset reverberation space simulation parameters to obtain reverberation audio signals of a plurality of audio input channels.
In the embodiment of the invention, the reverberation space simulation parameters comprise reverberation time, bass ratio, delay time and intensity factor. It will be appreciated that the hall shows are targeted differently, as are the optimum reverberation parameters (such as the optimum reverberation time) required by the hall. Therefore, by implementing the above steps 501 and 502, reverberation processing is performed on the original audio signal of the hall according to the preset reverberation space simulation parameters, and the acoustic environment meeting the purpose of a specific performance can be simulated, so as to bring optimal hearing experience to the audience.
As an alternative , the audio signal processing apparatus is further communicatively connected to a terminal device for controlling the audio signal processing apparatus, and before step 501, the method may further include:
the audio signal processing device acquires performance mode information transmitted by the terminal equipment; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
the audio signal processing device calls target configuration information matched with the performance mode information according to the performance mode information; the target configuration information comprises preset reverberation space simulation parameters;
the audio signal processing device configures the audio signal processing device according to the target configuration information;
the audio signal processing apparatus acquires original audio signals of a plurality of audio input channels when configuration is completed.
The terminal device may include, but is not limited to, a mobile terminal device, a remote control device, and an overall control server associated with the audio signal processing apparatus. The performance mode may include, but is not limited to, a concert, a music play, a drama, a dance, a magic, and a synthesis art. And each performance mode is stored in association with the target configuration information matched with the performance mode. Therefore, by implementing the optional implementation mode, the audio signal processing device is adjusted to the optimal working mode indicated by the target configuration information by calling the target configuration information matched with the performance mode selected by the user, so that the intelligent degree of the audio signal processing device can be improved; in addition, redundant manual debugging steps can be reduced, and remote interactivity with the user is improved.
, as an alternative to , the target configuration information may further include preset device information, where the preset device information includes the number of enabled microphones and the locations of the enabled microphones, and the number of enabled loudspeakers and the locations of the enabled loudspeakers in the performance mode.
The audio signal processing device acquires current equipment information of a plurality of pickup equipment and a plurality of public address equipment; wherein the current device information includes a device type (such as a sound pickup device or a sound amplification device) and a device location;
the audio signal processing device judges whether the current equipment information of the plurality of pickup equipment and the plurality of public address equipment is consistent with the preset equipment information;
if the audio signal processing device does not accord with the equipment adjusting instruction, the audio signal processing device sends the equipment adjusting instruction to the terminal equipment, so that the terminal equipment responds to the equipment adjusting instruction and outputs an equipment adjusting page; the equipment adjusting page comprises a floor plan of the current performance place, and the actual positions of the plurality of pickup equipment, the actual positions of the plurality of sound amplifying equipment, the number of the pickup equipment indicated by preset equipment information, the preset positions of the plurality of sound amplifying equipment, the number of the sound amplifying equipment indicated by the preset equipment information and the preset positions of the plurality of sound amplifying equipment are marked on the floor plan so as to guide a user to adjust the equipment distribution of the current performance place according to the indication of the floor plan;
the audio signal processing device acquires original audio signals of a plurality of audio input channels when configuration is completed, and comprises the following components:
and when the configuration of the audio signal processing device is finished and the current equipment information conforms to the preset equipment information, acquiring original audio signals of a plurality of audio input channels.
As another optional implementation manners, before step 501, the method may further include:
when the audio signal processing device enters the manual configuration mode, restoring to default configuration according to default configuration information corresponding to the manual configuration mode;
the audio signal processing device acquires the real-time configuration information transmitted by the terminal equipment, configures and debugs the audio signal processing device according to the real-time configuration information until the manual configuration is detected to be completed, and stores the corresponding performance mode and configuration information as new configuration information in a correlation manner when the manual configuration is completed.
Therefore, the optional implementation mode can also store the performance mode and the configuration information configured manually by the user, so that more actual performance requirements of the user are met.
503. The audio signal processing means assigns each reverberant audio signal to a plurality of audio output channels, such that each audio output channel obtains a plurality of sub-audio signals.
504. The audio signal processing device randomly sets an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals.
505. The audio signal processing device updates the phases of the plurality of sub audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub audio signals, so as to obtain a plurality of processed audio signals.
It can be seen that, by implementing the step 504 and the step 505, the initial phase values and the variation frequencies of the plurality of sub audio signals are randomly set, so that the frequency of phase update and the initial phase value of each sub audio signal are not fixed at each time of phase update, which further reduces the correlation between the plurality of sub audio signals.
506. The audio signal processing apparatus outputs a plurality of processed audio signals through an audio output channel.
It can be seen that, by implementing the method described in fig. 5, by obtaining the reverberant audio signals of multiple audio input channels and allocating each reverberant audio signal to multiple audio output channels, the sound field uniformity can be improved, and in addition, the initial phase values and the variation frequencies of multiple sub audio signals are randomly set, so that the frequency of phase update and the initial phase value of each sub audio signal are not fixed each time the phase is updated, which can further reduce the correlation between multiple sub audio signals, thereby improving the reverberant gain and greatly improving the effect of reverberation adjustment, and further can simulate the acoustic environment meeting the purpose of a specific performance, so as to bring the optimal hearing experience to the listener, and further can adjust the audio signal processing apparatus to the optimal working mode indicated by the target configuration information, so as to improve the intelligence degree of the audio signal processing apparatus, reduce the redundant human tuning steps, and improve the remote interactivity with the user.
EXAMPLE III
Referring to fig. 6, fig. 6 is a schematic structural diagram of audio signal processing apparatuses according to an embodiment of the present invention, the audio signal processing apparatus shown in fig. 6 is connected to a plurality of sound pickup devices and a plurality of sound amplifying devices, each sound pickup device corresponds to audio input channels, and each sound amplifying device corresponds to audio output channels, as shown in fig. 6, the electronic apparatus may include a obtaining unit 601, a distributing unit 602, an updating unit 603, and an output unit 604, wherein:
an th obtaining unit 601 for obtaining reverberant audio signals of multiple audio input channels.
A distribution unit 602 for distributing each reverberant audio signal to a plurality of audio output channels such that a plurality of sub-audio signals are obtained for each audio output channel.
An updating unit 603 for updating the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated.
An output unit 604 for outputting a plurality of processed audio signals through the audio output channel.
As an alternative to , the distribution unit 602 includes:
, an obtaining subunit, configured to obtain, for each audio input channel, a current gain value that is set by the audio input channel for each audio output channel at the current time, where the current gain value of each audio output channel changes periodically, and in each period, the current gain value of each audio output channel is linearly related to the current time, and the sum of the current gain values of the multiple audio output channels is 1;
and the distribution subunit is used for distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel, so that each audio output channel obtains a plurality of sub audio signals.
It can be seen that implementing the apparatus described in fig. 6, by obtaining the reverberant audio signals of multiple audio input channels, and distributing each reverberant audio signal to multiple audio output channels, so that each audio output channel obtains sub audio signals from different audio input channels, the sound field uniformity can be improved; in addition, the phases of the plurality of sub audio signals are updated, so that each audio output channel outputs a processed audio signal with a plurality of irrelevant phases, and the relevance of the audio signals can be reduced, so that the reverberation gain is improved, and the reverberation adjusting effect is greatly improved.
Example four
Referring to fig. 7, fig. 7 is a schematic structural diagram of another audio signal processing apparatuses according to an embodiment of the present invention, wherein the audio signal processing apparatus shown in fig. 7 is optimized by the audio signal processing apparatus shown in fig. 6, and compared with the audio signal processing apparatus shown in fig. 6, in the audio signal processing apparatus shown in fig. 7:
the updating unit 603 includes:
a setting stator unit 6031 configured to randomly set an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals;
an updating sub-unit 6032, configured to perform update processing on the phases of the multiple sub-audio signals according to the initial phase values and the change frequencies corresponding to the multiple sub-audio signals, so as to obtain multiple processed audio signals.
The th acquisition unit 601 includes:
a second obtaining subunit 6011, configured to obtain original audio signals of a plurality of audio input channels;
a processing subunit 6012, configured to perform reverberation processing on the multiple pieces of original audio information according to a preset reverberation space simulation parameter, so as to obtain reverberation audio signals of multiple audio input channels; the reverberation space simulation parameters comprise reverberation time, frequency power distribution of reverberation sound energy, delay time and channel transmission frequency.
As optional implementation modes, the audio signal processing device is also connected with a terminal device for controlling the audio signal processing device in a communication way, the acquisition unit 601 further comprises:
a third acquiring subunit 6013, configured to acquire performance mode information transmitted by the terminal device before the second acquiring subunit 6011 acquires original audio signals of multiple audio input channels; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;
a calling subunit 6014, configured to call, according to the performance mode information, target configuration information matched with the performance mode information; the target configuration information comprises preset reverberation space simulation parameters;
a configuration subunit 6015, configured to configure the audio signal processing apparatus according to the target configuration information, and trigger the second acquisition subunit 6011 to perform acquiring the original audio signals of the multiple audio input channels when the configuration is completed.
, as an alternative to embodiments, the target configuration information may further include preset device information, the preset device information includes the number of enabled microphones and the locations of the enabled microphones, and the number of enabled loudspeakers and the locations of the enabled loudspeakers for the performance mode.
The second acquisition unit is used for acquiring current equipment information of the plurality of pickup equipment and the plurality of public address equipment when configuration is completed; wherein the current device information includes a device type (such as a sound pickup device or a sound amplification device) and a device location;
a determining unit, configured to determine whether current device information of the multiple sound pickup devices and the multiple sound amplifying devices matches preset device information, and if so, trigger the second obtaining subunit 6011 to perform obtaining of original audio signals of the multiple audio input channels;
the sending unit is used for sending a device adjusting instruction to the terminal device when the judging unit judges that the current device information is not accordant with the preset device information, so that the terminal device responds to the device adjusting instruction and outputs a device adjusting page; the equipment adjusting page comprises a floor plan of the current performance place, and the actual positions of the pickup equipment, the actual positions of the sound amplifying equipment, the number of the pickup equipment indicated by the preset equipment information, the preset positions of the sound amplifying equipment, the number of the sound amplifying equipment indicated by the preset equipment information and the preset positions of the sound amplifying equipment are marked on the floor plan, so that a user can be guided to adjust the equipment distribution of the current performance place according to the indication of the floor plan.
As another alternative embodiments, the audio signal processing apparatus may further include:
the recovery unit is used for recovering to the default configuration according to the default configuration information corresponding to the manual configuration mode when entering the manual configuration mode;
and the debugging unit is used for acquiring the real-time configuration information transmitted by the terminal equipment, configuring and debugging the audio information processing device according to the real-time configuration information until the manual configuration is detected to be completed, and performing associated storage on the corresponding performance mode and the configuration information as new configuration information when the manual configuration is completed.
Therefore, the optional implementation mode can also store the performance mode and the configuration information configured manually by the user, so that more actual performance requirements of the user are met.
It can be seen that, with the implementation of the apparatus described in fig. 7, by obtaining the reverberant audio signals of multiple audio input channels and allocating each reverberant audio signal to multiple audio output channels, the sound field uniformity can be improved, in addition, the initial phase values and the variation frequencies of multiple sub audio signals are randomly set, so that the frequency of phase update and the initial phase value of each sub audio signal are not fixed each time the phase is updated, thus steps can be further performed to reduce the correlation between multiple sub audio signals, thereby improving the reverberant gain and greatly improving the effect of reverberation adjustment, steps can be further performed to simulate the acoustic environment meeting the purpose of a specific performance, so as to bring the optimal hearing experience to the listener, and steps are further performed to adjust the audio signal processing apparatus to the optimal working mode indicated by the target configuration information, so as to improve the intelligence degree of the audio signal processing apparatus, reduce the redundant human tuning steps, and improve the remote interactivity with the user.
EXAMPLE five
Referring to fig. 8, fig. 8 is a schematic structural diagram of another audio signal processing apparatuses according to the disclosure of the embodiment of the disclosure, as shown in fig. 8, the audio signal processing apparatus may include:
a memory 801 in which executable program code is stored;
a processor 802 coupled with the memory 801;
the processor 802 calls the executable program code stored in the memory 801 to execute audio signal processing methods shown in fig. 2 or fig. 5.
The embodiment of the present invention discloses computer-readable storage media storing a computer program, wherein the computer program causes a computer to execute audio signal processing methods shown in fig. 2 or fig. 5.
Embodiments of the present invention also disclose computer program products, wherein the computer program product, when run on a computer, causes the computer to perform some or all of the steps of a method as in the above method embodiments.
The embodiment of the invention also discloses application publishing platforms, which are used for publishing computer program products, wherein when the computer program products run on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.
It will be understood by those skilled in the art that all or part of the steps in the methods of the above embodiments may be implemented by instructions associated with a program, which may be stored in computer-readable storage media including Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (CD-ROM) or other Memory capable of storing data, magnetic tape, or any other computer-readable medium capable of carrying data.
The audio signal processing methods and apparatuses disclosed in the embodiments of the present invention are described above in detail, and the principles and embodiments of the present invention are explained herein by using specific examples, and the above description of the embodiments is only used to help understand the method and the core idea of the present invention, meanwhile, for persons in the art, the contents of the present description should not be construed as limiting the present invention in all respects.
Claims (10)
- The audio signal processing method is applied to an audio signal processing device, the audio signal processing device is connected with a plurality of sound pickup equipment and a plurality of public address equipment, each sound pickup equipment corresponds to audio input channels, and each public address equipment corresponds to audio output channels, the method comprises the following steps:obtaining reverberant audio signals for a plurality of the audio input channels;assigning each of the reverberant audio signals to a plurality of the audio output channels such that each of the audio output channels obtains a plurality of sub-audio signals;updating phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;outputting the plurality of processed audio signals through the audio output channel.
- 2. The method of claim 1, wherein said distributing each of said reverberant audio signals to a plurality of said audio output channels such that each of said audio output channels obtains a plurality of sub-audio signals, comprises:for each audio input channel, acquiring a current gain value set by the audio input channel for each audio output channel at the current moment; wherein the current gain value of each audio output channel is periodically changed; in each period, the current gain value of each audio output channel is in a linear correlation relationship with the current moment, and the sum of the current gain values of the audio output channels is 1;and distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel, so that each audio output channel obtains a plurality of sub audio signals.
- 3. The method of claim 1, wherein the updating the phases of the plurality of sub-audio signals to obtain a plurality of processed audio signals comprises:randomly setting initial phase values and change frequencies corresponding to the plurality of sub audio signals;and updating the phases of the plurality of sub audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub audio signals respectively to obtain a plurality of processed audio signals.
- 4. The method of any of claims 1-3, wherein the obtaining the reverberant audio signals for a plurality of the audio input channels comprises:acquiring original audio signals of a plurality of audio input channels;performing reverberation processing on the original audio information according to preset reverberation space simulation parameters to obtain reverberation audio signals of the audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
- 5. The method of claim 4, wherein the audio signal processing apparatus is communicatively connected to a terminal device for controlling the audio signal processing apparatus; before the obtaining of the original audio signals of the plurality of audio input channels, the method further comprises:acquiring performance mode information transmitted by the terminal equipment; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;and configuring the audio signal processing device according to the target configuration information, and executing the step of acquiring the original audio signals of the plurality of audio input channels when the configuration is completed.
- 6, audio signal processing device, wherein the device is connected to a plurality of sound collecting devices and a plurality of sound amplifying devices, each sound collecting device corresponds to audio input channels, and each sound amplifying device corresponds to audio output channels, the device comprises:an th obtaining unit, for obtaining the reverberation audio signals of a plurality of the audio input channels;a distribution unit for distributing each of the reverberant audio signals to a plurality of the audio output channels such that each of the audio output channels obtains a plurality of sub-audio signals;an updating unit for updating the phases of the plurality of sub audio signals to obtain a plurality of processed audio signals; wherein the phases of the plurality of processed audio signals are uncorrelated;an output unit for outputting the plurality of processed audio signals through the audio output channel.
- 7. The apparatus of claim 6, wherein the allocation unit comprises:, an obtaining subunit, configured to obtain, for each audio input channel, a current gain value that is set by the audio input channel for each audio output channel at a current time, where the current gain value of each audio output channel changes periodically, and in each period, the current gain value of each audio output channel is linearly related to the current time, and a sum of the current gain values of the audio output channels is 1;and the distribution subunit is used for distributing the reverberation audio signal to each audio output channel according to the current gain value of each audio output channel so that each audio output channel obtains a plurality of sub audio signals.
- 8. The apparatus of claim 6, wherein the updating unit comprises:a setting subunit, configured to randomly set an initial phase value and a variation frequency corresponding to each of the plurality of sub audio signals;and the updating subunit is used for updating the phases of the plurality of sub-audio signals according to the initial phase values and the change frequencies corresponding to the plurality of sub-audio signals respectively so as to obtain a plurality of processed audio signals.
- 9. The apparatus according to any one of claims 6 to 8 and , wherein the acquisition unit comprises:a second obtaining subunit, configured to obtain original audio signals of a plurality of the audio input channels;the processing subunit is configured to perform reverberation processing on the multiple pieces of original audio information according to a preset reverberation space simulation parameter to obtain reverberation audio signals of multiple audio input channels; wherein the reverberation space simulation parameters include a reverberation time, a frequency power distribution of reverberant sound energy, a delay time, and a channel transmission frequency.
- 10. The apparatus according to claim 9, wherein the apparatus is communicatively connected to a terminal device for controlling the apparatus, and the acquisition unit further comprises:a third acquiring subunit, configured to acquire performance mode information transmitted by the terminal device before the second acquiring subunit acquires original audio signals of the multiple audio input channels; the performance mode information is a performance mode which is selected by a user on the terminal equipment according to the current performance place;the calling subunit is used for calling target configuration information matched with the performance mode information according to the performance mode information; wherein the target configuration information comprises preset reverberation space simulation parameters;and the configuration subunit is configured to configure the audio signal processing apparatus according to the target configuration information, and trigger the second acquisition subunit to perform the acquisition of the original audio signals of the plurality of audio input channels when the configuration is completed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910926726.0A CN110740416B (en) | 2019-09-27 | 2019-09-27 | Audio signal processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910926726.0A CN110740416B (en) | 2019-09-27 | 2019-09-27 | Audio signal processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110740416A true CN110740416A (en) | 2020-01-31 |
| CN110740416B CN110740416B (en) | 2021-04-06 |
Family
ID=69268265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910926726.0A Active CN110740416B (en) | 2019-09-27 | 2019-09-27 | Audio signal processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110740416B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402593A (en) * | 2002-07-23 | 2003-03-12 | 华南理工大学 | 5.1 path surround sound earphone repeat signal processing method |
| US20060045275A1 (en) * | 2002-11-19 | 2006-03-02 | France Telecom | Method for processing audio data and sound acquisition device implementing this method |
| CN1781338A (en) * | 2003-04-30 | 2006-05-31 | 编码技术股份公司 | Advanced processing based on a complex-exponential-modulated filterbank and adaptive time signalling methods |
| CN101223820A (en) * | 2005-07-15 | 2008-07-16 | 松下电器产业株式会社 | Signal processing device |
| CN101477797A (en) * | 2008-11-24 | 2009-07-08 | 广州励丰声光科技有限公司 | Simulation system for hall acoustic environment |
| US20090185693A1 (en) * | 2008-01-18 | 2009-07-23 | Microsoft Corporation | Multichannel sound rendering via virtualization in a stereo loudspeaker system |
| CN101543098A (en) * | 2007-04-17 | 2009-09-23 | 弗劳恩霍夫应用研究促进协会 | Generation of decorrelated signals |
| US20130034235A1 (en) * | 2011-08-01 | 2013-02-07 | Samsung Electronics Co., Ltd. | Signal processing apparatus and method for providing spatial impression |
| CN103269474A (en) * | 2007-07-19 | 2013-08-28 | 弗劳恩霍夫应用研究促进协会 | Method and apparatus for generating a stereo signal with enhanced perceptual quality |
| CN104995676A (en) * | 2013-02-14 | 2015-10-21 | 杜比实验室特许公司 | Signal decorrelation in an audio processing system |
| CN106714040A (en) * | 2017-01-17 | 2017-05-24 | 宁波音王电声股份有限公司 | Digital variable reverberation audio system and realization method thereof |
| CN107479030A (en) * | 2017-07-14 | 2017-12-15 | 重庆邮电大学 | Based on frequency dividing and improved broad sense cross-correlation ears delay time estimation method |
| CN107710323A (en) * | 2016-01-22 | 2018-02-16 | 弗劳恩霍夫应用研究促进协会 | Resampled using spectrum domain to encode or decode the device and method of audio multichannel signal |
-
2019
- 2019-09-27 CN CN201910926726.0A patent/CN110740416B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402593A (en) * | 2002-07-23 | 2003-03-12 | 华南理工大学 | 5.1 path surround sound earphone repeat signal processing method |
| US20060045275A1 (en) * | 2002-11-19 | 2006-03-02 | France Telecom | Method for processing audio data and sound acquisition device implementing this method |
| CN1781338A (en) * | 2003-04-30 | 2006-05-31 | 编码技术股份公司 | Advanced processing based on a complex-exponential-modulated filterbank and adaptive time signalling methods |
| CN101223820A (en) * | 2005-07-15 | 2008-07-16 | 松下电器产业株式会社 | Signal processing device |
| CN101543098A (en) * | 2007-04-17 | 2009-09-23 | 弗劳恩霍夫应用研究促进协会 | Generation of decorrelated signals |
| CN103269474A (en) * | 2007-07-19 | 2013-08-28 | 弗劳恩霍夫应用研究促进协会 | Method and apparatus for generating a stereo signal with enhanced perceptual quality |
| US20090185693A1 (en) * | 2008-01-18 | 2009-07-23 | Microsoft Corporation | Multichannel sound rendering via virtualization in a stereo loudspeaker system |
| CN101477797A (en) * | 2008-11-24 | 2009-07-08 | 广州励丰声光科技有限公司 | Simulation system for hall acoustic environment |
| US20130034235A1 (en) * | 2011-08-01 | 2013-02-07 | Samsung Electronics Co., Ltd. | Signal processing apparatus and method for providing spatial impression |
| CN104995676A (en) * | 2013-02-14 | 2015-10-21 | 杜比实验室特许公司 | Signal decorrelation in an audio processing system |
| CN107710323A (en) * | 2016-01-22 | 2018-02-16 | 弗劳恩霍夫应用研究促进协会 | Resampled using spectrum domain to encode or decode the device and method of audio multichannel signal |
| CN106714040A (en) * | 2017-01-17 | 2017-05-24 | 宁波音王电声股份有限公司 | Digital variable reverberation audio system and realization method thereof |
| CN107479030A (en) * | 2017-07-14 | 2017-12-15 | 重庆邮电大学 | Based on frequency dividing and improved broad sense cross-correlation ears delay time estimation method |
Non-Patent Citations (1)
| Title |
|---|
| 丁雷: "电声可调混响技术在多功能剧院中的应用", 《电声技术》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110740416B (en) | 2021-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3092824B1 (en) | Calibration of virtual height speakers using programmable portable devices | |
| US9918174B2 (en) | Wireless exchange of data between devices in live events | |
| WO2007127762A2 (en) | Method and system for sound beam- forming using internal device speakers in conjunction with external speakers | |
| JP2003506984A (en) | Compensation system and compensation method for sound reproduction | |
| JP2011010183A (en) | Music reproduction system, mobile terminal device and music reproduction program | |
| EP3026666B1 (en) | Reverberant sound adding apparatus, reverberant sound adding method, and reverberant sound adding program | |
| CN110989968A (en) | Intelligent sound effect processing method, electronic equipment, storage medium and multi-sound effect sound box | |
| US9930469B2 (en) | System and method for enhancing virtual audio height perception | |
| CN105390144A (en) | Audio processing method and audio processing device | |
| US11670319B2 (en) | Enhancing artificial reverberation in a noisy environment via noise-dependent compression | |
| US10523171B2 (en) | Method for dynamic sound equalization | |
| CN113553022A (en) | Equipment adjusting method and device, mobile terminal and storage medium | |
| KR20210124217A (en) | Intelligent personal assistant | |
| CN110534079B (en) | Method and system for multi-sound-effect karaoke | |
| CN111800729B (en) | Audio signal processing device and audio signal processing method | |
| CN116437268B (en) | Adaptive frequency division surround sound upmixing method, device, equipment and storage medium | |
| CN110740416B (en) | Audio signal processing method and device | |
| CN110740404B (en) | Audio correlation processing method and audio processing device | |
| JP4888207B2 (en) | Filter device and sound field support system | |
| CN104599694A (en) | Volume adjusting method and device | |
| CN110312198B (en) | Virtual sound source repositioning method and device for digital cinema | |
| JP5213733B2 (en) | Transmitting device, receiving device, transmitting method, receiving method | |
| US11659330B2 (en) | Adaptive structured rendering of audio channels | |
| CN113286249B (en) | Sound signal processing method and sound signal processing device | |
| CN110753297B (en) | Mixing processing method and processing device for audio signals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |