CN113518286B - Reverberation processing method and device for audio signal, electronic equipment and storage medium - Google Patents
Reverberation processing method and device for audio signal, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113518286B CN113518286B CN202110732044.3A CN202110732044A CN113518286B CN 113518286 B CN113518286 B CN 113518286B CN 202110732044 A CN202110732044 A CN 202110732044A CN 113518286 B CN113518286 B CN 113518286B
- Authority
- CN
- China
- Prior art keywords
- stage
- audio signal
- echo
- reverberation
- pass filter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The invention relates to the technical field of signal processing, and discloses a reverberation processing method and device of an audio signal, electronic equipment and a storage medium. The reverberation processing method of the audio signal comprises the following steps: acquiring an original audio signal to be processed; inputting the original audio signals into a preset multi-stage reverberation effector to obtain a first echo signal and a second echo signal corresponding to each stage; wherein the echo output of each stage is used as the input of the next stage; mixing the first echo signal corresponding to each stage with the original audio signal to obtain a corresponding first reverberation audio signal; and mixing the second echo signal corresponding to each stage with the original audio signal to obtain a corresponding second reverberation audio signal. The invention improves the reverberation effect of the audio signal.
Description
Technical Field
The present invention relates to the field of signal processing technologies, and in particular, to a method and apparatus for processing reverberation of an audio signal, an electronic device, and a storage medium.
Background
When playing music, the reverberant sound effect is a sound effect when the simulated sound is reflected back through all walls in a room and then is overlapped with the current sound, and a reverberator is generally used for realizing the reverberant sound effect. In the existing reverberator, the generated reverberation often has the defects of insufficient obvious change of space sense, insufficient continuity and completeness of early, middle and later reflections of the reverberation, and unreal and natural reverberation effect.
Therefore, how to improve the reverberation effect is a problem to be solved.
Disclosure of Invention
The invention mainly aims to solve the technical problem of poor reverberation effect of the existing reverberator.
The first aspect of the present invention provides a reverberation processing method of an audio signal, the reverberation processing method of the audio signal including:
acquiring an original audio signal to be processed;
inputting the original audio signals into a preset multi-stage reverberation effector to obtain a first echo signal and a second echo signal corresponding to each stage; wherein the echo output of each stage is used as the input of the next stage;
mixing the first echo signal corresponding to each stage with the original audio signal to obtain a corresponding first reverberation audio signal; and mixing the second echo signal corresponding to each stage with the original audio signal to obtain a corresponding second reverberation audio signal.
Optionally, in a first implementation manner of the first aspect of the present invention, each stage of the multi-stage reverberation effector includes a nested all-pass filter and a delay filter connected in series, the inputting the original audio signal into a preset multi-stage reverberation effector, and obtaining a first echo signal and a second echo signal corresponding to each stage includes:
taking the original audio signal and the echo output of the previous stage as the input of the current stage, and processing the input by a nested all-pass filter of the current stage to obtain the first echo signal corresponding to the current stage;
and inputting the first echo signal corresponding to the current stage into a delay filter of the current stage, and outputting the second echo signal corresponding to the current stage.
Optionally, in a second implementation manner of the first aspect of the present invention, each stage of the multi-stage reverberation effector further includes a gain controller connected in series with the delay filter, a parameter of the gain controller of each stage is adjustable, and after the first echo signal corresponding to the current stage is input into the delay filter of the current stage and the second echo signal corresponding to the current stage is output, the method further includes:
and inputting the second echo signal corresponding to the current stage into a gain controller of the current stage to obtain the echo output corresponding to the current stage.
Optionally, in a third implementation manner of the first aspect of the present invention, the multi-stage reverberation effector further includes a pre-delay device, and the taking the original audio signal and the echo output of the previous stage as the current stage input includes:
inputting the original audio signal into the pre-delay device to obtain a corresponding input signal;
and taking the input signal and the echo output of the previous stage as the input of the current stage.
Optionally, in a fourth implementation manner of the first aspect of the present invention, the nested all-pass filter includes a first all-pass filter, a second all-pass filter, a low-pass filter and a low-frequency oscillator, where the low-pass filter is connected in series with the first all-pass filter, a serial branch formed is connected in parallel with the second all-pass filter, and the low-frequency oscillator is connected in series with the second all-pass filter.
Optionally, in a fifth implementation manner of the first aspect of the present invention, the modulating the second all-pass filter by the low frequency oscillator generates a delay length of a fractional formula, and the method further includes:
and carrying out nonlinear interpolation on the delay length of the small-order equation by using an all-pass filter to obtain the corresponding integer-order equation delay length.
Optionally, in a sixth implementation manner of the first aspect of the present invention, the mixing processing is performed on the first echo signal corresponding to each stage and the original audio signal to obtain a corresponding first reverberant audio signal; and mixing the second echo signal corresponding to each stage with the original audio signal, and obtaining a corresponding second echo audio signal includes:
the first echo signals corresponding to each stage are output in parallel according to the corresponding proportion through the corresponding gain controllers, and are mixed with the original audio signals to obtain corresponding first reverberation audio signals;
and outputting the second echo signals corresponding to each stage in parallel through the corresponding gain controllers according to the corresponding proportion, and mixing the second echo signals with the original audio signals to obtain corresponding second reverberation audio signals.
A second aspect of the present invention provides a reverberation processing apparatus of an audio signal including:
the acquisition module is used for acquiring an original audio signal to be processed;
the first processing module is used for inputting the original audio signals into a preset multi-stage reverberation effector to obtain a first echo signal and a second echo signal corresponding to each stage; wherein the echo output of each stage is used as the input of the next stage;
the second processing module is used for mixing the first path of echo signals corresponding to each level with the original audio signals to obtain corresponding first path of reverberation audio signals; and mixing the second echo signal corresponding to each stage with the original audio signal to obtain a corresponding second reverberation audio signal.
Optionally, in a first implementation manner of the second aspect of the present invention, each stage of the multi-stage reverberation effector includes a nested all-pass filter and a delay filter connected in series, and the first processing module is specifically configured to:
taking the original audio signal and the echo output of the previous stage as the input of the current stage, and processing the input by a nested all-pass filter of the current stage to obtain the first echo signal corresponding to the current stage;
and inputting the first echo signal corresponding to the current stage into a delay filter of the current stage, and outputting the second echo signal corresponding to the current stage.
Optionally, in a second implementation manner of the second aspect of the present invention, each stage of the multi-stage reverberation effector further includes a gain controller connected in series with the delay filter, a parameter of the gain controller of each stage is adjustable, and the first processing module is specifically further configured to:
and inputting the second echo signal corresponding to the current stage into a gain controller of the current stage to obtain the echo output corresponding to the current stage.
Optionally, in a third implementation manner of the second aspect of the present invention, the multi-stage reverberation effector further includes a pre-delay device, and the first processing module is specifically further configured to:
inputting the original audio signal into the pre-delay device to obtain a corresponding input signal;
and taking the input signal and the echo output of the previous stage as the input of the current stage.
Optionally, in a fourth implementation manner of the second aspect of the present invention, the nested all-pass filter includes a first all-pass filter, a second all-pass filter, a low-pass filter and a low-frequency oscillator, where the low-pass filter is connected in series with the first all-pass filter, a serial branch formed is connected in parallel with the second all-pass filter, and the low-frequency oscillator is connected in series with the second all-pass filter.
Optionally, in a fifth implementation manner of the second aspect of the present invention, the reverberation processing device of the audio signal further includes:
and the second processing module is used for carrying out nonlinear interpolation on the delay length of the small-order equation by using an all-pass filter to obtain the corresponding delay length of the integral-order equation.
Optionally, in a sixth implementation manner of the second aspect of the present invention, the second processing module is specifically configured to:
the first echo signals corresponding to each stage are output in parallel according to the corresponding proportion through the corresponding gain controllers, and are mixed with the original audio signals to obtain corresponding first reverberation audio signals;
and outputting the second echo signals corresponding to each stage in parallel through the corresponding gain controllers according to the corresponding proportion, and mixing the second echo signals with the original audio signals to obtain corresponding second reverberation audio signals.
A third aspect of the present invention provides an electronic device comprising: a memory and at least one processor, the memory having instructions stored therein;
the at least one processor invokes the instructions in the memory to cause the electronic device to perform the reverberation processing method of the audio signal according to any one of the preceding claims.
A fourth aspect of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a reverberation processing method of an audio signal according to any one of the above.
According to the technical scheme provided by the invention, the original audio signal is acquired and input into the preset multi-stage reverberation effector to obtain the first echo signal and the second echo signal corresponding to each stage, wherein for the multi-stage reverberation effector, the echo output of each stage is taken as the input of the next stage, the multi-level and multi-azimuth echo effect is increased, the first echo signal corresponding to each stage is mixed with the original audio signal to obtain the corresponding first reverberation audio signal, the second echo signal corresponding to each stage is mixed with the original audio signal to obtain the corresponding second reverberation audio signal, the first reverberation audio signal and the second reverberation audio signal can comprehensively simulate the early, middle and later reflections of reverberation, and the reverberation effect is real and natural, so that the reverberation effect is improved, and the experience of a user is improved.
Drawings
Fig. 1 is a schematic diagram of a first embodiment of a reverberation processing method of an audio signal according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a multi-stage frame structure for reverberation in an embodiment of the present invention;
FIG. 3 is a schematic diagram of a reverberant multi-node output frame structure in an embodiment of the present invention;
FIG. 4 is a schematic diagram of a nested all-pass filter according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of an all-pass filter according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a first embodiment of a reverberation processing apparatus for an audio signal according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a second embodiment of a reverberation processing apparatus of an audio signal according to an embodiment of the present invention;
fig. 8 is a schematic diagram of an embodiment of an electronic device according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a reverberation processing method, a device, electronic equipment and a storage medium of an audio signal. The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.
For easy understanding, the following describes a specific flow of an embodiment of the present invention, referring to fig. 1, and a first embodiment of a method for processing reverberation of an audio signal according to the embodiment of the present invention includes:
101. acquiring an original audio signal to be processed;
for example, taking music playing as an example, the audio corresponding to the music to be played is the original audio signal. For ease of description, the original audio signal is hereinafter labeled x (n). For music to be played, an original audio signal x (n) corresponding to the music is acquired.
For another example, a voice signal of a user is collected by a voice collection device such as a microphone, the collected voice signal is converted into a digital signal, and the obtained digital signal is used as an original audio signal x (n).
102. Inputting the original audio signals into a preset multi-stage reverberation effector to obtain a first echo signal and a second echo signal corresponding to each stage; wherein the echo output of each stage is used as the input of the next stage;
in this embodiment, in order to achieve enhancement of the reverberation effect, a corresponding multi-stage reverberation effector is provided, which has a reverberation multi-stage frame structure and a reverberation multi-node output frame structure. Wherein each stage of the multi-stage reverberation effector in the reverberation multi-stage frame structure comprises a nested all-pass filter (mn_apf) and a Delay filter (Delay) connected in series.
And inputting the original audio signal x (n) into the multi-stage reverberation effector to obtain a first echo signal and a second echo signal corresponding to each stage. For convenience of description, the first echo signal corresponding to the ith stage is hereinafter referred to as yiL (n) and the second echo signal is hereinafter referred to as yiR (n).
Wherein the echo output of each stage serves as the input to the next stage. I.e. the echo output of the i-th stage is taken as input to the (i + 1) -th stage. Optionally, the reverberant multi-stage frame structure is a reverberant multi-stage closed frame structure, and the echo output of the last stage is used as the input of the first stage.
Therefore, the input of each stage contains both the original audio signal x (n) and the echo output of the previous stage, so that the multi-level and multi-azimuth echo effect can be increased.
In one embodiment, step 102 specifically includes:
(1) Taking the original audio signal and the echo output of the previous stage as the input of the current stage, and processing the input by a nested all-pass filter of the current stage to obtain the first echo signal corresponding to the current stage;
(2) And inputting the first echo signal corresponding to the current stage into a delay filter of the current stage, and outputting the second echo signal corresponding to the current stage.
The corresponding second echo signal yiR (n) is obtained by a Delay filter (Delay), which may provide more echo signals (e.g., y1R (n), y2R (n), etc.) for output.
In an embodiment, each stage of the multi-stage reverberation effect further comprises a gain controller (G) in series with the Delay filter (Delay), wherein parameters of the gain controller (G) of each stage are adjustable. The gain controller (G) may control the echo output intensity corresponding to each stage, thereby affecting the duration of the reverberation, and thus simulating the reverberation effect of different scenes.
Inputting the first echo signal corresponding to the current stage into a delay filter of the current stage, and outputting the second echo signal corresponding to the current stage, the method further comprises the following steps:
(3) And inputting the second echo signal corresponding to the current stage into a gain controller of the current stage to obtain the echo output corresponding to the current stage.
That is, after the second echo signal yiR (n) corresponding to the i-th stage is input to the gain controller Gi of the i-th stage, the echo output corresponding to the i-th stage is output.
In an embodiment, the multi-stage reverberation effector further comprises pre-delay means (pre delay), the pre-delay being the time between directly hearing the sound source and hearing the first reflected echo, the pre-delay determining the size of the current space.
The step (1) specifically comprises:
(11) Inputting the original audio signal into the pre-delay device to obtain a corresponding input signal;
(12) And taking the input signal and the echo output of the previous stage as the input of the current stage.
That is, a pre-delay device (pre delay) is disposed before the nested all-pass filter (mn_apf), and before the original audio signal x (n) is input into the nested all-pass filter (mn_apf), the original audio signal x (n) is input into the pre-delay device (pre delay) to obtain an input signal corresponding to the original audio signal x (n). The input signal corresponding to the original audio signal x (n) and the echo output of the previous stage are taken as the current stage input. That is, the input of each stage contains both the input signal corresponding to the original audio signal x (n) and the echo output of the previous stage.
For example, as shown in fig. 2, the multi-stage reverberation effector includes a 4-stage closed frame in which 4 nested all-pass filters (mn_apf1, mn_apf2, mn_apf1, mn_apf4) are connected in series and recycled in stages, and pre-delay (preDelay) is preceded, wherein each stage corresponds to one horizontal branch. In the first horizontal branch, the nested all-pass filter (mn_apf1) is followed by a corresponding Delay filter (Delay 1) and gain controller (G1); in the second horizontal branch, the nested all-pass filter (mn_apf2) is followed by a corresponding Delay filter (Delay 2) and gain controller (G2); in the third horizontal branch, the nested all-pass filter (mn_apf3) is followed by a corresponding Delay filter (Delay 3) and gain controller (G3); in the fourth horizontal branch, the nested all-pass filter (mn_apf4) is followed by a corresponding Delay filter (Delay 4) and gain controller (G4).
The original audio signal x (n) is input into a pre-delay device (pre delay) to obtain an input signal corresponding to the original audio signal x (n). The input signal corresponding to the original audio signal x (n) and the echo output of the fourth stage (namely, the fourth horizontal branch) are used as the input of the first stage, the nested all-pass filter (MN_APF1) of the first stage (namely, the first horizontal branch) is mixed and input, the first echo signal y1L (n) corresponding to the first stage is obtained through the processing of the nested all-pass filter (MN_APF1) of the first stage, and then the first echo signal y1L (n) corresponding to the first stage is input to the Delay filter (Delay 1) of the first stage, and the second echo signal y1R (n) corresponding to the first stage is output. After the second echo signal y1R (n) is input into the gain controller G1 of the first stage, the echo output corresponding to the first stage is output.
The echo output corresponding to the first stage and the input signal corresponding to the original audio signal x (n) are taken as the second stage input, the mixed input is carried out on a second stage nested all-pass filter (MN_APF2), the second stage nested all-pass filter (MN_APF2) is used for processing, a second stage corresponding first path echo signal y2L (n) is obtained, and then the second stage corresponding second path echo signal y2R (n) is input into a second stage Delay filter (Delay 2). After the second echo signal y2R (n) is input into the gain controller G2 of the second stage, the echo output corresponding to the second stage is output.
The echo output corresponding to the second stage and the input signal corresponding to the original audio signal x (n) are taken as the input of the third stage, the input is mixed and input into a nested all-pass filter (MN_APF3) of the third stage, the first path of echo signal y3L (n) corresponding to the third stage is obtained through the processing of the nested all-pass filter (MN_APF3) of the third stage, the first path of echo signal y3L (n) corresponding to the third stage is input into a Delay filter (Delay 3) of the third stage, and the second path of echo signal y3R (n) corresponding to the third stage is output. After the second echo signal y3R (n) is input into the gain controller G3 of the third stage, the echo output corresponding to the third stage is output.
The echo output corresponding to the third stage and the input signal corresponding to the original audio signal x (n) are taken as fourth stage input, mixed and input into a fourth stage nested all-pass filter (MN_APF4), the fourth stage nested all-pass filter (MN_APF4) is used for processing, a fourth stage corresponding first path echo signal y4L (n) is obtained, and then the fourth stage corresponding first path echo signal y4L (n) is input into a fourth stage Delay filter (Delay 4) to output a fourth stage corresponding second path echo signal y4R (n). After the second echo signal y4R (n) is input into the gain controller G4 of the fourth stage, the echo output corresponding to the fourth stage is output.
103. Mixing the first echo signal corresponding to each stage with the original audio signal to obtain a corresponding first reverberation audio signal; mixing the second echo signal corresponding to each stage with the original audio signal to obtain a corresponding second reverberation audio signal;
in one embodiment, step 103 specifically includes:
(1) The first echo signals corresponding to each stage are output in parallel according to the corresponding proportion through the corresponding gain controllers, and are mixed with the original audio signals to obtain corresponding first reverberation audio signals;
(2) And outputting the second echo signals corresponding to each stage in parallel through the corresponding gain controllers according to the corresponding proportion, and mixing the second echo signals with the original audio signals to obtain corresponding second reverberation audio signals.
For example, as shown in fig. 3, y1L (n), y2L (n), y3L (n), and y4L (n) correspond to gain controllers g1, g2, g3, and g4, respectively, and y1R (n), y2R (n), y3R (n), and y4R (n) correspond to gain controllers g5, g6, g7, and g8, respectively.
And outputting y1L (n), y2L (n), y3L (n) and y4L (n) in parallel in corresponding proportion through respective corresponding gain controllers g1, g2, g3 and g4, and performing mixing processing on the y1L (n), y2L (n), y3L (n) and y4L (n) and the original audio signal x (n) to obtain a corresponding first path of reverberation audio signal yL (n).
And outputting y1R (n), y2R (n), y3R (n) and y4R (n) in parallel in a corresponding proportion through respective corresponding gain controllers g5, g6, g7 and g8, and performing mixing processing on the obtained mixed signals and the original audio signal x (n) to obtain a corresponding second path of reverberation audio signal yR (n).
The first echo signal and the second echo signal corresponding to each level, such as y1L (n) and y1R (n), are output in parallel by the corresponding gain controllers according to a specific proportion, so that what is commonly called wet sound is obtained, early, medium and later reflections of reverberation can be comprehensively simulated, and the reverberation effect is real and natural. The original audio signals x (n) of the original inputs are mixed, commonly called "dry sound", and the final output results (yL (n), yR (n)) are obtained through weighted summation of the respective post gain controllers (such as wet gain controllers and dry gain controllers in FIG. 3).
In an embodiment, the reverberations output result may be affected by changing the parameter values of the gain controllers g1, g2 … …. The final reverberation output result can also be affected by changing the parameter values of the wet and dry gain controllers, i.e. changing the dry-wet ratio. Also, by setting appropriate values for the parameters of the gain controllers g1, g2 … …, a coloring effect or standing wave that may occur in the echo signal can be avoided.
In this embodiment, an original audio signal is obtained, the original audio signal is input into a preset multi-stage reverberation effector, and a first echo signal and a second echo signal corresponding to each stage are obtained, where, for the multi-stage reverberation effector, the echo output of each stage is used as the input of the next stage, multiple-level and multi-azimuth echo effects are added, the first echo signal corresponding to each stage and the original audio signal are mixed to obtain a corresponding first-stage reverberation audio signal, and the second echo signal corresponding to each stage and the original audio signal are mixed to obtain a corresponding second-stage reverberation audio signal, where the first-stage reverberation audio signal and the second-stage reverberation audio signal can fully simulate early, middle and later reflections of reverberation, and the reverberation effect is true and natural, so that the reverberation effect is improved, and the experience of a user is improved.
Referring to fig. 4, in a second embodiment of a reverberation processing method of an audio signal according to an embodiment of the present invention, a nested all-pass filter mn_apf includes a first all-pass filter APF1, a second all-pass filter APF2, a low-pass filter LPF and a low-frequency oscillator LFO, wherein the low-pass filter LPF is connected in series with the first all-pass filter APF1, a serial branch formed by the low-pass filter LPF and the low-frequency oscillator LFO is connected in parallel with the second all-pass filter APF2, and the low-frequency oscillator LFO is connected in series with the second all-pass filter APF2.
The structures of the first all-pass filter APF1 and the second all-pass filter APF2 are shown in fig. 5, and include a gain controller g, a gain controller-g and a Delay filter Delay. The input signal is delayed to obtain one echo signal, the echo signal is mixed with the original signal after passing through the gain controller g, the other echo signal is obtained after passing through the gain controller-g, and the two echo signals are mixed to obtain an output result.
The nested all-pass filter MN_APF has the following advantages:
a. the comb filter is replaced by an all-pass filter. Multiple echoes can also be generated with an all-pass filter alone and the amplitude exhibits exponential decay.
b. The first all-pass filter APF1 is nested within the second all-pass filter APF2. The number of echoes generated by a single all-pass filter is rare and the echo interval is fixed. And the number of the echo generated by nesting two all-pass filters is greatly increased, and the echo interval is sharply reduced. This not only accumulates more echo but also enhances the tailing effect of the sound.
c. The delay filter of the outer second all-pass filter APF2 is modulated using a low frequency oscillator LFO. While the nested all-pass filter keeps the echo density increasing, the second all-pass filter APF2 at the outer layer has a constant delay length. In order to further increase the density of the echo exponentially with time, the delay filter of the second all-pass filter APF2 is modulated by using the low-frequency oscillator LFO, so as to further enhance the tailing effect of sound and increase the density of the echo in the time domain, and more approximate to the actual reverberation.
Alternatively, the values of the low frequency oscillator LFO frequency and amplitude are very small to ensure that no significant detuning (harmonic distortion) and chorus effects are produced.
Optionally, the low frequency oscillator modulates the second all-pass filter APF2, modulates the delay filter of the second all-pass filter APF2, and generates a small-valued delay length. And (3) performing nonlinear interpolation by using an all-pass filter, and performing nonlinear interpolation on the small-order delay length by using the all-pass filter to obtain the corresponding integer-order delay length so as to avoid the phenomena of high-frequency deletion, amplitude and phase distortion and even aliasing of sound.
d. A low pass filter LPF is nested on the feedback loop. The low-pass filter LPF is used for accelerating the attenuation speed of high-frequency components in sound and simulating the absorption of the high-frequency components in sound in a real scene, so that a more natural reverberation effect is achieved, and the sound feeling is more real.
In this embodiment, by designing the nested all-pass filter mn_apf, one all-pass filter is embedded in the other all-pass filter, and compared with the pure two all-pass filters connected in series or in parallel, the reverberation effect is better. In addition, by embedding a low-pass filter to attenuate the high-frequency component of sound, the absorption of the high-frequency component of sound in a real scene is simulated, so that a more natural reverberation effect is achieved, the hearing is more real, and the user experience is improved.
The above description is made on the method for processing the reverberation of the audio signal according to the embodiment of the present invention, and the following description is made on the device for processing the reverberation of the audio signal according to the embodiment of the present invention, referring to fig. 6, the first embodiment of the device for processing the reverberation of the audio signal according to the embodiment of the present invention includes:
an acquisition module 201, configured to acquire an original audio signal to be processed;
a first processing module 202, configured to input the original audio signal into a preset multi-stage reverberation effector, and obtain a first echo signal and a second echo signal corresponding to each stage; wherein the echo output of each stage is used as the input of the next stage;
the second processing module 203 is configured to mix the first echo signal corresponding to each stage with the original audio signal to obtain a corresponding first reverberant audio signal; and mixing the second echo signal corresponding to each stage with the original audio signal to obtain a corresponding second reverberation audio signal.
Optionally, in an embodiment, each stage of the multi-stage reverberation effector includes a nested all-pass filter and a delay filter connected in series, and the first processing module 202 is specifically configured to:
taking the original audio signal and the echo output of the previous stage as the input of the current stage, and processing the input by a nested all-pass filter of the current stage to obtain the first echo signal corresponding to the current stage;
and inputting the first echo signal corresponding to the current stage into a delay filter of the current stage, and outputting the second echo signal corresponding to the current stage.
Optionally, in an embodiment, each stage of the multi-stage reverberation effect further includes a gain controller connected in series with the delay filter, a parameter of the gain controller of each stage is adjustable, and the first processing module 202 is specifically further configured to:
and inputting the second echo signal corresponding to the current stage into a gain controller of the current stage to obtain the echo output corresponding to the current stage.
Optionally, in an embodiment, the multi-stage reverberation effector further includes a pre-delay device, and the first processing module 202 is specifically further configured to:
inputting the original audio signal into the pre-delay device to obtain a corresponding input signal;
and taking the input signal and the echo output of the previous stage as the input of the current stage.
Optionally, in an embodiment, the second processing module 203 is specifically configured to:
the first echo signals corresponding to each stage are output in parallel according to the corresponding proportion through the corresponding gain controllers, and are mixed with the original audio signals to obtain corresponding first reverberation audio signals;
and outputting the second echo signals corresponding to each stage in parallel through the corresponding gain controllers according to the corresponding proportion, and mixing the second echo signals with the original audio signals to obtain corresponding second reverberation audio signals.
In this embodiment, an original audio signal is obtained, the original audio signal is input into a preset multi-stage reverberation effector, and a first echo signal and a second echo signal corresponding to each stage are obtained, where, for the multi-stage reverberation effector, the echo output of each stage is used as the input of the next stage, multiple-level and multi-azimuth echo effects are added, the first echo signal corresponding to each stage and the original audio signal are mixed to obtain a corresponding first-stage reverberation audio signal, and the second echo signal corresponding to each stage and the original audio signal are mixed to obtain a corresponding second-stage reverberation audio signal, where the first-stage reverberation audio signal and the second-stage reverberation audio signal can fully simulate early, middle and later reflections of reverberation, and the reverberation effect is true and natural, so that the reverberation effect is improved, and the experience of a user is improved.
Referring to fig. 7, in a second embodiment of the reverberation processing apparatus for an audio signal according to the present invention, a nested all-pass filter mn_apf includes a first all-pass filter APF1, a second all-pass filter APF2, a low-pass filter LPF and a low-frequency oscillator LFO, wherein the low-pass filter LPF is connected in series with the first all-pass filter APF1, a serial branch formed by the low-pass filter LPF and the low-frequency oscillator LFO is connected in parallel with the second all-pass filter APF2, and the low-frequency oscillator LFO is connected in series with the second all-pass filter APF2. The low frequency oscillator LFO modulates the second all-pass filter APF2 to produce a small number of delay lengths.
The reverberation processing device of the audio signal further comprises:
and a third processing module 204, configured to perform nonlinear interpolation on the fractional delay length by using an all-pass filter, so as to obtain a corresponding integer delay length.
In this embodiment, nonlinear interpolation is performed on the delay length of the fractional equation by using an all-pass filter, so as to obtain the corresponding delay length of the fractional equation, so as to avoid the phenomena of high-frequency deletion, distortion of amplitude and phase, and even aliasing of sound.
The above fig. 6 and fig. 7 describe the reverberation processing apparatus of the audio signal in the embodiment of the present invention in detail from the point of view of the modularized functional entity, and the electronic device in the embodiment of the present invention is described in detail from the point of view of hardware processing.
Fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, where the electronic device 800 may have a relatively large difference due to different configurations or performances, and may include one or more processors (central processing units, CPU) 810 (e.g., one or more processors) and a memory 820, and one or more storage media 830 (e.g., one or more mass storage devices) storing application programs 833 or data 832. Wherein memory 820 and storage medium 830 can be transitory or persistent. The program stored on the storage medium 830 may include one or more modules (not shown), each of which may include a series of instruction operations in the electronic device 800. Still further, the processor 810 may be arranged to communicate with the storage medium 830 and to execute a series of instruction operations in the storage medium 830 on the electronic device 800.
The electronic device 800 may also include one or more power supplies 840, one or more wired or wireless network interfaces 850, one or more input/output interfaces 860, and/or one or more operating systems 831, such as Android, windows Serve, mac OS X, unix, linux, freeBSD, and the like. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 8 is not limiting of the electronic device and may include more or fewer components than shown, or may combine certain components, or may be arranged in a different arrangement of components.
The present invention also provides an electronic device including a memory and a processor, the memory storing computer readable instructions that, when executed by the processor, cause the processor to perform the steps of the reverberation processing method of the audio signal in the above embodiments.
The present invention also provides a computer readable storage medium, which may be a non-volatile computer readable storage medium, and which may also be a volatile computer readable storage medium, the computer readable storage medium having stored therein instructions which, when executed on a computer, cause the computer to perform the steps of the reverberation processing method of the audio signal.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (8)
1. A reverberation processing method of an audio signal, applied to a multi-stage reverberation effector including a nested all-pass filter and a delay filter connected in series in a plurality of stages and a gain controller connected in series with the delay filter, the reverberation processing method of the audio signal comprising:
acquiring an original audio signal to be processed;
taking the original audio signal and the echo output of the previous stage as the input of the current stage, and processing the input by a nested all-pass filter of the current stage to obtain a first echo signal corresponding to the current stage;
inputting the first echo signal corresponding to the current stage into a delay filter of the current stage, and outputting a second echo signal corresponding to the current stage; inputting the second echo signal corresponding to the current stage into a gain controller of the current stage to obtain echo output corresponding to the current stage; wherein the echo output of each stage is used as the input of the next stage and the echo output of the last stage is used as the input of the first stage;
mixing the first echo signal corresponding to each stage with the original audio signal to obtain a corresponding first reverberation audio signal; and mixing the second echo signal corresponding to each stage with the original audio signal to obtain a corresponding second reverberation audio signal.
2. The method of reverberation processing of an audio signal according to claim 1, wherein the multi-stage reverberation effector further comprises a pre-delay means, the taking the original audio signal and an echo output of a previous stage as current stage inputs comprising:
inputting the original audio signal into the pre-delay device to obtain a corresponding input signal;
and taking the input signal and the echo output of the previous stage as the input of the current stage.
3. The method of reverberation processing of an audio signal according to claim 1, wherein the nested all-pass filter comprises a first all-pass filter, a second all-pass filter, a low-pass filter and a low-frequency oscillator, the low-pass filter is connected in series with the first all-pass filter, a constituent series branch is connected in parallel with the second all-pass filter, and the low-frequency oscillator is connected in series with the second all-pass filter.
4. A method of reverberation processing of an audio signal according to claim 3, wherein the low frequency oscillator modulating the second all pass filter produces a fractional delay length, the method further comprising:
and carrying out nonlinear interpolation on the delay length of the small-order equation by using an all-pass filter to obtain the corresponding integer-order equation delay length.
5. The method for reverberation processing of an audio signal according to any one of claims 1 to 4, wherein the mixing processing is performed on the first echo signal corresponding to each stage and the original audio signal to obtain a corresponding first reverberant audio signal; and mixing the second echo signal corresponding to each stage with the original audio signal, and obtaining a corresponding second echo audio signal includes:
the first echo signals corresponding to each stage are output in parallel according to the corresponding proportion through the corresponding gain controllers, and are mixed with the original audio signals to obtain corresponding first reverberation audio signals;
and outputting the second echo signals corresponding to each stage in parallel through the corresponding gain controllers according to the corresponding proportion, and mixing the second echo signals with the original audio signals to obtain corresponding second reverberation audio signals.
6. A reverberation processing apparatus for an audio signal, the reverberation processing apparatus being applied to a multi-stage reverberation effector including a nested all-pass filter and a delay filter connected in series in a plurality of stages and a gain controller connected in series with the delay filter, the reverberation processing apparatus comprising:
the acquisition module is used for acquiring an original audio signal to be processed;
the first processing module is used for taking the original audio signal and the echo output of the previous stage as the input of the current stage, and processing the input by the nested all-pass filter of the current stage to obtain a first echo signal corresponding to the current stage; inputting the first echo signal corresponding to the current stage into a delay filter of the current stage, and outputting a second echo signal corresponding to the current stage; inputting the second echo signal corresponding to the current stage into a gain controller of the current stage to obtain echo output corresponding to the current stage; wherein the echo output of each stage is used as the input of the next stage and the echo output of the last stage is used as the input of the first stage;
the second processing module is used for mixing the first path of echo signals corresponding to each level with the original audio signals to obtain corresponding first path of reverberation audio signals; and mixing the second echo signal corresponding to each stage with the original audio signal to obtain a corresponding second reverberation audio signal.
7. An electronic device, the electronic device comprising: a memory and at least one processor, the memory having instructions stored therein;
the at least one processor invokes the instructions in the memory to cause the electronic device to perform the reverberation processing method of the audio signal according to any one of claims 1 to 5.
8. A computer readable storage medium having stored thereon a computer program, characterized in that the computer program, when executed by a processor, implements a reverberation processing method of an audio signal according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110732044.3A CN113518286B (en) | 2021-06-29 | 2021-06-29 | Reverberation processing method and device for audio signal, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110732044.3A CN113518286B (en) | 2021-06-29 | 2021-06-29 | Reverberation processing method and device for audio signal, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113518286A CN113518286A (en) | 2021-10-19 |
| CN113518286B true CN113518286B (en) | 2023-07-14 |
Family
ID=78066487
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110732044.3A Active CN113518286B (en) | 2021-06-29 | 2021-06-29 | Reverberation processing method and device for audio signal, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113518286B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101034548A (en) * | 2006-02-14 | 2007-09-12 | 意法半导体亚太私人有限公司 | Method and system for generating and controlling digital reverberations for audio signals |
| CN110809227A (en) * | 2015-02-12 | 2020-02-18 | 杜比实验室特许公司 | Reverberation generation for headphone virtualization |
| WO2020199990A1 (en) * | 2019-03-29 | 2020-10-08 | Goodix Technology (Hk) Company Limited | Speech processing system and method therefor |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6978027B1 (en) * | 2000-04-11 | 2005-12-20 | Creative Technology Ltd. | Reverberation processor for interactive audio applications |
| JP6481905B2 (en) * | 2017-03-15 | 2019-03-13 | カシオ計算機株式会社 | Filter characteristic changing device, filter characteristic changing method, program, and electronic musical instrument |
-
2021
- 2021-06-29 CN CN202110732044.3A patent/CN113518286B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101034548A (en) * | 2006-02-14 | 2007-09-12 | 意法半导体亚太私人有限公司 | Method and system for generating and controlling digital reverberations for audio signals |
| CN110809227A (en) * | 2015-02-12 | 2020-02-18 | 杜比实验室特许公司 | Reverberation generation for headphone virtualization |
| WO2020199990A1 (en) * | 2019-03-29 | 2020-10-08 | Goodix Technology (Hk) Company Limited | Speech processing system and method therefor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113518286A (en) | 2021-10-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101193763B1 (en) | Unnatural reverberation | |
| US7257230B2 (en) | Impulse response collecting method, sound effect adding apparatus, and recording medium | |
| CN102638757B (en) | Generate and control the method and system of the digital reverberation for audio signal | |
| MX2013009657A (en) | Apparatus and method for determining a measure for a perceived level of reverberation, audio processor and method for processing a signal. | |
| US11049482B1 (en) | Method and system for artificial reverberation using modal decomposition | |
| Välimäki et al. | Parametric spring reverberation effect | |
| Lee et al. | Differentiable artificial reverberation | |
| US8204240B2 (en) | Apparatus and method for artificial reverberation | |
| CN114242097A (en) | Audio data processing method and apparatus, medium, and device | |
| CN113518286B (en) | Reverberation processing method and device for audio signal, electronic equipment and storage medium | |
| US10019980B1 (en) | Distortion and pitch processing using a modal reverberator architecture | |
| JP4019753B2 (en) | Reverberation imparting device, reverberation imparting method, program, and recording medium | |
| CN112652290A (en) | Method for generating reverberation audio signal and training method of audio processing model | |
| JPH06348290A (en) | Reverberation effect giving device | |
| Beltrán et al. | Matlab implementation of reverberation algorithms | |
| CN112820256B (en) | Reverberation method and system based on improved feedback delay network | |
| Dutilleux et al. | Filters and delays | |
| JPS6253100A (en) | Acoustic characteristic controller | |
| Ciufo | Beginner's Mind: an Environment for Sonic Improvisation. | |
| US20090245526A1 (en) | Device for and method of adding reverberation to an input signal | |
| JP4263869B2 (en) | Reverberation imparting device, reverberation imparting method, program, and recording medium | |
| Malko et al. | Implementation of digital audio effects for electric guitar on DSP platform | |
| WO2018135564A1 (en) | Acoustic effect giving device, acoustic effect giving method and acoustic effect giving program | |
| Anghelescu et al. | Real-time audio effects with DSP algorithms and DirectSound | |
| Pfeiffer et al. | Manipulating Audio Through the Web Audio API |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |