CN115866482A - Audio processing method and device - Google Patents

Audio processing method and device Download PDF

Info

Publication number
CN115866482A
CN115866482A CN202211176938.XA CN202211176938A CN115866482A CN 115866482 A CN115866482 A CN 115866482A CN 202211176938 A CN202211176938 A CN 202211176938A CN 115866482 A CN115866482 A CN 115866482A
Authority
CN
China
Prior art keywords
signal
harmonic
side chain
gain
odd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211176938.XA
Other languages
Chinese (zh)
Inventor
陈立
程光伟
朱长宝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Horizon Information Technology Co Ltd
Original Assignee
Beijing Horizon Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Horizon Information Technology Co Ltd filed Critical Beijing Horizon Information Technology Co Ltd
Priority to CN202211176938.XA priority Critical patent/CN115866482A/en
Publication of CN115866482A publication Critical patent/CN115866482A/en
Pending legal-status Critical Current

Links

Images

Abstract

An audio processing method and device are disclosed, the method can obtain the audio signal to be processed, and determine the main chain signal and the side chain signal. And inputting the side chain signals into a harmonic generator to generate odd harmonic signals and even harmonic signals respectively. And determining the gain of the odd harmonic signal and the gain of the even harmonic signal to obtain the gained odd harmonic signal and even harmonic signal. And mixing the gain odd harmonic signal, the gain even harmonic signal and the main chain signal to obtain an audio output signal. The method can change the nonlinear characteristic of the audio signal to be processed by generating the odd harmonic signal and the even harmonic signal, can also control the proportion of the odd harmonic signal and the even harmonic signal by determining the gain of the harmonic signal, can realize the accurate adjustment of a harmonic structure, further realize the fine adjustment of the audio signal to be processed, and can improve the definition, brightness and intelligibility of the audio signal to be processed.

Description

Audio processing method and device
Technical Field
The present disclosure relates to the field of audio technologies, and in particular, to an audio processing method and apparatus.
Background
Audio equipment can record the sound of sound producer and generate the human sound signal, can also carry out the acoustic playback to the human sound signal, but, be subject to sound producer's vocal principle, the composition of human sound signal is generally single thin, if consequently not handle the human sound signal, and directly play this human sound signal on audio equipment, often can appear the sense of hearing in the oppression shrivelled problem, tone quality is poor, intelligibility is low. Therefore, the human voice signal needs to be processed by digital sound effect.
The existing processing method comprises the steps of mixing harmonic waves of human voice signals, wherein the human voice signals mixed with the harmonic waves are richer in audibility, the tone quality can be improved to a certain extent, and the intelligibility is improved. However, this digital sound effect processing method cannot control the structure of harmonics and cannot finely adjust a human voice signal.
Disclosure of Invention
The present disclosure is proposed to solve the above technical problems. The embodiment of the disclosure provides an audio processing method and device.
According to an aspect of the present disclosure, there is provided an audio processing method including:
acquiring an audio signal to be processed, and determining a main chain signal and a side chain signal;
inputting the side chain signal into a harmonic generator to respectively generate an odd harmonic signal and an even harmonic signal;
determining the gain of the odd harmonic signal and the gain of the even harmonic signal to obtain the gain odd harmonic signal and the gain even harmonic signal;
and mixing the gain odd harmonic signal, the gain even harmonic signal and the main chain signal to obtain an audio output signal.
According to another aspect of the present disclosure, there is provided an audio processing apparatus including:
a signal determination module: the method comprises the steps of obtaining an audio signal to be processed, and determining a main chain signal and a side chain signal;
a harmonic generation module: the harmonic generator is used for inputting the side chain signals determined by the signal determination module into the harmonic generator to respectively generate odd harmonic signals and even harmonic signals;
a first gain module: the gain control module is used for determining the gain of the odd harmonic signal generated by the harmonic generation module and the gain of the even harmonic signal generated by the harmonic generation module to obtain the gained odd harmonic signal and the even harmonic signal;
the sound mixing module: and the audio output module is used for mixing the gained odd harmonic signal and the even harmonic signal output by the first gain module with the main chain signal to obtain an audio output signal.
According to yet another aspect of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing the audio processing method described above.
According to still another aspect of the present disclosure, there is provided an electronic device including:
a processor;
a memory for storing processor-executable instructions;
and the processor is used for reading the executable instructions from the memory and executing the instructions to realize the audio processing method.
Based on the audio processing method and the audio processing device provided by the above embodiments of the present disclosure, the method may acquire an audio signal to be processed, and determine a main chain signal and a side chain signal. And inputting the side chain signals into a harmonic generator to generate odd harmonic signals and even harmonic signals respectively. And determining the gain of the odd harmonic signal and the gain of the even harmonic signal to obtain the gain odd harmonic signal and the gain even harmonic signal. And mixing the gained odd harmonic signal, the gained even harmonic signal and the main chain signal to obtain an audio output signal. The method provided by the disclosure can change the nonlinear characteristic of the audio signal to be processed by generating the odd harmonic signal and the even harmonic signal, can also control the proportion of the odd harmonic signal and the even harmonic signal by determining the gain of the harmonic signal, can realize the accurate adjustment of a harmonic structure, further realize the fine adjustment of the audio signal to be processed, and can improve the definition, brightness and intelligibility of the audio signal to be processed.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description of the embodiments of the present disclosure when taken in conjunction with the accompanying drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the principles of the disclosure and not to limit the disclosure. In the drawings, like reference numbers generally represent like parts or steps.
Fig. 1 is a schematic structural diagram of an audio processing system according to an exemplary embodiment of the present disclosure.
Fig. 2 is a flowchart illustrating an audio processing method according to an exemplary embodiment of the disclosure.
Fig. 3 is a schematic flow chart of high-pass filtering the side chain signal according to an exemplary embodiment of the present disclosure.
Fig. 4 is a schematic flowchart of performing companding on a side chain signal according to an exemplary embodiment of the present disclosure.
Fig. 5 is a schematic flow chart of generating harmonics using a harmonic generator according to an exemplary embodiment of the present disclosure.
Fig. 6 is a schematic diagram of a symmetrical clipping flow provided by an exemplary embodiment of the present disclosure.
Fig. 7 is a spectrum image after a 100Hz signal is symmetrically clipped according to an exemplary embodiment of the present disclosure.
Fig. 8 is a symmetrical clipping dynamic range mapping function image provided by an exemplary embodiment of the present disclosure.
Fig. 9 is a half-wave rectified dynamic range mapping function image provided by an exemplary embodiment of the present disclosure.
Fig. 10 is a frequency image of a 100Hz signal after half-wave rectification according to an exemplary embodiment of the present disclosure.
Fig. 11 is a schematic structural diagram of an audio processing apparatus according to an exemplary embodiment of the present disclosure.
Fig. 12 is another schematic structural diagram of an audio processing method according to an exemplary embodiment of the present disclosure.
Fig. 13 is a block diagram of an electronic device provided in an exemplary embodiment of the present disclosure.
Detailed Description
Hereinafter, example embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some of the embodiments of the present disclosure, and not all of the embodiments of the present disclosure, and it is to be understood that the present disclosure is not limited by the example embodiments described herein.
It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.
It will be understood by those of skill in the art that the terms "first," "second," and the like in the embodiments of the present disclosure are used merely to distinguish one element from another, and are not intended to imply any particular technical meaning, nor is the necessary logical order between them.
It is also understood that in embodiments of the present disclosure, "a plurality" may refer to two or more and "at least one" may refer to one, two or more.
It is also to be understood that any reference to any component, data, or structure in the embodiments of the disclosure, may be generally understood as one or more, unless explicitly defined otherwise or stated otherwise.
In addition, the term "and/or" in the present disclosure is only one kind of association relationship describing an associated object, and means that three kinds of relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the former and latter associated objects are in an "or" relationship.
It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and the same or similar parts may be referred to each other, so that the descriptions thereof are omitted for brevity.
Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
Embodiments of the disclosure may be implemented in electronic devices such as terminal devices, computer systems, servers, etc., which are operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known terminal devices, computing systems, environments, and/or configurations that may be suitable for use with electronic devices, such as terminal devices, computer systems, servers, and the like, include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set top boxes, programmable consumer electronics, network pcs, minicomputer systems, mainframe computer systems, distributed cloud computing environments that include any of the above systems, and the like.
Electronic devices such as terminal devices, computer systems, servers, etc. may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. The computer system/server may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
Summary of the application
The audio acquisition device (such as a microphone and an audio acquisition card) acquires sounds in the environment to form audio signals, the audio processing device processes the audio signals, the audio signal processing can change various attributes of the audio signals, and then the audio output device (such as a loudspeaker) outputs the audio signals, for example, the microphone acquires sounds singing by people, and the audio output device broadcasts the sounds singing by people's ears after the audio signals are processed. In some implementations, the processing of the audio signal can be implemented by any of a power amplifier, a digital sound console, a multimedia console, a sound card, and other software, hardware, and combinations thereof.
The composition of an audio signal determines its audibility during playback. Examples are as follows: the vocal signal is an audio signal generated by an audio device collecting a sound made by a speaker, and the vocal signal and the musical instrument signal generally include a fundamental wave signal and various harmonic components. Limited by the phonation principle of a phoner, the components of a human voice signal are generally thinner, the fundamental wave signal occupies a larger proportion, and the harmonic components are very few. When the energy or the order of the harmonic component in the human voice signal is too low, the problem of oppression and shriveling in the auditory sense can occur, the sound quality is poor, and the intelligibility is low. Not limited to the human voice signal, other simple sounds such as the audio signal formed by the sound of a musical instrument also have such a problem when played. Therefore, it is necessary to perform digital audio processing on a single thin audio signal such as a human voice signal, and increase harmonic components in the audio signal to improve the problem of poor listening feeling.
The existing processing method is to mix harmonic waves of audio signals, so that the audio signals are richer in audibility. The method can improve the tone quality to a certain extent and improve the intelligibility. However, the specific components of the harmonic signals may also affect the audibility of the audio signal, for example, if too many harmonics are added to the audio signal, the audio signal may be very harsh to the audibility. Therefore, it is necessary to control the structure of the harmonics in the audio signal, but the above digital sound processing method cannot control the structure of the harmonics and cannot finely adjust the components of the audio signal, so that the improvement of the audio signal in the sense of hearing is not obvious.
Exemplary System
Fig. 1 is a schematic structural diagram of an audio processing system according to an exemplary embodiment of the present disclosure. As shown in fig. 1, the audio processing system 1 comprises an acquisition module 101, a pre-processing module 102, a harmonic generator 103, a first gain controller 104, a mixing module 105 and an output module 106.
The acquisition module 101 is configured to convert a sound signal into an electrical signal to obtain an initial audio signal. The preprocessing module 102 is configured to process the initial audio signal acquired by the acquisition module 101 to obtain a main chain signal and a side chain signal. The harmonic generator 103 is used to generate an odd harmonic signal and an even harmonic signal based on the side chain signal, and the harmonic generator 103 is also used to control the high-order ratio of harmonics and the like. The first gain controller 104 is used for gain-up the odd harmonic signal and the even harmonic signal to control the ratio of the odd harmonic signal and the even harmonic signal. The mixing module 105 is used to mix the main chain signal with the odd harmonic signal and the even harmonic signal. The output module 106 is configured to output the mixed signal.
Further, the preprocessing module 102 includes a copying unit 1021, a high-pass filtering unit 1022, a companding unit 1023, and a second gain controller 1024, where the copying unit 1021 is configured to copy the initial audio signal into two identical audio signals, obtain a main chain signal and a side chain signal, and input the side chain signal to the high-pass filtering unit 1022. The main chain signal, which may be referred to as the fundamental signal in some implementations, is used to preserve various characteristics of the original audio signal. The side chain signals may be applied to an audio processing process, generating harmonic components. The high-pass filtering unit 1022 is configured to perform high-pass filtering on the side chain signal to obtain a high-frequency component in the side chain signal, and input the high-pass filtered side chain signal to the companding unit 1023. The companding unit 1023 is used to compand the side chain signal to control the amplitude dynamic range of the side chain signal, and input the side chain signal to the second gain controller 1024. The second gain controller 1024 is configured to gain the side chain signal, control the amplitude of the side chain signal, and input the side chain signal to the harmonic generator 103.
The technical scheme provided by the embodiment can be realized in any mode of software, hardware and combination of software and hardware. The hardware can provide sound input, the software can be realized through C + + programming language, java and the like, and the specific hardware, software structure and corresponding functions are not limited by the disclosure.
Exemplary method
Fig. 2 is a flowchart illustrating an audio processing method according to an exemplary embodiment of the disclosure. As shown in fig. 2, the method comprises the following steps:
s201: and acquiring an audio signal to be processed, and determining a main chain signal and a side chain signal.
The audio signal to be processed may be an audio signal acquired by the audio acquisition module from sound, for example, a human voice signal acquired from sound of a speaker. The audio acquisition module can be a microphone, an audio acquisition card and the like. When the audio signal to be processed is collected, the sampling rate, the channel number, the bit depth, the frame number and the like of the audio signal to be processed can be selected based on actual conditions.
The step of determining the main chain signal and the side chain signal based on the audio signal to be processed may be to copy the audio signal to be processed to obtain the identical main chain signal and side chain signal. The present embodiment may use the main chain signal as the fundamental wave signal and does not perform any processing on the main chain signal, so that the main chain signal may include various characteristics of the audio signal to be processed. In addition, in this embodiment, the side chain signal can be subjected to processing such as harmonic generation and gain control, and a side chain signal having a harmonic component can be obtained.
In this way, a main chain signal for preserving various characteristics of the audio signal to be processed, and side chain signals for performing various audio processing steps can be obtained.
S202: and inputting the side chain signals into a harmonic generator to generate odd harmonic signals and even harmonic signals respectively.
The harmonic generator may be configured to perform a harmonic generation process on the side-chain signal to generate an odd harmonic signal and an even harmonic signal.
The harmonic is a signal having a frequency that is an integral multiple of the fundamental frequency. When the frequency of the harmonic signal is an odd multiple of the frequency of the fundamental wave signal, the harmonic is made an odd harmonic signal. For example, for a fundamental signal having a frequency of 50Hz, the frequency of the third harmonic thereof is three times the frequency of the fundamental signal, and the frequency of the third harmonic signal is specifically 150Hz. In this embodiment, the odd harmonic signal is generated by using the side-chain signal as the fundamental wave signal. The specific order of the odd harmonic is not limited in any way, and the odd harmonic can be designed according to actual conditions. The odd harmonic generation method may be that the harmonic generator symmetrically clips the side chain signal to make the side chain signal generate nonlinear distortion to obtain the odd harmonic signal.
When the frequency of the harmonic signal is an even multiple of the frequency of the fundamental signal, the harmonic is referred to as an even harmonic signal. For example, for a fundamental signal with a frequency of 50Hz, the frequency of the second harmonic signal is twice the frequency of the fundamental signal, and the frequency of the second harmonic signal is 100Hz specifically. In this embodiment, the even harmonic signal is generated by using the side chain signal as the fundamental signal. The embodiment does not limit the specific order of the even harmonic wave at all, and can be set according to actual conditions. The even harmonic generation method may be that the harmonic generator performs full-wave rectification or half-wave rectification on the side chain signal to make the side chain signal generate nonlinear distortion to obtain an even harmonic signal.
It will be appreciated that the side-chain signal acts as a fundamental signal, the frequency of which is determined by the source of the sound. For example, when the signal to be processed is a human voice signal collected by the audio collection module, the frequency is determined by the physical function and sounding skill of the sounder. When the signal to be processed is the sound of the musical instrument collected by the audio collection module, the frequency is determined by the sound production principle and the playing mode of the musical instrument.
Therefore, after the side chain signal is input into the harmonic generator, not only the odd harmonic signal with odd harmonic components can be obtained, but also the even harmonic signal with even harmonic components can be obtained. The odd harmonic signal and the even harmonic signal may be used to alter the audibility of the audio signal to obtain an audio signal with a better audibility.
It should be added that the step of generating the odd harmonic signal and the even harmonic signal based on the side chain signal can be understood as a Distortion (Distortion) phenomenon, and the magnitude of the Distortion can be determined by the harmonic generator.
S203: and determining the gain of the odd harmonic signal and the gain of the even harmonic signal to obtain the gained odd harmonic signal and even harmonic signal.
For an audio signal, the audibility of the audio signal will be affected by the amount of odd harmonic components and even harmonic components. Therefore, in order to control the ratio between the odd harmonic signal and the even harmonic signal, the present embodiment may also determine the gain of the odd harmonic signal and the gain of the even harmonic signal before mixing the odd harmonic signal and the even harmonic signal. Specifically, the gain refers to an amplification factor when a signal is amplified, and the gain can make the audio signal change linearly, so that the linear characteristic of the audio signal can be changed by using the gain. Therefore, in the present embodiment, when more odd harmonic signals and less even harmonic signals are required, a larger gain may be set for the odd harmonic signals, and a smaller gain may be set for the even harmonic signals relative to the gain of the odd harmonic signals, for example, the gain ratio between the odd harmonic signals and the even harmonic signals is set to 3. When more even harmonic signals and less odd harmonic signals are required, a larger gain may be set for the even harmonic signals and a smaller gain may be set for the odd harmonic signals relative to the gain of the even harmonic signals, for example, the gain ratio between the odd harmonic signals and the even harmonic signals is set to 2. The step of gain may be implemented by a gain amplifier or the like. Therefore, the embodiment can determine the gain of the odd harmonic signal and the gain of the even harmonic signal, obtain the gain odd harmonic signal and the gain even harmonic signal, and realize the control of the proportion of the odd harmonic signal and the even harmonic signal so as to improve the hearing.
S204: and mixing the gain odd harmonic signal, the gain even harmonic signal and the main chain signal to obtain an audio output signal.
The first mixed signal may be obtained by first mixing the gained odd harmonic signal and the gained even harmonic signal. A gain ratio between the first mixed signal and the main chain signal is then determined, and the first mixed signal and the main chain signal are mixed based on the gain ratio. In the present embodiment, it is preferable to set the gain of the main chain signal to 1, and then set the gain for the first mixed signal based on the gain of the main chain signal.
For example, if the distortion effect of the audio output signal is desired to be more pronounced, a larger gain may be set for the first mixed signal at the time of mixing, which may make the audio processing effect more noticeable in the sense of hearing. If the distortion effect of the audio output signal is needed to be less obvious, a smaller gain can be set for the first mixed signal during mixing, so that the audio output signal can reflect the sound collected by the audio collection module more truly. That is, the specific value of the first mixed signal gain may be designed according to practical situations, which is not specifically limited in this embodiment.
In some implementations, the embodiment may further determine a gain ratio between the gained odd harmonic signal, the gained even harmonic signal, and the main chain signal, and then mix the gained odd harmonic signal, the gained even harmonic signal, and the main chain signal based on the gain ratio. It is understood that the present embodiment can set the first gain for the harmonic signal before and during mixing, respectively.
The audio processing method can acquire the audio signal to be processed and determine the main chain signal and the side chain signal. And inputting the side chain signals into a harmonic generator to generate odd harmonic signals and even harmonic signals respectively. And determining the gain of the odd harmonic signal and the gain of the even harmonic signal to obtain the gain odd harmonic signal and the gain even harmonic signal. And mixing the gained odd harmonic signal, the gained even harmonic signal and the main chain signal to obtain an audio output signal. The method can change the nonlinear characteristic of the audio signal to be processed by generating the odd harmonic signal and the even harmonic signal, can also control the proportion of the odd harmonic signal and the even harmonic signal by determining the gain of the harmonic signal, can realize the accurate adjustment of a harmonic structure, further realize the fine adjustment of the audio signal to be processed, and can improve the definition, brightness and intelligibility of the audio signal to be processed.
Fig. 3 is a schematic flow chart of high-pass filtering a side chain signal according to an exemplary embodiment of the disclosure. As shown in fig. 3, on the basis of the embodiment shown in fig. 2, the method further includes the following steps before step S202:
s301: the side-chain signal is input to a high-pass filter.
The amount of high frequency components in the audio signal also affects the hearing sensation of the audio signal, and generally, the more high frequency components in the audio signal, the brighter the hearing sensation, so the present disclosure may further include a step of enhancing the high frequency components in the audio signal to be processed. Specifically, the present embodiment inputs the side chain signal to the high-pass filter, and thus, a high-frequency component higher than the cutoff frequency of the high-frequency filter in the side chain signal can be obtained. The high-pass filter preferably has a cutoff frequency of 1500Hz, and the specific cutoff frequency can be determined according to the components of the side-chain signal in the actual situation, which is not specifically limited by the present disclosure.
S302: the side-chain signal is filtered using a high-pass filter to obtain a signal in the side-chain signal above the cut-off frequency of the high-pass filter.
After being filtered by the high-pass filter, a signal of the side-chain signal above the cut-off frequency of the high-pass filter can be obtained, and it is understood that the signal can be referred to as the side-chain signal filtered by the high-pass filter. Therefore, after the high-frequency component enters the audio output audio, the effect of enhancing the high-frequency component in the audio output signal can be achieved, and the hearing sense of the audio output signal is further improved.
Fig. 4 is a schematic flowchart illustrating a process of performing companding on a side chain signal according to an exemplary embodiment of the disclosure. As shown in fig. 4, on the basis of the embodiment shown in fig. 2, the method further includes the following steps before step S202:
s401: the side-chain signal is input to the compander.
The compander consists of a compressor and an expander, and the compressor can be used for compressing the dynamic range of a signal, wherein the dynamic range refers to the ratio of the maximum value and the minimum value of the signal (such as an audio signal). The compressor can compress the dynamic range of the signal by a compression factor, and the magnitude of the compression parameter affects the magnitude of the degree of compression. For example, the compression parameter of the compressor may be 0.5, and if the dynamic range of the signal before compression is 4dB, the dynamic range of the signal after passing through the compressor may be compressed to 2dB according to the compression parameter of 0.5.
After the side chain signal is input into the compressor in the embodiment of the disclosure, the dynamic range of the side chain signal is reduced, and the difference between the peak values of the side chain signals with different amplitudes is reduced. In this way, when the side chain signal output from the compander is applied to step S202, the distortion level between the side chain signals of different amplitudes is comparable. Wherein the difference of the distortion level depends on the original dynamic range of the side chain signal and the compression parameter.
The expander can be used for expanding the dynamic range of the signal, the expander can expand the dynamic range of the signal according to the expansion coefficient, and the expansion parameter greatly influences the expansion degree. For example, the spreading parameter of the spreader may be 2, and if the dynamic range of the signal before spreading is 2dB, the dynamic range of the signal after passing through the spreader may be spread by a spreading factor of 2 to 4dB.
In the embodiment of the present disclosure, after the side chain signal is input to the expander, the dynamic range of the side chain signal is increased, and the difference between the peak values of the side chain signals with different amplitudes is increased, which may be specifically expressed as: after expansion, the amplitude difference between the large amplitude signal and the small amplitude signal is expanded compared to before expansion. Thus, when the side-chain signal inputted from the compander is applied in step S202, the distortion is mainly concentrated on the large amplitude signal, and the distortion level of the small amplitude signal is suppressed, so that the large amplitude signal distortion is more obvious and the small amplitude signal distortion is smaller. The magnitude of the difference in distortion levels depends on the original dynamic range of the side-chain signal and the magnitude of the extension parameter.
It should be added that the compander can be determined by an algorithm related to the audio companding technology, specifically, the compressor and the expander can be determined by the same algorithm, and the compression or expansion of the signal can be realized by setting different parameters (compression parameter or expansion parameter) for the compressor and the expander respectively. For example, if the compression parameter is set to 0.5 and the expansion parameter is set to 0, then the compander will only compress the signal and not expand it.
It should be added that, in the embodiment of the present disclosure, a compander may be used to separately compress the side chain signal, a compander may also be used to separately expand the side chain signal, and a compander may also be used to simultaneously compress and expand the side chain signal, which is not specifically limited in the present disclosure.
Specifically, in the embodiment of the present disclosure, the calculation formula of the compander gain is as follows:
G=min(0,CS·(CT-X),ES·(ET-X));
wherein G represents the compander gain, min represents the minimum function, CS is the compression slope, CT is the compression threshold, X is the smoothed input signal effective value in decibels, ES is the expansion slope, and ET is the expansion threshold.
It is understood that G may represent compression and/or expansion gain in decibels of the applied side-chain signal in this embodiment. X may represent the effective value of the smoothed side-chain signal in decibels input to the compander.
For example, for a side chain signal with a peak of-3 dB, CT may be-15, ET may be 0, CS may be 0.8, and ES may be 0. Since the expansion slope is 0, the compander does not expand the side-chain signal. Since the compression threshold CT is-15 and the compression slope CS is 0.8, the compander compresses the signal with a peak value greater than the compression threshold (for example, -3dB side chain signal) by 0.8, and then calculates by taking the minimum function, and the finally obtained compander gain is-9.6, in other words, the peak value of the side chain signal after companding is compressed to-12.6 dB.
S402: and adjusting the amplitude dynamic range of the side chain signal by using the compander to obtain the side chain signal with the amplitude dynamic range within a preset range.
The preset range may be a range determined jointly according to the specific amplitude of the side-chain signal, the desired distortion effect, and the like. In this embodiment, the parameters (CS, CT, ES, ET) of the compander may be set according to a preset range.
Thus, the compander can adjust the amplitude dynamic range of the side chain signal, so that the difference of the peak values among different amplitude signals is reduced, and the amplitude dynamic range of the side chain signal is in a preset range. The relative distortion degree of different amplitudes of the side chain signal can be controlled, so that the distortion level generated after the signal components of different amplitudes in the side chain signal are input into the harmonic generator is equivalent, and the hearing sense of the audio output signal is further improved.
It should be added that, in the embodiment of the present disclosure, steps S401 and S402 may be performed after steps S301 and S302, specifically, the side chain signal is first filtered by a high-pass filter, and then the side chain signal output by the high-pass filter is input into a compander, and the side chain signal is companded by the compander.
On the basis of the embodiment shown in fig. 2, step S202 further includes the following steps:
s501: and determining the gain of the side chain signal to obtain the side chain signal after the gain.
Here, the gain of the side chain signal refers to a gain before the side chain signal is input to the harmonic generator.
Since the level of distortion generated by the harmonic generator is positively correlated with the signal amplitude, the larger the amplitude of the signal, the more harmonic components are generated after passing through the harmonic generator. Therefore, in this embodiment, the gain of the side-chain signal may be determined, and the gain may be applied to the side-chain signal based on the determined gain, so as to obtain the side-chain signal after the gain. And the step of performing gain on the side chain signal can control the amplitude of the side chain signal, wherein the larger the gain applied to the side chain signal is, the larger the amplitude change of the side chain signal after gain is, the more harmonic components are generated after the side chain signal after gain passes through the harmonic generator, and the larger the distortion degree is. Therefore, the present embodiment can apply a gain to the side-chain signal to control the amplitude of the side-chain signal, and thus control the distortion degree of the side-chain signal. The specific value of the gain can be determined according to the amplitude of the side chain signal, the expected distortion effect and the like, and is preferably a value between 1 and 5. The step of gain may be implemented by a gain amplifier or the like.
It should be added that, in the embodiment of the present disclosure, step S501 may be executed after step S301, step S302, step S401, and step S402, specifically, the side chain signal is first filtered by a high-pass filter, then the side chain signal output by the high-pass filter is input into a compander, the side chain signal is companded by the compander, and then the gain of the side chain signal output by the compander is determined, so as to obtain a side chain signal after gain.
It should be noted that, in step S202, the side chain signal input to the harmonic generator is determined based on step S301, step S302, step S401, step S402, and step S501, and after passing through step S301 and step S302, the side chain signal is filtered into a high frequency signal by the high frequency filter. Then, step S202 determines the odd harmonic signal and the even harmonic signal based on the high-frequency side chain signal, so that the odd harmonic signal and the even harmonic signal are also high-frequency signals, and the high-frequency signal is more strongly expressed in audibility. Then, when the gain of the main chain signal is 1 in step S204, the gain of the first mixed signal may be determined to be a value less than 1, so that the audio output signal obtained after the first mixed signal is mixed with the main chain signal does not lose the sound information originally expressed by the audio signal due to excessive components of the high frequency signal. For example, when the required distortion effect is weak and the audibility is less obvious, the gain ratio of the main chain signal to the first mixed signal may be determined to be 1.
Fig. 5 is a schematic flow chart of generating harmonics by a harmonic generator according to an exemplary embodiment of the present disclosure. As shown in fig. 5, on the basis of the embodiment shown in fig. 2, the step S202 includes the following steps:
s2021: and determining a first side chain sub-signal and a second side chain sub-signal according to the side chain signals.
The step of determining the first side chain sub-signal and the second side chain sub-signal according to the side chain signal may be to copy the side chain signal to obtain the identical first side chain sub-signal and second side chain sub-signal.
S2022: the first side chain sub-signal and the second side chain sub-signal are input to a harmonic generator.
The harmonic generator may be configured to generate an odd harmonic signal based on the first side chain sub-signal and may be further configured to generate an even harmonic signal based on the second side chain sub-signal. In this way, it is convenient to control the ratio of the odd harmonic signal to the even harmonic signal.
S2023: the first side chain sub-signal is symmetrically clipped using a harmonic generator to generate an odd harmonic signal.
Where clipping is a form of distortion, clipping may cause the signal to be controlled within a threshold range, and clipping may result in generation of harmonics. Symmetric clipping refers to clipping in which the amplitudes are symmetric up and down, and the absolute values of the amplitude thresholds of the up and down clipping are equal. Taking the waveform diagram of an audio signal as an example, the amplitudes in the waveform diagram are generally symmetrically distributed with respect to the amplitude equal to 0, and the absolute values of the clipping thresholds set for the amplitude above 0 and the amplitude below 0 are equal when symmetric clipping is performed.
In this way, the harmonic generator may cause amplitudes in the first side chain sub-signal that exceed the clipping threshold to be clipped, while also generating odd harmonic signals based on the first side chain sub-signal.
Fig. 6 is a schematic diagram of a symmetrical clipping flow provided by an exemplary embodiment of the present disclosure.
As shown in fig. 6, on the basis of the embodiment shown in fig. 2, step S2023 includes the following steps:
s20231: a symmetric clipping dynamic range mapping function of the harmonic generator is determined.
Wherein, the symmetric clipping dynamic range mapping function is as follows:
Figure BDA0003864922480000131
wherein, y (n) is a symmetrical clipping output signal, x (n) is a symmetrical clipping input signal, n is a sampling point serial number, and d is a parameter for controlling the hardness degree of the inflection point. It is understood that in the present embodiment, y (n contains odd harmonic signals, and x (n) is the first side chain sub-signal.
In addition, in the present embodiment, y (n) includes a frequency component of the original signal (first side chain sub-signal) and also includes a frequency component of an odd harmonic of the original signal (odd harmonic signal). In step S204, the signals included in y (n) may be directly mixed to obtain an audio output signal.
S20232: and symmetrically clipping the first side chain sub-signal according to a symmetrical clipping dynamic range mapping function to generate an odd harmonic signal, wherein the speed of the amplitude of the odd harmonic signal decaying along with the order is determined by the symmetrical clipping dynamic range mapping function.
In this way, odd harmonic signals may be generated based on the first side chain sub-signal according to a symmetric clipping dynamic range mapping function of the harmonic generator.
The magnitude of the harmonics affects the amount of energy in the high and low order signals in the harmonic signal as the speed of the order decay. The energy of the lower order harmonics in the harmonic signal is relatively large if the harmonic amplitudes decay faster with increasing frequency order, and the energy of the higher order harmonics in the harmonic signal is relatively large if the harmonic amplitudes decay slower with increasing frequency order. The embodiment of the disclosure can also control the speed of the energy of the odd harmonic signal along with the order attenuation, and is embodied in controlling parameters of a symmetric clipping dynamic range mapping function for controlling the soft and hard degrees of inflection points. The amplitude of the odd harmonic signals decays faster as the frequency order increases when a softer inflection point is used by the mapping function, and slower as the frequency order increases when a harder inflection point is used by the mapping function. Therefore, the energy distribution of different orders of harmonics in odd harmonic signals can be controlled by controlling the hardness and softness of the inflection points.
Fig. 7 is a spectrum image after a 100Hz signal is symmetrically clipped according to an exemplary embodiment of the present disclosure. An image as shown in figure 7 can be obtained by inputting a 100Hz signal into a symmetric clipped dynamic range mapping function. Wherein, the image abscissa is the signal frequency, and the image ordinate is the signal frequency spectrum. As shown in FIG. 7, the frequency at point A is 300Hz, the frequency at point B is 500Hz, and the frequency at point C is 700Hz, that is, the 100Hz signal is symmetrically cut to obtain the corresponding odd harmonic signal.
Fig. 8 is a symmetrical clipping dynamic range mapping function image provided by an exemplary embodiment of the present disclosure. As shown in fig. 8, the abscissa is the input signal amplitude and the ordinate is the output signal amplitude. The solid line shows a symmetrical clipped dynamic range mapping function image with hard corners, for an image with an input signal amplitude range between-0.8 and-0.6, the output signal amplitude rises rapidly after the input signal amplitude is greater than a certain amplitude value as the input signal amplitude increases. The dashed line shows the image of the dynamic range mapping function clipped symmetrically with soft-knee, for an image with an input signal amplitude range between-0.8 and-0.6, the output signal amplitude rises slowly as the input signal amplitude increases. With continued reference to fig. 7, the solid line shows the symmetrically clipped image when the symmetric clipped dynamic range mapping function employs a hard inflection point, and the dashed line shows the symmetrically clipped image when the symmetric clipped dynamic range mapping function employs a soft inflection point. As shown in fig. 7, in the solid-line image, the odd harmonic signal decays slower as the frequency order increases. In the dotted image, the odd harmonic signals are attenuated faster as the frequency order increases.
Therefore, the proportion of high-order harmonics and low-order harmonics in the odd harmonic signals can be adjusted, and the fine control of the odd harmonic signal structure is further realized.
S2024: the second side chain sub-signal is rectified using a harmonic generator to generate an even harmonic signal.
Rectification, which is a form of distortion, results in the generation of even harmonics. The rectification may specifically be full-wave rectification or half-wave rectification.
The following is an exemplary description in the manner of half-wave rectification.
The half-wave rectification dynamic range mapping function of the harmonic generator is as follows:
y(n)=max(0,x(n));
wherein y (n) represents a half-wave rectification output signal, x (n) is a half-wave rectification input signal, max is a function for solving the maximum value, and n is a sampling point serial number. It is understood that in the present embodiment, y (n) includes even harmonic signals, and x (n) is the second side chain sub-signal.
In this embodiment, y (n) includes a frequency component of the original signal (second side chain sub-signal) and also includes a frequency component of an even harmonic of the original signal (even harmonic signal). In step S204, the signals included in y (n) may be directly mixed to obtain an audio output signal.
In this way, an even harmonic signal may be generated based on the second side chain sub-signal according to the half-wave rectified dynamic range mapping function of the harmonic generator.
Fig. 9 is a half-wave rectified dynamic range mapping function image provided by an exemplary embodiment of the present disclosure. As shown in fig. 9, the image abscissa is the input signal amplitude and the image ordinate is the output signal amplitude. In the example shown in fig. 9, the amplitude variation range of the input signal is [ -1,1], and the amplitude variation range of the output signal after half-wave rectification is [0,1].
Fig. 10 is a frequency image of a 100Hz signal after half-wave rectification provided by an exemplary embodiment of the present disclosure. Fig. 10 shows a frequency image of a 100Hz signal after half-wave rectification, with the signal frequency on the abscissa and the signal frequency spectrum on the ordinate. As shown in fig. 10, the frequency at point E is 200hz, the frequency at point f is 400hz, and the frequency at point g is 600Hz, that is, the 100Hz signal is half-wave rectified to obtain the even harmonic signal corresponding thereto.
In step S2024, the second side chain sub-signal may be half-wave rectified according to a half-wave rectified dynamic range mapping function to obtain an even harmonic signal.
Exemplary devices
Fig. 11 is a schematic structural diagram of an audio processing apparatus according to an exemplary embodiment of the present disclosure. The apparatus may be used to implement all or part of the functionality of the method embodiments described above. Specifically, the audio processing apparatus includes a signal determining module 701, a harmonic generating module 702, a first gain module 703 and a mixing module 704.
Specifically, the signal determining module 701 in the embodiment of the present disclosure is configured to obtain an audio signal to be processed, and determine a main chain signal and a side chain signal;
the harmonic generation module 702 is configured to input the side-chain signal determined by the signal determination module 701 into a harmonic generator, and generate an odd harmonic signal and an even harmonic signal, respectively;
the first gain module 703 is configured to determine a gain of the odd harmonic signal generated by the harmonic generation module 702 and a gain of the even harmonic signal generated by the harmonic generation module 702, so as to obtain a gain odd harmonic signal and a gain even harmonic signal;
the mixing module 704 is configured to mix the odd harmonic signal and the even harmonic signal after the gain output by the first gain module 703 with the main chain signal to obtain an audio output signal.
Fig. 12 is another schematic structural diagram of an audio processing method according to an exemplary embodiment of the present disclosure.
Optionally, in another implementation manner of this embodiment, as shown in fig. 12, the harmonic generation module 702 includes a sub-signal determination unit 7021, an input unit 7022, a symmetric clipping unit 7023, and a rectification unit 7024.
The sub-signal determining unit 7021 is configured to determine the first side chain sub-signal and the second side chain sub-signal according to the side chain signal.
The input unit 7022 is configured to input the first side chain sub-signal and the second side chain sub-signal determined by the sub-signal determination unit 7021 to the harmonic generator.
The symmetric clipping unit 7023 is configured to symmetrically clip the first side-chain sub-signal input by the input unit 7022 using a harmonic generator to generate an odd harmonic signal.
The rectifying unit 7024 is configured to rectify the second side chain sub-signal input by the input unit 7022 by using a harmonic generator to generate an even harmonic signal.
Optionally, in another implementation manner of this embodiment, the symmetrically clipping the first side chain sub-signal by using a harmonic generator to generate an odd harmonic signal includes:
determining a symmetric clipping dynamic range mapping function of the harmonic generator;
and symmetrically clipping the first side chain sub-signal according to a symmetrical clipping dynamic range mapping function to generate an odd harmonic signal, wherein the speed of the amplitude of the odd harmonic signal attenuated along with the order is determined by the symmetrical clipping dynamic range mapping function.
Optionally, in another implementation manner of this embodiment, as shown in fig. 12, the apparatus provided in this embodiment of the disclosure may further include a first input module 705 and a high-pass filtering module 706.
The first input module 705 is used for inputting the side chain signal into a high pass filter.
The high-pass filtering module 706 is configured to filter the side-chain signal using the high-pass filter to obtain a signal in the side-chain signal that is higher than a cutoff frequency of the high-pass filter.
Optionally, in another implementation manner of this embodiment, as shown in fig. 12, the apparatus provided in this embodiment of the present disclosure may further include a second input module 707 and a companding module 708.
The second input module 707 is used for inputting the side chain signal to the compander;
the companding module 708 is configured to adjust an amplitude dynamic range of the side-chain signal using a compander to obtain the side-chain signal with the amplitude dynamic range within a preset range.
Optionally, in another implementation manner of this embodiment, as shown in fig. 12, the apparatus provided in this embodiment of the disclosure may further include a second gain module 709.
The second gain module 709 is configured to determine a gain of the side chain signal to obtain a side chain signal after the gain.
In addition, in this apparatus embodiment, the functions of the respective modules shown in fig. 11 correspond to those of the method embodiment shown in fig. 1, for example, the signal determining module 701 is configured to execute the method step S201, the harmonic generating module 702 is configured to execute the method step S202, the gain module 703 is configured to execute the method step S203, and the mixing module 704 is configured to execute the method step S204.
Exemplary electronic device
Next, an electronic apparatus according to an embodiment of the present disclosure is described with reference to fig. 13. The electronic device may be either or both of the first device 100 and the second device 200, or a stand-alone device separate from them that may communicate with the first device and the second device to receive the collected input signals therefrom.
FIG. 13 illustrates a block diagram of an electronic device in accordance with an embodiment of the disclosure.
As shown in fig. 13, the electronic device 10 includes one or more processors 11 and a memory 12.
The processor 11 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.
Memory 12 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer readable storage medium and executed by the processor 11 to implement the audio processing methods of the various embodiments of the present disclosure described above and/or other desired functions. Various contents such as an input signal, a signal component, a noise component, etc. may also be stored in the computer-readable storage medium.
In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected by a bus system and/or other form of connection mechanism (not shown).
For example, when the electronic device is the first device 100 or the second device 200, the input device 13 may be a microphone or a microphone array as described above for capturing an input signal of a sound source. When the electronic device is a stand-alone device, the input means 13 may be a communication network connector for receiving the acquired input signals from the first device 100 and the second device 200.
The input device 13 may also include, for example, a keyboard, a mouse, and the like.
The output device 14 may output various information including the determined distance information, direction information, and the like to the outside. The output devices 14 may include, for example, a display, speakers, a printer, and a communication network and its connected remote output devices, among others.
Of course, for simplicity, only some of the components of the electronic device 10 relevant to the present disclosure are shown in fig. 13, and components such as buses, input/output interfaces, and the like are omitted. In addition, the electronic device 10 may include any other suitable components depending on the particular application.
Exemplary computer program product and computer-readable storage Medium
In addition to the above-described methods and apparatus, embodiments of the present disclosure may also be a computer program product comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the audio processing method according to various embodiments of the present disclosure described in the "exemplary methods" section of this specification above.
The computer program product may write program code for carrying out operations for embodiments of the present disclosure in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present disclosure may also be a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform steps in an audio processing method according to various embodiments of the present disclosure described in the "exemplary methods" section above in this specification.
The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing describes the general principles of the present disclosure in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present disclosure are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present disclosure. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the disclosure will be described in detail with reference to specific details.
The block diagrams of devices, apparatuses, systems referred to in this disclosure are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
It is also noted that in the apparatus, devices, and methods of the present disclosure, various components or steps may be broken down and/or re-combined. Such decomposition and/or recombination should be considered as equivalents of the present disclosure.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims (10)

1. An audio processing method, comprising:
acquiring an audio signal to be processed, and determining a main chain signal and a side chain signal;
inputting the side chain signal into a harmonic generator to respectively generate an odd harmonic signal and an even harmonic signal;
determining the gain of the odd harmonic signal and the gain of the even harmonic signal to obtain a gained odd harmonic signal and a gained even harmonic signal;
and mixing the gained odd harmonic signal, the gained even harmonic signal and the main chain signal to obtain an audio output signal.
2. The audio processing method of claim 1, wherein said inputting the side chain signal into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively, comprises:
determining a first side chain sub-signal and a second side chain sub-signal according to the side chain signal;
inputting the first side chain sub-signal and the second side chain sub-signal to the harmonic generator;
symmetrically clipping the first side chain sub-signal using the harmonic generator to generate the odd harmonic signal;
rectifying the second side chain sub-signal using the harmonic generator to generate the even harmonic signal.
3. The audio processing method of claim 2, wherein said symmetrically clipping the first side chain sub-signal using the harmonic generator to generate the odd harmonic signal comprises:
determining a symmetric clipping dynamic range mapping function for the harmonic generator;
and symmetrically clipping the first side chain sub-signal according to the symmetrical clipping dynamic range mapping function to generate the odd harmonic signal, wherein the speed of the amplitude of the odd harmonic signal decaying along with the order is determined by the symmetrical clipping dynamic range mapping function.
4. The audio processing method of claim 1, wherein before the inputting the side chain signal into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively, the method further comprises:
inputting the side-chain signal into a high-pass filter;
filtering the side chain signal by using the high-pass filter to obtain a signal which is higher than the cut-off frequency of the high-pass filter in the side chain signal.
5. The audio processing method of claim 1, wherein before the inputting the side chain signal into a harmonic generator to generate an odd harmonic signal and an even harmonic signal, respectively, the method further comprises:
inputting the side chain signal to a compander;
and adjusting the amplitude dynamic range of the side chain signal by using the compander to obtain the side chain signal with the amplitude dynamic range within a preset range.
6. The audio processing method according to claim 1, 4 or 5, wherein before said inputting said side chain signal into a harmonic generator for generating an odd harmonic signal and an even harmonic signal, respectively, the method further comprises:
and determining the gain of the side chain signal to obtain the side chain signal after the gain.
7. An audio processing apparatus comprising:
a signal determination module: the method comprises the steps of obtaining an audio signal to be processed, and determining a main chain signal and a side chain signal;
a harmonic generation module: the side chain signal determined by the signal determination module is input into a harmonic generator to generate an odd harmonic signal and an even harmonic signal respectively;
a first gain module: the harmonic generation module is used for generating an odd harmonic signal and an even harmonic signal according to the received odd harmonic signal and the received even harmonic signal;
the sound mixing module: and the audio output signal is obtained by mixing the gained odd harmonic signal and even harmonic signal output by the first gain module with the main chain signal.
8. The audio processing apparatus of claim 7, wherein the harmonic generation module comprises:
a sub-signal determining unit, configured to determine a first side chain sub-signal and a second side chain sub-signal according to the side chain signal;
an input unit configured to input the first side chain sub-signal and the second side chain sub-signal determined by the sub-signal determination unit to the harmonic generator;
a symmetric clipping unit for performing symmetric clipping on the first side chain sub-signal input by the input unit using the harmonic generator to generate the odd harmonic signal;
a rectifying unit for rectifying the second side chain sub-signal input by the input unit using the harmonic generator to generate the even harmonic signal.
9. A computer-readable storage medium storing a computer program for executing the audio processing method of any of the above claims 1-6.
10. An electronic device, the electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor is configured to read the executable instructions from the memory and execute the instructions to implement the audio processing method of any one of claims 1 to 6.
CN202211176938.XA 2022-09-26 2022-09-26 Audio processing method and device Pending CN115866482A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211176938.XA CN115866482A (en) 2022-09-26 2022-09-26 Audio processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211176938.XA CN115866482A (en) 2022-09-26 2022-09-26 Audio processing method and device

Publications (1)

Publication Number Publication Date
CN115866482A true CN115866482A (en) 2023-03-28

Family

ID=85661149

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211176938.XA Pending CN115866482A (en) 2022-09-26 2022-09-26 Audio processing method and device

Country Status (1)

Country Link
CN (1) CN115866482A (en)

Similar Documents

Publication Publication Date Title
KR101310231B1 (en) Apparatus and method for enhancing bass
JP5730881B2 (en) Adaptive dynamic range enhancement for recording
US20030216907A1 (en) Enhancing the aural perception of speech
JP4747835B2 (en) Audio reproduction effect adding method and apparatus
JP2012235310A (en) Signal processing apparatus and method, program, and data recording medium
JP5453740B2 (en) Speech enhancement device
EP2172930B1 (en) Audio signal processing device and audio signal processing method
JP2013102411A (en) Audio signal processing apparatus, audio signal processing method, and program
US8213636B2 (en) Method and a system for reconstituting low frequencies in audio signal
US9413316B2 (en) Asymmetric polynomial psychoacoustic bass enhancement
US10382857B1 (en) Automatic level control for psychoacoustic bass enhancement
JP2010537233A (en) Compressed digital TV audio processing
US20050147262A1 (en) Method for decreasing the dynamic range of a signal and electronic circuit
JP2015050685A (en) Audio signal processor and method and program
US10128809B2 (en) Intelligent method and apparatus for spectral expansion of an input signal
US8416965B2 (en) Harmonics generation apparatus and method thereof
US20210158833A1 (en) Audio Signal
Zorilă et al. Effectiveness of a loudness model for time-varying sounds in equating the loudness of sentences subjected to different forms of signal processing
CN109841223B (en) Audio signal processing method, intelligent terminal and storage medium
CN115866482A (en) Audio processing method and device
CN112585868A (en) Audio enhancement in response to compression feedback
Vickers The Non-flat and Continually Changing Frequency Response of Multiband Compressors
Mu Perceptual quality improvement and assessment for virtual bass system
CN111478675A (en) Audio signal processing system, audio signal processing method and electronic equipment
US11792572B2 (en) Audio signal processing circuit and audio signal processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination