WO2020097824A1

WO2020097824A1 - Audio processing method and apparatus, storage medium, and electronic device

Info

Publication number: WO2020097824A1
Application number: PCT/CN2018/115408
Authority: WO
Inventors: 陈岩
Original assignee: 深圳市欢太科技有限公司; Oppo广东移动通信有限公司
Priority date: 2018-11-14
Filing date: 2018-11-14
Publication date: 2020-05-22
Also published as: CN113170260A; CN113170260B

Abstract

An audio processing method, applicable to an electronic device. The method comprises: obtaining an audio signal required to be output by a loudspeaker (101); performing bass boost processing on the audio signal to obtain a bass boosted audio signal (102); predicting a diaphragm displacement generated by output of the bass boosted audio signal by the loudspeaker, and determining whether the predicted diaphragm displacement is greater than a preset displacement (103); and if yes, performing gain control on the bass boosted audio signal to enable the diaphragm displacement generated by output of the bass boosted audio signal subjected to gain control by the loudspeaker to be less than or equal to the preset displacement (104).

Description

Audio processing method, device, storage medium and electronic equipment

Technical field

The present application belongs to the technical field of audio processing, and particularly relates to an audio processing method, device, storage medium, and electronic equipment.

Background technique

With the rapid development of electronic devices such as mobile phones and tablet computers, electronic devices have developed into intelligent devices with multiple functions, and people have increasingly higher requirements for the quality of audio signals played by electronic devices. However, due to the small volume of speakers configured by electronic devices, there is a problem of poor low-frequency reduction ability of the speakers. However, the low-frequency components in the audio signal play an important role in auditory perception. The lack of bass components will make the sound sound pale and Weakness.

Summary of the invention

Embodiments of the present application provide an audio processing method, apparatus, storage medium, and electronic equipment, which can improve the quality of audio signals played by electronic equipment.

In a first aspect, an embodiment of the present application provides an audio processing method, which is applied to an electronic device and includes:

Obtain the audio signal that needs to be output by the speaker;

Bass enhancement processing is performed on the audio signal to obtain a bass enhancement audio signal;

Predict the displacement of the diaphragm generated by the speaker outputting the bass-enhanced audio signal, and determine whether the predicted diaphragm displacement is greater than a preset displacement;

If yes, performing gain control on the bass-enhanced audio signal so that the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal is less than or equal to the preset displacement.

In a second aspect, an embodiment of the present application provides an audio processing device, which is applied to an electronic device and includes:

Audio acquisition module for acquiring audio signals that need to be output by the speaker;

Bass enhancement module, used to perform bass enhancement processing on the audio signal to obtain a bass enhanced audio signal;

A displacement prediction module, used to predict the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal, and determine whether the predicted diaphragm displacement is greater than a preset displacement;

The gain control module is configured to perform gain control on the bass-enhanced audio signal if the judgment result of the displacement prediction module is yes, so that the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal is less than or equal to the Preset displacement.

In a third aspect, an embodiment of the present application provides a storage medium on which a computer program is stored, wherein, when the computer program is executed on a computer, the computer is caused to execute the audio processing method provided in the embodiment of the present application. step.

According to a fourth aspect, an embodiment of the present application provides an electronic device, including a memory and a processor, and the processor is used to execute a computer program stored in the memory by executing:

Obtain the audio signal that needs to be output by the speaker;

In the application example, the electronic device can obtain the audio signal that needs to be output by the speaker; then, the audio signal that needs to be output by the speaker is subjected to bass enhancement processing to obtain a bass-enhanced audio signal; Diaphragm displacement, and judge whether the predicted diaphragm displacement is greater than the preset displacement, and if so, perform gain control on the bass enhanced audio signal so that the diaphragm displacement generated by the speaker outputting the bass enhanced audio signal is less than or equal to the preset Displacement, in this way, the bass-enhanced audio signal after gain control retains the low-frequency components of the original audio signal, so that the playback quality can be improved and the speaker will not be damaged.

BRIEF DESCRIPTION

The technical solution of the present invention and its beneficial effects will be apparent through the detailed description of the specific embodiments of the present invention with reference to the accompanying drawings.

FIG. 1 is a schematic flowchart of an audio processing method provided by an embodiment of the present application.

2 is another schematic flowchart of an audio processing method provided by an embodiment of the present application.

FIG. 3 is a schematic diagram of dividing a sound-reduced enhanced audio signal into multiple audio frames in an embodiment of the present application.

4 is a schematic diagram of a virtual bass configuration interface provided in an embodiment of the present application.

5 is a schematic structural diagram of an audio processing device provided by an embodiment of the present application.

6 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

7 is another schematic structural diagram of an electronic device provided by an embodiment of the present application.

detailed description

Please refer to the drawings, where the same component symbols represent the same components. The principle of the present invention is illustrated by implementation in an appropriate computing environment. The following description is based on the illustrated specific embodiments of the present invention, which should not be construed as limiting other specific embodiments of the present invention that are not detailed herein.

Please refer to FIG. 1, which is a schematic flowchart of an audio processing method provided by an embodiment of the present application. The audio processing method can be applied to electronic devices. The flow of the audio processing method may include:

In 101, an audio signal that needs to be output by a speaker is acquired.

The audio signal that needs to be output by the speaker can be determined according to user operations. For example, when the electronic device receives a user-triggered playback operation on the XX song, the audio signal of the XX song is determined as the audio signal that needs to be output by the speaker.

After determining the audio signal that needs to be output by the speaker, the electronic device acquires the audio signal. For example, when the electronic device locally stores the audio signal that needs to be output by the speaker, the audio signal that needs to be output by the speaker can be directly obtained locally, and if the audio signal that needs to be output by the speaker is not stored locally, the electronic device can The audio signal that needs to be output by the speaker is obtained from other electronic devices or servers.

In 102, bass enhancement processing is performed on the aforementioned audio signal to obtain a bass enhancement audio signal.

After acquiring the audio signal that needs to be output by the speaker, the electronic device may use virtual bass enhancement technology to perform bass enhancement processing on the audio signal that needs to be output by the speaker, and record the audio signal after bass enhancement processing as a bass enhancement audio signal.

In 103, the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal is predicted, and it is determined whether the predicted diaphragm displacement is greater than the preset displacement.

It should be noted that when the signal strength of the bass-enhanced audio signal is too large, it may cause the displacement of the diaphragm generated by the speaker to output the bass-enhanced audio signal to be too large and damage the speaker's diaphragm. For this reason, the embodiments of the present application are configured with a preset displacement, which is the maximum diaphragm displacement that will not cause damage to the diaphragm. The preset displacement can be performed by a person of ordinary skill in the art according to the diaphragm in the actual speaker Configuration, this embodiment of the present application does not specifically limit this.

In this way, after bass enhancement processing is performed on the audio signal that needs to be output from the speaker to obtain a bass enhancement audio signal, the electronic device predicts the diaphragm displacement generated by the speaker outputting the bass enhancement audio signal according to the physical characteristics of the speaker, and judges the predicted vibration Whether the membrane displacement is greater than the preset displacement, where if the predicted diaphragm displacement is greater than the preset displacement, it means that direct output of the bass-enhanced audio signal from the speaker will cause damage to the speaker's diaphragm, if the predicted diaphragm displacement is less than or equal to the Setting the displacement means that outputting the bass-enhanced audio signal directly from the speaker will not damage the speaker's diaphragm.

In 104, if yes, gain control is performed on the bass-enhanced audio signal, so that the diaphragm displacement generated by the speaker-enhanced bass-enhanced audio signal after gain control is less than or equal to the preset displacement.

In the embodiment of the present application, after the electronic device determines whether the predicted diaphragm displacement is greater than the preset displacement, if the obtained judgment result is yes, that is, when the predicted diaphragm displacement is greater than the preset displacement, the bass enhancement audio The signal is gain controlled so that the diaphragm displacement generated by the bass-enhanced audio signal after the speaker outputs gain control is less than or equal to the preset displacement to avoid damage to the diaphragm of the speaker.

It can be seen from the above that in the embodiment of the present application, the electronic device can obtain the audio signal that needs to be output by the speaker; then, the audio signal that needs to be output by the speaker is subjected to bass enhancement processing to obtain a bass enhancement audio signal; then, the speaker outputs the bass enhancement The displacement of the diaphragm generated by the audio signal, and determine whether the predicted displacement of the diaphragm is greater than the preset displacement. If it is, then perform gain control on the bass-enhanced audio signal so that the diaphragm displacement generated by the speaker output bass-enhanced audio signal is less than or It is equal to the preset displacement, so that the bass-enhanced audio signal after gain control retains the low-frequency components of the original audio signal, so that the playback quality can be improved and the speaker will not be damaged.

Please refer to FIG. 2, which is another schematic flowchart of an audio processing method according to an embodiment of the present application. The audio processing method can be applied to electronic devices. The flow of the audio processing method may include:

In 201, the electronic device acquires an audio signal that needs to be output by the speaker.

In 202, the electronic device performs bass enhancement processing on the aforementioned audio signal to obtain a bass enhanced audio signal.

In 203, the electronic device divides the bass-enhanced audio signal into multiple audio frames.

It should be noted that the audio signal is not stable macroscopically, but it is stable microscopically and has short-term stability. It is generally considered that the audio signal is stable in the period of 10 ms to 30 ms. In order to process the bass enhancement audio signal more accurately, the bass enhancement audio signal is divided into multiple short segments for processing, and each short segment is called an audio frame.

It should be noted that how to divide the audio frame of the bass-enhanced audio signal can be performed by a person of ordinary skill in the art according to actual needs, which is not specifically limited in the embodiments of the present application. For example, referring to FIG. 3, the electronic device may divide the bass-enhanced audio signal into i audio frames with a duration of 30 milliseconds.

In 204, the electronic device sequentially selects one audio frame from the multiple audio frames as the current audio frame.

In the embodiment of the present application, the electronic device processes the divided audio frames frame by frame. After the bass-enhanced audio signal is divided into multiple audio frames, the electronic device sequentially selects one audio frame from the multiple audio frames as the current audio frame. For example, when the electronic device selects the current audio frame, can it obtain multiple audio frames in the time domain according to the division order, and sequentially select one audio frame from the multiple audio frames as the current audio frame.

It can be understood by those of ordinary skill in the art that the current audio frame is not specifically used to refer to a certain audio frame, but is used to refer to the audio frame that is being processed at the current time. For example, if the bass enhancement audio signal is If the five audio frames are processed, the fifth audio frame is the current audio frame. If the sixth audio frame of the bass-enhanced audio signal is processed at the current moment, the sixth audio frame is the current audio frame ,and many more.

In 205, the electronic device predicts the diaphragm displacement generated by the speaker outputting the current audio frame to obtain the predicted diaphragm displacement of the current audio frame.

It should be noted that when the signal strength of the audio signal is too large, the diaphragm generated by the speaker outputting the audio signal may be displaced too much and damage the diaphragm of the speaker. For this reason, the embodiments of the present application are configured with a preset displacement, which is the maximum diaphragm displacement that will not cause damage to the diaphragm. The preset displacement can be performed by a person of ordinary skill in the art according to the diaphragm in the actual speaker Configuration, this embodiment of the present application does not specifically limit this.

In this way, after bass enhancement processing is performed on the audio signal that needs to be output by the speaker to obtain a bass enhancement audio signal, for the current audio frame of the selected bass enhancement audio signal, the electronic device predicts that the speaker outputs the current audio frame according to the physical characteristics of the speaker Of the diaphragm displacement to obtain the predicted diaphragm displacement of the current audio frame.

In 206, the electronic device determines whether the predicted diaphragm displacement of the current audio frame is greater than the preset displacement, if yes, go to 207, otherwise go to 208;

After predicting the predicted diaphragm displacement of the current audio frame, the electronic device further determines whether the predicted diaphragm displacement of the current audio frame is greater than the preset displacement, thereby determining whether the output of the current audio frame by the speaker may cause the vibration of the speaker according to the obtained judgment result The membrane is damaged.

Among them, if the predicted diaphragm displacement of the current audio frame is greater than the preset displacement, it means that directly outputting the current audio frame from the speaker will cause the speaker diaphragm to be damaged. In this case, it is necessary to perform gain control on the current audio frame so that the speaker output current The displacement of the diaphragm generated by the audio frame is less than or equal to the preset displacement, and execution proceeds to 207.

If the predicted diaphragm displacement of the current audio frame is less than or equal to the preset displacement, it means that outputting the bass-enhanced audio signal directly from the speaker will not cause the speaker diaphragm to be damaged. In this case, it is not necessary to perform gain control on the current audio frame and go to execution 208.

In 207, the electronic device performs gain control on the current audio frame so that the diaphragm displacement generated by the speaker outputting the current audio frame is less than or equal to the preset displacement.

The electronic device performs gain control on the current audio frame, so that when the speaker actually outputs the current audio frame after gain control, the diaphragm displacement generated is less than or equal to the preset displacement, thereby avoiding the speaker ’s output caused by the output of the current audio frame The diaphragm is damaged.

In 208, the electronic device determines whether the current audio frame is the last audio frame, if yes, go to 209, otherwise go to 204.

In the embodiment of the present application, the electronic device determines whether the current audio frame is the last audio frame, thereby determining whether all audio frames for the bass-enhanced audio signal have been completed (that is, multiple audio frames obtained by dividing the bass-enhanced audio signal) according to the obtained judgment result ).

Among them, if the obtained judgment result is yes, it means that the processing of all audio frames of the bass-enhanced audio signal has been completed. At this time, the process proceeds to 209 to synthesize all audio frames into a complete audio signal.

If the obtained judgment result is no, it means that the processing of all audio frames of the bass-enhanced audio signal has not been completed. At this time, the process proceeds to 204, and the audio frames are selected for processing.

In 209, the electronic device synthesizes multiple audio frames to obtain a bass-enhanced audio signal after gain control.

In the embodiment of the present application, after completing the processing of all audio frames of the bass-enhanced audio signal, the electronic device synthesizes the multiple audio frames to obtain the bass-enhanced audio signal after gain control. Wherein, how to synthesize the foregoing multiple audio frames can be performed by a person of ordinary skill in the art according to actual needs, which is not limited in the embodiments of the present application.

Based on the above description, those of ordinary skill in the art may understand that, in the embodiments of the present application, the electronic device performs gain control on the audio frames that may cause speaker damage in the bass-enhanced audio signal, and synthesizes the bass after gain control Enhance the audio signal so that when the speaker outputs the bass-enhanced audio signal after gain control, the diaphragm displacement generated will never be greater than the preset diaphragm displacement, which will not cause damage to the speaker diaphragm. In addition, the bass-enhanced audio signal retains the low-frequency components of the original audio signal, which improves playback quality.

In one embodiment, when predicting the diaphragm displacement generated by the speaker outputting the current audio frame to obtain the predicted diaphragm displacement of the current audio frame, the electronic device may execute:

The electronic device determines the voltage required by the speaker to output the current audio frame;

The electronic device predicts the predicted diaphragm displacement of the current audio frame according to the aforementioned voltage and the transfer function of the preset voltage to the diaphragm displacement.

It should be noted that the transfer function of the voltage to the displacement of the diaphragm can be predetermined according to the impedance characteristics and mechanical characteristics of the speaker.

Among them, the transfer function of voltage to diaphragm displacement can be expressed as:

H _x (s) represents the transfer function of voltage to diaphragm displacement, X (s) represents the Laplace transform of the diaphragm displacement, and U (s) represents the Laplace transform of voltage.

It should be noted that the transfer function is determined by the essential characteristics of the system and has nothing to do with the input volume. After knowing the transfer function, the output volume can be obtained from the input volume, or the input volume can be determined according to the required output volume.

Therefore, in the embodiment of the present application, when predicting the predicted diaphragm displacement of the speaker to output the current audio frame, the electronic device first determines the voltage (input amount) required by the speaker to output the current audio frame, and then outputs the current audio frame according to the speaker Voltage and the transfer function of the preset voltage to the diaphragm displacement, the predicted diaphragm displacement (output value) of the current audio frame can be predicted.

Optionally, in one embodiment, the transfer function of voltage to diaphragm displacement is obtained by the following formula:

Where b is the force factor of the speaker, L is the voice coil inductance of the speaker, Re is the DC resistance of the speaker, m is the mechanical quality of the speaker, s is the Laplace operator, Rm is the mechanical resistance of the speaker, S _D Represents the diaphragm area of the speaker, and k represents the stiffness coefficient of the speaker.

It should be noted that the force factor, voice coil inductance, DC resistance, mechanical quality, mechanical resistance, diaphragm area, and stiffness coefficient of the speaker can be measured in advance.

For example, the impedance of a loudspeaker can be measured using a swept frequency signal.

In an embodiment, when performing gain control on the current audio frame, the electronic device may perform:

The electronic device obtains a gain coefficient for controlling the diaphragm displacement generated by the speaker outputting the current audio frame according to the predicted diaphragm displacement, the preset displacement and the transfer function of the voltage to the diaphragm displacement of the current audio frame;

The electronic device performs gain control on the current audio frame according to the aforementioned gain coefficient.

It should be noted that since the transfer function of the voltage to the diaphragm displacement is constant, then reducing the voltage supplied to the speaker can reduce the diaphragm displacement generated by the speaker, and the voltage required by the speaker to output the current audio frame depends on the current The signal strength of the audio frame, therefore, you can perform gain control on the current audio frame to reduce its signal strength, thereby reducing the voltage supplied to the speaker due to the output of the current audio frame, so that the diaphragm displacement generated by the speaker output of the current audio frame can be reduced small.

In the embodiment of the present application, if α is used to represent the gain coefficient for gain control of the current audio frame, the transfer function of the voltage to the diaphragm displacement can be expressed as:

Where U (s) represents the Laplace transform of the voltage required by the speaker to output the current audio frame before gain control, and X '(s) represents the Lapp of the diaphragm displacement generated by the current audio frame after the gain control of the speaker output The Lass transform is constrained by X ′ being less than or equal to the preset displacement, and the value of α can be determined by a person of ordinary skill in the art based on experience, which is not specifically limited in the embodiments of the present application.

Optionally, in an embodiment, the electronic device may perform gain control on the current audio frame according to the following formula:

Among them, u _out (n) represents the current audio frame after gain control, u _b (n) represents the current audio frame (before gain control),

Means convolution, L ^-1 means inverse Laplace transform.

In an embodiment, when performing bass enhancement processing on the aforementioned audio signal to obtain a bass enhanced audio signal, the electronic device may perform:

The electronic device performs low-pass filtering on the aforementioned audio signal to obtain a low-pass audio signal;

Electronic equipment generates high-order harmonic signals of low-pass audio signals;

The electronic device delays the aforementioned audio signal according to the higher harmonic signal;

The electronic device superimposes the delayed audio signal and the higher harmonic signal to obtain a bass-enhanced audio signal.

Among them, the electronic device first performs low-pass filtering on the aforementioned audio signal (that is, the audio signal that needs to be output by the speaker) through a low-pass filter to obtain a low-frequency component of the aforementioned audio signal, and records it as a low-pass audio signal.

It should be noted that the low-frequency cutoff frequency of the low-pass filtering of the audio signal by the electronic device using a low-pass filter is determined according to the low-frequency cutoff frequency of the speaker. For example, the electronic device may set the low-frequency cutoff frequency for low-pass filtering to The low frequency cutoff frequency is the same.

In addition, in the embodiments of the present application, there is no specific limitation on the type of the low-pass filter, which may be a finite impulse response filter or an infinite impulse response filter.

After filtering out the low-frequency components of the aforementioned audio signal, that is, obtaining the low-pass audio signal of the audio signal, the electronic device can use the frequency domain or time domain method to generate the high-order harmonic signal of the low-pass audio signal as a virtual bass . For example, electronic equipment can generate high-order harmonic signals of low-pass audio signals through harmonic generators (non-linear devices).

It should be noted that since it takes a certain amount of time to generate a higher-order harmonic signal, it will cause the higher-order harmonic signal and the aforementioned audio signal to be out of synchronization in the time domain. Therefore, electronic devices are generating high-order harmonics of low-pass audio signals. After the wave signal, the audio signal is further delayed according to the harmonic signal, so that the harmonic signal and the audio signal are synchronized in the time domain.

After the synchronization of the higher harmonic signal and the aforementioned audio signal is completed, the electronic device superimposes the delayed aforementioned audio signal and the higher harmonic signal, because the higher harmonic signal carries the original audio signal (that is, the aforementioned needs to be Low-frequency components of the played audio signal), the resulting superimposed audio signal carries the low-frequency component of the original audio signal in the form of high frequencies, and the resulting superimposed audio signal is recorded as a bass-enhanced audio signal.

In one embodiment, before the delayed audio signal and the higher harmonic signal are superimposed to obtain a bass-enhanced audio signal, the method further includes:

The electronic device adjusts the signal strength of the higher harmonic signal to the preset signal strength.

In the embodiment of the present application, by adjusting the signal strength of the higher harmonic signal, the strength of the virtual bass can be adjusted.

It should be noted that, the value of the preset signal strength is not specifically limited in the embodiments of the present application, and can be manually set by the user or can be set by default by the electronic device.

Among them, the electronic device adjusts the signal strength of the higher harmonic signal according to the second gain coefficient, which is expressed as:

u _g (n) = gu _h (n);

u _g (n) represents the higher harmonic signal after adjusting the signal strength, g represents the second gain coefficient, and u _h (n) represents the higher harmonic signal before adjusting the signal strength. The second gain coefficient is determined by constraining the signal strength of the higher harmonic signal to a preset strength.

For example, please refer to FIG. 4, the electronic device provides a virtual bass configuration interface, the virtual bass configuration interface includes a prompt message “please turn the slider to adjust the bass level”, and an operable control, which includes a user for adjusting the bass Strong and weak slider. The electronic device is configured with a correspondence between the position of the slider and the signal strength, where the closer the slider position is to the left, the smaller the corresponding signal strength, and the closer the slider position is to the right, the greater the corresponding signal strength, according to The position of the slider and the correspondence between the position of the slider and the signal strength use the signal strength corresponding to the position of the slider indicated by the user operation as the preset signal strength that needs to be adjusted for the higher harmonic signal.

In an embodiment, after synthesizing multiple audio frames to obtain a bass-enhanced audio signal after gain control, the electronic device further executes:

The electronic device outputs the bass-enhanced audio signal after gain control through the speaker.

Based on the above description, those of ordinary skill in the art may understand that the electronic device in the embodiments of the present application performs gain control on audio frames that may cause speaker damage in the bass-enhanced audio signal. In this way, after gain control is performed through the speaker output The bass-enhanced audio signal will not damage the speaker, and the bass-enhanced audio signal after gain control retains the low-frequency components of the original audio signal, which improves playback quality.

Please refer to FIG. 5, which is a schematic structural diagram of an audio processing device according to an embodiment of the present application. The audio processing device can be applied to electronic equipment. The audio processing device 400 may include an audio acquisition module 401, a bass enhancement module 402, a displacement prediction module 403, and a gain control module 404.

The audio acquisition module 401 is used to acquire audio signals that need to be output by the speaker;

The bass enhancement module 402 is used to perform bass enhancement processing on the aforementioned audio signal to obtain a bass enhanced audio signal;

The displacement prediction module 403 is used to predict the displacement of the diaphragm generated by the speaker outputting the bass enhanced audio signal, and determine whether the predicted diaphragm displacement is greater than the preset displacement;

The gain control module 404 is used to perform gain control on the bass-enhanced audio signal if the judgment result of the displacement prediction module 403 is yes, so that the diaphragm displacement generated by the speaker-enhanced bass-enhanced audio signal after gain control is less than or equal to the preset Displacement.

In one embodiment, when predicting the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal, and determining whether the predicted diaphragm displacement is greater than the preset displacement, the displacement prediction module 403 may be used to:

Predict the displacement of the diaphragm generated by the current audio frame of the bass-enhanced audio signal output by the speaker to obtain the predicted diaphragm displacement of the current audio frame;

Determine whether the predicted diaphragm displacement of the current audio frame reaches the preset displacement;

When performing gain control on the bass-enhanced audio signal, the gain control module 404 may be used to perform gain control on the current audio frame of the bass-enhanced audio signal.

In one embodiment, before predicting the diaphragm displacement generated by the current audio frame of the bass-enhanced audio signal output by the speaker to obtain the predicted diaphragm displacement of the current audio frame, the displacement prediction module 403 may be used to:

Divide the bass enhancement audio signal into multiple audio frames;

Select one audio frame from multiple audio frames in sequence as the current audio frame.

In an embodiment, when predicting the diaphragm displacement generated by the current audio frame of the bass-enhanced audio signal output by the speaker to obtain the predicted diaphragm displacement of the current audio frame, the displacement prediction module 403 is further used to:

Determine the voltage required by the speaker to output the current audio frame;

According to the aforementioned voltage and the transfer function of the preset voltage to the diaphragm displacement, the predicted diaphragm displacement of the current audio frame is predicted.

In one embodiment, the transfer function of voltage to diaphragm displacement is obtained by the following formula:

Where H _x (s) represents the transfer function of voltage to diaphragm displacement, b represents the force factor of the speaker, L represents the inductance of the speaker's voice coil, Re represents the DC resistance of the speaker, m represents the mechanical quality of the speaker, and s represents the Lapp Las operator, Rm denotes a mechanical force resistance speaker, S _D represents the area of the speaker diaphragm, k represents the stiffness coefficient of the speaker.

In an embodiment, when performing gain control on the current audio frame of the bass-enhanced audio signal, the gain control module 404 is further used to:

Obtain a gain coefficient for controlling the diaphragm displacement generated by the speaker outputting the current audio frame according to the predicted diaphragm displacement, preset displacement, and transfer function of voltage to diaphragm displacement of the current audio frame;

Perform gain control on the current audio frame according to the aforementioned gain coefficient.

In one embodiment, the gain control module 404 performs gain control on the current audio frame according to the following formula:

Represents convolution, L ^-1 represents inverse Laplace transform, α represents gain coefficient, and H _x (s) represents the transfer function of voltage to diaphragm displacement.

In an embodiment, after the gain control module 404 performs gain control on the current audio frame, the displacement prediction module 403 may also be used to:

To determine whether the current audio frame is the last audio frame, synthesize multiple audio frames to obtain a bass-enhanced audio signal after gain control, otherwise select one audio frame from the multiple audio frames as the current audio frame again.

In an embodiment, when performing bass enhancement processing on the aforementioned audio signal to obtain a bass enhancement audio signal, the bass enhancement module 402 may be used to:

Perform low-pass filtering on the aforementioned audio signal to obtain a low-pass audio signal;

Generate high-order harmonic signals of low-pass audio signals;

Delay the aforementioned audio signal according to the higher harmonic signal;

The delayed audio signal and the higher harmonic signal are superimposed to obtain a bass-enhanced audio signal.

In one embodiment, before the delayed audio signal and the higher harmonic signal are superimposed to obtain a bass enhancement audio signal, the bass enhancement module 402 may also be used to:

Adjust the signal strength of the higher harmonic signal to the preset signal strength.

In one embodiment, the audio processing device further includes an audio output module for outputting the bass-enhanced audio signal after gain control through the speaker.

An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the stored computer program is executed on a computer, the computer is caused to perform the steps in the audio processing method provided by the embodiment of the present application.

An embodiment of the present application further provides an electronic device, including a memory, a processor, and the processor executes the steps in the audio processing method provided by the embodiment of the present application by calling a computer program stored in the memory.

Please refer to FIG. 6, which is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device may include a speaker 601, a memory 602, and a processor 603. A person of ordinary skill in the art may understand that the structure of the electronic device shown in FIG. 6 does not constitute a limitation on the electronic device, and may include more or fewer components than those illustrated, or combine certain components, or arrange different components .

The speaker 601 may output an audio signal to play sound.

The memory 602 may be used to store application programs and data. The application program stored in the memory 602 contains executable code. The application program can form various functional modules. The processor 603 executes application programs stored in the memory 602 to execute various functional applications and data processing.

The processor 603 is the control center of the electronic device, and uses various interfaces and lines to connect the various parts of the entire electronic device. Various functions and processing data, so as to carry out overall monitoring of electronic equipment.

In the embodiment of the present application, the processor 603 in the electronic device loads the executable code corresponding to the process of one or more audio processing programs into the memory 602 according to the following instructions, and the processor 603 executes the storage The application program in the memory 602, thereby executing:

Obtain the audio signal that needs to be output by the speaker;

Bass enhancement processing is performed on the aforementioned audio signal to obtain a bass enhancement audio signal;

Predict the displacement of the diaphragm generated by the speaker outputting bass enhanced audio signals, and determine whether the predicted diaphragm displacement is greater than the preset displacement;

If so, gain control is performed on the bass-enhanced audio signal so that the diaphragm displacement generated by the speaker-enhanced bass-enhanced audio signal after output gain control is less than or equal to the preset displacement.

Please refer to FIG. 7, which is another schematic structural diagram of an electronic device provided by an embodiment of the present application. The difference from the electronic device shown in FIG. 6 is that the electronic device further includes components such as an input unit 604 and an output unit 605.

The input unit 604 can be used to receive input numbers, character information, or user characteristic information (such as fingerprints), and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

The output unit 605 may be used to display information input by the user or information provided to the user, such as a screen.

Obtain the audio signal that needs to be output by the speaker;

In one embodiment, when predicting the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal, and determining whether the predicted diaphragm displacement is greater than the preset displacement, the processor 603 may execute:

When performing gain control on the bass-enhanced audio signal, the processor 603 may execute:

Gain control of the current audio frame of the bass-enhanced audio signal.

In one embodiment, before predicting the diaphragm displacement generated by the current audio frame of the bass-enhanced audio signal output by the speaker and obtaining the predicted diaphragm displacement of the current audio frame, the processor 603 may execute:

Divide the bass enhancement audio signal into multiple audio frames;

In one embodiment, when predicting the diaphragm displacement generated by the current audio frame of the speaker output bass enhanced audio signal and obtaining the predicted diaphragm displacement of the current audio frame, the processor 603 may execute:

In an embodiment, when performing gain control on the current audio frame of the bass-enhanced audio signal, the processor 603 may execute:

In an embodiment, when performing gain control on the current audio frame according to the aforementioned gain coefficient, the processor 603 may perform gain control on the current audio frame according to the following formula:

In an embodiment, after performing gain control on the current audio frame, the processor 603 may further execute:

In an embodiment, when performing bass enhancement processing on the foregoing audio signal to obtain a bass enhancement audio signal, the processor 603 may execute:

Generate high-order harmonic signals of low-pass audio signals;

Delay the aforementioned audio signal according to the higher harmonic signal;

In one embodiment, before superimposing the delayed audio signal and the higher harmonic signal to obtain a bass-enhanced audio signal, the processor 603 may execute:

In an embodiment, after performing gain control on the bass-enhanced audio signal, the processor 603 may further execute:

The bass enhanced audio signal after gain control is output through the speaker.

In the above embodiments, the description of each embodiment has its own emphasis. For a part that is not detailed in an embodiment, you can refer to the detailed description of the audio processing method above, which will not be repeated here.

The audio processing device provided by the embodiment of the present application and the audio processing method in the above embodiments belong to the same concept, and any method provided in the audio processing method embodiment can be run on the audio processing device. The method embodiments are not repeated here.

It should be noted that, for the audio processing method of the embodiment of the present application, a person of ordinary skill in the art can understand that all or part of the process of implementing the audio processing method of the embodiment of the present application can be completed by controlling related hardware through a computer program. The computer The program may be stored in a computer-readable storage medium, such as stored in a memory, and executed by at least one processor, and the execution process may include a process such as an audio processing method embodiment. Among them, the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), etc.

For the audio processing device of the embodiment of the present application, each functional module may be integrated into one processing chip, or each module may exist alone physically, or two or more modules may be integrated into one module. The above integrated modules may be implemented in the form of hardware or software function modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium, such as a read-only memory, magnetic disk, or optical disk.

The audio processing method, device, storage medium, and electronic equipment provided by the embodiments of the present application have been described in detail above. Specific examples are used in this article to explain the principles and implementations of the present invention. It is used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. It should be understood as a limitation to the present invention.

Claims

An audio processing method applied to electronic equipment, including:

Obtain the audio signal that needs to be output by the speaker;

Bass enhancement processing is performed on the audio signal to obtain a bass enhancement audio signal;

Predict the displacement of the diaphragm generated by the speaker outputting the bass-enhanced audio signal, and determine whether the predicted diaphragm displacement is greater than a preset displacement;

If yes, performing gain control on the bass-enhanced audio signal so that the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal is less than or equal to the preset displacement.
The audio processing method according to claim 1, wherein the predicting a diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal, and determining whether the predicted diaphragm displacement reaches a preset displacement includes:

Predicting the diaphragm displacement generated by the current audio frame from which the speaker outputs the bass-enhanced audio signal, to obtain the predicted diaphragm displacement of the current audio frame;

Judging whether the predicted diaphragm displacement of the current audio frame reaches the preset displacement;

The gain control of the bass-enhanced audio signal includes:

Perform gain control on the current audio frame of the bass enhanced audio signal.
The audio processing method according to claim 2, wherein the predicting the diaphragm displacement generated by the current audio frame in which the speaker outputs the bass enhancement audio signal to obtain the predicted diaphragm displacement of the current audio frame includes :

Determine the voltage required by the speaker to output the current audio frame;

The predicted diaphragm displacement of the current audio frame is predicted according to the voltage and the transfer function of the preset voltage to the diaphragm displacement.
The audio processing method according to claim 3, wherein the transfer function is obtained by the following formula:

Where H x (s) represents the transfer function, b represents the force factor of the speaker, L represents the voice coil inductance of the speaker, Re represents the DC resistance of the speaker, and m represents the mechanical quality of the speaker, s represents Laplace operator, Rm represents the speaker's machinery mechanical resistance, s D represents the area of the diaphragm of the speaker, k is the stiffness coefficient of the speaker.
The audio processing method according to claim 3, wherein the gain control of the current audio frame of the bass-enhanced audio signal includes:

Acquiring, according to the predicted diaphragm displacement of the current audio frame, the preset displacement, and the transfer function, a gain coefficient for controlling the diaphragm displacement generated by the speaker outputting the current audio frame;

Perform gain control on the current audio frame according to the gain coefficient.
The audio processing method according to claim 5, wherein the current audio frame is gain-controlled according to the following formula:

Among them, u out (n) represents the current audio frame after gain control, u b (n) represents the current audio frame,
Represents convolution, L -1 represents inverse Laplace transform, α represents the gain coefficient, and H x (s) represents the transfer function.
The audio processing method according to claim 1, wherein the bass enhancement processing is performed on the audio signal to obtain a bass enhancement audio signal, including:

Performing low-pass filtering on the audio signal to obtain a low-pass audio signal;

Generating a higher harmonic signal of the low-pass audio signal;

Delay the audio signal according to the higher harmonic signal;

Superimposing the delayed audio signal and the higher harmonic signal to obtain the bass enhanced audio signal.
The audio processing method according to claim 7, wherein the superimposing the delayed audio signal and the higher harmonic signal to obtain the bass-enhanced audio signal further comprises:

Adjusting the signal strength of the higher harmonic signal to a preset signal strength.
The audio processing method according to claim 1, wherein after performing gain control on the bass-enhanced audio signal, further comprising:

The bass-enhanced audio signal after gain control is output through the speaker.
An audio processing device applied to electronic equipment, including:

Audio acquisition module for acquiring audio signals that need to be output by the speaker;

Bass enhancement module, used to perform bass enhancement processing on the audio signal to obtain a bass enhanced audio signal;

A displacement prediction module, used to predict the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal, and determine whether the predicted diaphragm displacement is greater than a preset displacement;

The gain control module is configured to perform gain control on the bass-enhanced audio signal if the judgment result of the displacement prediction module is yes, so that the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal is less than or equal to the Preset displacement.
A storage medium having a computer program stored thereon, wherein when the computer program is executed on a computer, the computer is caused to execute the audio processing method according to any one of claims 1 to 9.
An electronic device includes a memory and a processor, wherein the processor is used to execute a computer program stored in the memory by executing:

Obtain the audio signal that needs to be output by the speaker;

Bass enhancement processing is performed on the audio signal to obtain a bass enhancement audio signal;

Predict the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal, and determine whether the predicted diaphragm displacement is greater than a preset displacement;

If yes, performing gain control on the bass-enhanced audio signal so that the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal is less than or equal to the preset displacement.
The electronic device according to claim 12, wherein, when predicting the diaphragm displacement generated by the speaker outputting the bass-enhanced audio signal, and judging whether the predicted diaphragm displacement reaches a preset displacement, the processor uses To execute:

Predicting the diaphragm displacement generated by the current audio frame from which the speaker outputs the bass-enhanced audio signal, to obtain the predicted diaphragm displacement of the current audio frame;

Judging whether the predicted diaphragm displacement of the current audio frame reaches the preset displacement;

When performing gain control on the bass-enhanced audio signal, the processor is used to execute:

Perform gain control on the current audio frame of the bass enhanced audio signal.
The electronic device according to claim 12, wherein when predicting the diaphragm displacement generated by the current audio frame in which the speaker outputs the bass-enhanced audio signal to obtain the predicted diaphragm displacement of the current audio frame, the The processor is used to perform:

Determine the voltage required by the speaker to output the current audio frame;

The predicted diaphragm displacement of the current audio frame is predicted according to the voltage and the transfer function of the preset voltage to the diaphragm displacement.
The electronic device according to claim 14, wherein the transfer function is obtained by the following formula:

Where H x (s) represents the transfer function, b represents the force factor of the speaker, L represents the voice coil inductance of the speaker, Re represents the DC resistance of the speaker, and m represents the mechanical quality of the speaker, s represents Laplace operator, Rm represents the speaker's machinery mechanical resistance, s D represents the area of the diaphragm of the speaker, k is the stiffness coefficient of the speaker.
The electronic device according to claim 14, wherein, when performing gain control on the current audio frame of the bass-enhanced audio signal, the processor is configured to execute:

Acquiring, according to the predicted diaphragm displacement of the current audio frame, the preset displacement, and the transfer function, a gain coefficient for controlling the diaphragm displacement generated by the speaker outputting the current audio frame;

Perform gain control on the current audio frame according to the gain coefficient.
The electronic device according to claim 16, wherein the current audio frame is gain-controlled according to the following formula:

Among them, u out (n) represents the current audio frame after gain control, u b (n) represents the current audio frame,
Represents convolution, L -1 represents inverse Laplace transform, α represents the gain coefficient, and H x (s) represents the transfer function.
The electronic device according to claim 12, wherein, when performing bass enhancement processing on the audio signal to obtain a bass enhancement audio signal, the processor is configured to execute:

Performing low-pass filtering on the audio signal to obtain a low-pass audio signal;

Generating a higher harmonic signal of the low-pass audio signal;

Delay the audio signal according to the higher harmonic signal;

Superimposing the delayed audio signal and the higher harmonic signal to obtain the bass enhanced audio signal.
The electronic device according to claim 18, wherein before superimposing the delayed audio signal and the higher harmonic signal to obtain the bass-enhanced audio signal, the processor is configured to execute:

Adjusting the signal strength of the higher harmonic signal to a preset signal strength.
The electronic device according to claim 12, wherein, after performing gain control on the bass-enhanced audio signal, the processor is configured to execute:

The bass-enhanced audio signal after gain control is output through the speaker.