CN117998257A - Audio processing method and device and electronic equipment - Google Patents

Audio processing method and device and electronic equipment Download PDF

Info

Publication number
CN117998257A
CN117998257A CN202211387452.0A CN202211387452A CN117998257A CN 117998257 A CN117998257 A CN 117998257A CN 202211387452 A CN202211387452 A CN 202211387452A CN 117998257 A CN117998257 A CN 117998257A
Authority
CN
China
Prior art keywords
audio signal
frequency band
processed
enhancement
specified frequency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211387452.0A
Other languages
Chinese (zh)
Inventor
练添富
李艳明
刘杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202211387452.0A priority Critical patent/CN117998257A/en
Priority to PCT/CN2023/118871 priority patent/WO2024098958A1/en
Publication of CN117998257A publication Critical patent/CN117998257A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Tone Control, Compression And Expansion, Limiting Amplitude (AREA)

Abstract

The embodiment of the application discloses an audio processing method and device and electronic equipment. The method comprises the following steps: acquiring an audio signal to be processed; acquiring an audio signal of a specified frequency band from the audio signal to be processed; acquiring the envelope amplitude of the audio signal of the specified frequency band; and carrying out enhancement processing on the signal to be processed based on the envelope amplitude value, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed. Therefore, when the audio signal of the specified frequency band is required to be enhanced aiming at the audio signal to be processed, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band beyond the specified frequency band, and the enhancement effect of the audio is further improved.

Description

Audio processing method and device and electronic equipment
Technical Field
The present application relates to the field of audio processing, and in particular, to an audio processing method, an apparatus, and an electronic device.
Background
In order to make the audio data have a better audio playing effect when being played by the audio playing device, the audio data may be processed first. But the enhancement effect of the audio data processed by the related processing mode is still to be improved.
Disclosure of Invention
In view of the above, the present application provides an audio processing method, an audio processing device, and an electronic device, so as to improve the above problem.
In a first aspect, the present application provides an audio processing method, the method comprising: acquiring an audio signal to be processed; acquiring an audio signal of a specified frequency band from the audio signal to be processed; acquiring the envelope amplitude of the audio signal of the specified frequency band; and carrying out enhancement processing on the signal to be processed based on the envelope amplitude value, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
In a second aspect, the present application provides an audio processing apparatus, the apparatus comprising: a signal acquisition unit for acquiring an audio signal to be processed; the signal filtering unit is used for acquiring an audio signal of a specified frequency band from the audio signal to be processed; an amplitude value obtaining unit, configured to obtain an envelope amplitude value of the audio signal in the specified frequency band; and the signal processing unit is used for carrying out enhancement processing on the signal to be processed based on the envelope amplitude value, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
In a third aspect, the present application provides an electronic device comprising one or more processors and a memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods described above.
In a fourth aspect, the present application provides a computer readable storage medium having program code stored therein, wherein the method described above is performed when the program code is run.
According to the audio processing method, the device and the electronic equipment, after the audio signal to be processed is acquired, the audio signal of the specified frequency band is acquired from the audio signal to be processed, then the envelope amplitude of the audio signal of the specified frequency band is acquired, and further the audio signal to be processed is subjected to enhancement processing based on the envelope amplitude so as to be used for enhancing the audio signal corresponding to the specified frequency band in the audio signal to be processed. Therefore, when the audio signal of the specified frequency band is required to be enhanced aiming at the audio signal to be processed, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band beyond the specified frequency band, and the enhancement effect of the audio is further improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of an application environment of an audio processing method according to an embodiment of the present application;
FIG. 2 is a flow chart of an audio processing method according to an embodiment of the present application;
fig. 3 is a schematic diagram of a band selection interface according to an embodiment of the present application;
Fig. 4 shows a schematic diagram of the envelope amplitude of a low frequency signal in an embodiment of the application;
FIG. 5 shows a schematic diagram of a plurality of audio frames in an embodiment of the application;
FIG. 6 is a flow chart of an audio processing method according to another embodiment of the present application;
FIG. 7 illustrates a schematic diagram of an enhancement level configuration interface in an embodiment of the present application;
FIG. 8 is a flow chart of an audio processing method according to still another embodiment of the present application;
FIG. 9 shows a schematic diagram of a plurality of enhancement filters in an embodiment of the application;
fig. 10 is a schematic diagram of an audio processing method performed by an earphone according to an embodiment of the present application;
Fig. 11 is a block diagram showing an audio processing apparatus according to an embodiment of the present application;
Fig. 12 is a block diagram showing an audio processing apparatus according to another embodiment of the present application;
fig. 13 is a memory unit for storing or carrying program codes for implementing an audio processing method according to an embodiment of the present application;
Fig. 14 shows a storage unit for storing or carrying program codes for implementing an audio processing method according to an embodiment of the present application in real time.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
In order to make the audio data have better playing effect when being played by the audio playing device, the audio data can be processed first to change some parameters of the audio data, so that the audio data with the parameters changed has more playing effect when being played. However, the inventors have found in the study that the enhancement effect of the audio data processed by the relevant processing method is still to be improved.
Therefore, the inventor proposes an audio processing method, an audio processing device and an electronic device, after an audio signal to be processed is acquired, an audio signal of a specified frequency band is acquired from the audio signal to be processed, then an envelope amplitude of the audio signal of the specified frequency band is acquired, and further enhancement processing is performed on the audio signal to be processed based on the envelope amplitude, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed. Therefore, when the audio signal of the specified frequency band is required to be enhanced aiming at the audio signal to be processed, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band beyond the specified frequency band, and the enhancement effect of the audio is further improved.
An exemplary application scenario according to an embodiment of the present application is described below.
As shown in fig. 1, an audio source device 100 and an audio playback device 200 are included in the scene shown in fig. 1. The audio source device 100 may be a mobile phone shown in fig. 1, a tablet computer, a smart watch, or other audio source devices. The audio playback device 200 may be a headphone or a speaker. For example, the audio playback device 200 may be TWS (True Wireless Stereo) headphones.
In the embodiment of the present application, both the sound source device 100 and the audio playback device 200 have audio processing capabilities. In this case, the audio processing method provided by the embodiment of the present application may be performed by the audio source device 100, may be performed by the audio playback device 200, and may be performed in cooperation by the audio source device 100 and the audio playback device 200.
In the case where the audio processing method is performed by the audio source device 100, the audio source device 100 may use the audio signal read locally as the audio signal of the to-be-processed device, or may use the audio signal acquired from the network as the audio signal to be processed. Also, after the audio processing method is performed by the audio source device 100, the audio signal after the enhancement processing may be directly played by the audio source device 100 or may be transmitted to an external device (for example, the audio playing device 200) for playing.
In the case where the audio processing method is performed by the audio playback apparatus 200, the audio playback apparatus 200 may take the audio signal transmitted from the outside as an audio signal to be processed, for example, an audio signal that is not subjected to enhancement processing and is transmitted from the sound source apparatus 100 may be taken as an audio signal to be processed. After the audio playback apparatus 200 performs the audio processing method, the enhancement-processed audio signal may be played back by the audio playback apparatus 200.
In the case where the audio processing method is cooperatively performed by the audio source device 100 and the audio playback device 200, some steps in the audio processing method provided by the embodiment of the present application may be performed by the audio source device 100, and the other steps may be performed by the audio playback device 200. For example, the audio source device 100 may first perform the acquisition of the audio signal to be processed, acquire the audio signal of the specified frequency band from the audio signal to be processed, acquire the envelope amplitude of the audio signal of the specified frequency band, then the audio source device 100 may transmit the acquired amplitude and the audio signal to be processed to the audio playing device 200 together, and then perform the enhancement processing on the signal to be processed based on the envelope amplitude by the audio playing device 200, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings.
Referring to fig. 2, an audio processing method provided by an embodiment of the present application includes:
S110: an audio signal to be processed is acquired.
In the embodiment of the present application, the audio signal may be subjected to enhancement processing before being played. In this case, an audio signal for playing may be used as the audio signal to be processed. In another case, the audio signal may be enhanced before being stored, so that the stored audio signal may be directly played without being enhanced when being played later, and thus the enhanced audio effect may be provided. In this case, the audio signal to be stored may be the audio signal to be processed.
There are also various ways to obtain the audio signal to be processed. For example, the audio signal to be processed may be acquired locally, or may be acquired through an external device or a network.
S120: and acquiring the audio signal of the specified frequency band from the audio signal to be processed.
It should be noted that, in the embodiment of the present application, although the enhancement processing is directly performed on the audio signal to be processed, the audio effect of the audio signal of the partial frequency band in the signal to be processed is actually enhanced during playing. The specified frequency band is understood as the frequency band that needs to be enhanced in the embodiment of the present application. Wherein the audio signal of the specified frequency band includes at least one of an audio signal of a low frequency band, an audio signal of an intermediate frequency band, and an audio signal of a high frequency band. For example, the specified frequency band may be a low frequency band, the specified frequency band may be a low frequency segment and an intermediate frequency band, and the specified frequency band may be a high frequency band.
In the embodiment of the application, the audio signals of a plurality of frequency bands can be flexibly enhanced, and in this case, the specific frequency band included in the designated frequency band can be determined in a plurality of ways.
As one way, the content of the specified frequency band may be manually selected by the user. In this way, the electronic device may provide a plurality of alternative frequency bands, and the user may select one or more frequency bands from the plurality of alternative frequency bands as the specified frequency band according to his own needs. For example, as shown in fig. 3, the alternative frequency bands displayed in the frequency band selection interface 10 shown in fig. 3 include a low frequency band, an intermediate frequency band, and a high frequency band, and if the electronic device detects that the low frequency band is selected, the low frequency band may be used as the designated frequency band. If the electronic equipment detects that the low frequency band and the intermediate frequency band are both selected, the low frequency band and the intermediate frequency band can be used as the designated frequency bands.
Alternatively, the electronic device may determine the frequency band specifically included in the specified frequency band by itself. In this way, the electronic device can determine the specified frequency band according to the type of music to which the audio signal to be processed belongs. Music types may include pop music, rock music, ballad, pure music, and the like, among others. The specific type of music is not particularly limited in the embodiments of the present application.
Optionally, when the electronic device is a mobile terminal, the electronic device may synchronously acquire a music type of the played music when starting to play the music in response to the operation instruction, and further acquire a frequency band to be enhanced according to the music type as the specified frequency band. Correspondingly, the audio signal corresponding to the played music is the audio signal to be processed. The correspondence between the music type and the corresponding enhancement frequency band required can be stored in the electronic device in advance, and in this case, the electronic device can acquire the frequency band required to be enhanced according to the correspondence. For example, the correspondence may include a frequency band F1 corresponding to the music type a, a frequency band F2 corresponding to the music type B, and a frequency band F3 corresponding to the music type C. In this example, if it is determined that the music genre to which the audio signal to be processed belongs is music genre B, the specified frequency band is determined to be frequency band F2.
Alternatively, in the case where the electronic device is an audio playback device, for a device that transmits an audio signal to the audio playback device, in addition to the transmission of the audio signal, the type of music to which the transmitted audio signal belongs may be transmitted to the audio playback device. In this case, the audio playback apparatus, when acquiring the audio signal to be processed, may also synchronously acquire the music type of the audio signal to be processed so as to determine the specified frequency band based on the music type
It should be noted that the audio signal to be processed may not belong to music. For example, the audio signal to be processed may also be a speech signal transmitted during a call. As a way, the electronic device may detect, after acquiring the audio signal to be processed, a scene type to which the audio signal to be processed belongs, and if the scene type of the audio signal to be processed is acquired as a music scene, determine that the audio signal to be processed belongs to music, and then start to acquire a music type to which the audio signal to be processed belongs. If the scene category to which the audio signal to be processed belongs is obtained as a call scene, the audio signal to be processed may not be subjected to enhancement processing.
Optionally, if the electronic device is a mobile terminal, the electronic device may acquire the currently running application when acquiring the audio signal to be processed, and if it is detected that the currently running application includes a call program, then it is determined that the scene type to which the audio signal to be processed belongs is a call scene. If the fact that the currently running application program does not include the call program is detected, determining that the music scene category to which the audio signal to be processed belongs is a music scene.
After the electronic device obtains the audio signal to be processed, the electronic device may obtain the audio signal with the specified frequency band from the audio signal to be processed through the filter. For example, if the determined specified frequency band is a low frequency band, a low-pass filter or a band-pass filter may be used to filter the audio signal to be processed, so as to obtain an audio signal in the low frequency band. For another example, if the determined specified frequency band is a high-frequency band, the audio signal to be processed may be filtered by using a high-pass filter to obtain the audio signal of the high-frequency band.
S130: an envelope magnitude of an audio signal of a specified frequency band is obtained.
It should be noted that, in the embodiment of the present application, the envelope may be understood as a curve of amplitude of a plurality of consecutive sampling points in the audio signal of the specified frequency band with time. And the envelope magnitude may characterize the energy intensity of the audio signal for the specified frequency band. If the envelope amplitude corresponding to the specified frequency band is larger, the user perceives the audio signal of the specified frequency band more strongly when the audio signal of the specified frequency band is played.
In the embodiment of the application, there may be various ways of acquiring the envelope amplitude of the audio signal in the specified frequency band.
As one way, the electronic device may perform envelope detection on the audio signal in the specified frequency band to obtain a corresponding envelope magnitude, and obtain the envelope magnitude of the audio signal in the specified frequency band according to the envelope magnitude. In the embodiment of the application, a plurality of modes for carrying out envelope detection can be adopted as a detection mode, and the envelope detection is completed by carrying out Hilbert transformation on the audio signal with the specified frequency band so as to obtain the corresponding envelope amplitude. Furthermore, the audio signal can be subjected to envelope detection by combining local peak detection with spline fitting so as to obtain a corresponding envelope amplitude.
For example, if the designated frequency band is a low frequency band as shown in fig. 4, the resulting envelope magnitude may be as shown in fig. 4.
The obtained envelope magnitude can be identified by the following formula:
Pe(m)＝(1.0-μ)*Pe(m-1)+μ*Pf(m)
wherein P e (m) represents the envelope magnitude, M represents a time series, μ represents a weight factor of the current frame, 0< μ <1. The current frame is understood to be the audio frame to which the signal to be processed belongs.
The envelope magnitude of the audio signal of the specified frequency band obtained according to the envelope magnitude can be understood as directly taking the envelope magnitude obtained by envelope detection as the envelope magnitude of the audio signal of the specified frequency band. For example, P e (m) calculated according to the above formula is directly taken as the envelope amplitude of the audio signal of the specified frequency band. Furthermore, the envelope magnitude obtained through the envelope detection can be compared with a reference envelope value, so that the normalization processing is carried out on the envelope magnitude obtained through the envelope detection, and the ratio is further used as the envelope magnitude of the audio signal of the specified frequency band. Illustratively, the following formula is shown:
Wherein P r represents a reference envelope value, and P is the determined envelope magnitude of the audio signal in the specified frequency band. Similarly, while the notch is the normalized envelope magnitude, the notch may still characterize the energy intensity of the audio signal in the specified frequency band.
Alternatively, the electronic device may perform fourier transform on the audio signal in the specified frequency band to obtain a corresponding frequency domain signal. And then acquiring a part belonging to the specified frequency band in the frequency domain signal, and further acquiring the envelope amplitude of the audio signal of the specified frequency band according to the part belonging to the specified frequency band.
S140: and carrying out enhancement processing on the signal to be processed based on the envelope amplitude value, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
In the embodiment of the application, the object directly processed in the enhancement processing may be an audio signal to be processed, but in practice, the enhancement processing is performed on an audio signal corresponding to a specified frequency band in the audio signal to be processed. In this case, the audio signal corresponding to the specified frequency band in the audio signal to be processed may be understood as audio signals of all frequencies included in the specified frequency band, and may also be understood as audio signals of a part of frequencies in the specified frequency band. For example, in the case where the specified frequency band is 40Hz to 80Hz, the audio signal corresponding to the specified frequency band may be understood as an audio signal having a frequency of 40Hz to 80Hz, may be understood as an audio signal having a frequency of 40Hz to 50Hz, or may be understood as an audio signal having a frequency of 50Hz to 80 Hz.
Furthermore, in the embodiment of the present application, the designated frequency band can be understood as a frequency point. In this case, the audio signal corresponding to the specified frequency band can be understood as an audio signal of the frequency point. For example, the specified frequency band is 50Hz, and then the audio signal corresponding to the specified frequency band can be understood as an audio signal having a frequency of 50 Hz.
The enhancement processing is performed on the audio signal corresponding to the specified frequency band, so that the signal energy of the audio signal corresponding to the specified frequency band can be enhanced, and further, when the audio signal corresponding to the specified frequency band is played, the user can feel stronger on the audio signal of the specified frequency band. For example, if the specified frequency band is a low frequency band, after the audio signal corresponding to the low frequency band in the signal to be processed is enhanced, the user can have stronger perception on the low frequency signal when playing the processed audio signal, so as to further enhance the hearing experience of the low frequency signal. Correspondingly, if the designated frequency band is a high-frequency band, after the audio signal corresponding to the high-frequency band in the signal to be processed is enhanced, the user can have stronger perception on the high-frequency signal when the processed audio signal is played, so that the hearing experience of the high-frequency signal is improved.
In the process of enhancing the audio signal corresponding to the specified frequency band in the audio signal to be processed based on the envelope amplitude of the audio signal of the specified frequency band, the enhancement strength may be determined based on the magnitude of the envelope amplitude of the audio signal of the specified frequency band, and then the audio signal may be enhanced according to the determined enhancement strength. The greater the intensity of the enhancement, the greater the degree of enhancement of the energy intensity of the audio signal, and thus the more pronounced the perception of the user when the audio signal is being played. In the embodiment of the application, the larger the corresponding amplitude is, the smaller the corresponding enhancement intensity is, and the smaller the corresponding amplitude is, the larger the corresponding enhancement intensity is, thereby realizing the enhancement of the audio signal dynamically. Moreover, because the enhancement strength is inversely proportional to the envelope amplitude of the audio signal of the specified frequency band, when the envelope amplitude of the audio signal of the specified frequency band is smaller, the audio signal of the specified frequency band is enhanced to a greater extent, and when the envelope amplitude of the audio signal of the specified frequency band is larger, the enhancement of the audio signal of the specified frequency band is relatively smaller, so that the listening feeling of a user to the audio signal of the specified frequency band can be kept relatively consistent, and further the user experience is further improved.
Moreover, the larger the corresponding amplitude is, the smaller the corresponding enhancement intensity is, which is also beneficial to avoiding distortion problem caused by overflow of the audio signal during playing.
It should be noted that, in the embodiment of the present application, the audio signal to be processed may be in units of frames. That is, the audio signal to be processed may be one frame. In this way, in the embodiment of the present application, enhancement processing of an audio signal can be performed frame by frame. For example, as shown in fig. 5, if the audio data to be played by the electronic device includes an audio frame F1, an audio frame F2, an audio frame F3, an audio frame F4, and an audio frame F5. When the electronic device receives the audio frame F1, the audio signal included in the audio frame F1 may be used as an audio signal to be processed, so as to perform enhancement processing on the audio signal corresponding to the specified frequency band in the audio frame F1. Then, if the electronic device receives the audio frame F2 again, the audio signal included in the audio frame F2 may be used as the audio signal to be processed, so as to perform enhancement processing on the audio signal corresponding to the specified frequency band in the audio frame F2, thereby completing enhancement processing on all the audio frames.
According to the audio processing method provided by the embodiment, after the audio signal to be processed is obtained, the audio signal of the specified frequency band is obtained from the audio signal to be processed, then the envelope amplitude of the audio signal of the specified frequency band is obtained, and further the enhancement processing is performed on the signal to be processed based on the envelope amplitude, so that the audio signal corresponding to the specified frequency band in the audio signal to be processed is enhanced. Therefore, when the audio signal of the specified frequency band is required to be enhanced aiming at the audio signal to be processed, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band beyond the specified frequency band, and the enhancement effect of the audio is further improved.
Referring to fig. 6, an audio processing method provided by an embodiment of the present application includes:
s210: an audio signal to be processed is acquired.
S220: and acquiring the audio signal of the specified frequency band from the audio signal to be processed.
S230: an envelope magnitude of an audio signal of a specified frequency band is obtained.
S240: and acquiring a corresponding first gain parameter based on the envelope amplitude, wherein the larger the envelope amplitude is, the smaller the corresponding first gain parameter is.
In this embodiment of the present application, the first gain parameter may also characterize the intensity of the enhancement. The larger the first gain parameter, the greater the corresponding enhanced intensity. As one way, a correspondence between the envelope magnitude and the first gain parameter may be stored in the electronic device. In this way, after the electronic device obtains the envelope amplitude of the audio signal of the specified frequency band, the corresponding first gain parameter may be obtained based on the envelope amplitude and the corresponding relationship. For example, the first gain parameter corresponding to the envelope magnitude A1 is coef1, the first gain parameter corresponding to the envelope magnitude A2 is coef2, the first gain parameter corresponding to the envelope magnitude A3 is coef3, and the first gain parameter corresponding to the envelope magnitude A4 is coef4. If the electronic device obtains that the envelope amplitude of the audio signal in the specified frequency band is the envelope amplitude A4, the obtained first gain parameter is coef4.
S250: and carrying out enhancement processing on the audio signals corresponding to the specified frequency band in the audio signals to be processed based on the first gain parameters.
After the first gain parameter is determined, the intensity of the sound effect enhancement may be further determined according to the determined first gain parameter.
As one way, the electronic device may perform enhancement processing on an audio signal corresponding to a specified frequency band among the audio signals to be processed through the enhancement filter. In this manner, the electronic device may determine a second gain parameter of the enhancement filter based on the first gain parameter, so as to obtain the enhancement filter with the determined gain, where the larger the first gain parameter is, the larger the corresponding determined second gain parameter is, and perform enhancement processing on an audio signal corresponding to the specified frequency band in the audio signal to be processed based on the enhancement filter with the determined second gain parameter.
It should be noted that the enhancement filter can be expressed by an equation:
during enhancement of the signal by the enhancement filter, the enhancement of the signal is typically performed according to the corresponding filter coefficients (e.g., a i and b i in the above equations) based on the above equations. That is, the filter coefficients may affect the operation of the enhancement filter. Alternatively, the enhancement filter in the embodiment of the present application may be a 2 nd-order IIR (Infinite Impulse Response) filter. Correspondingly, the filter coefficients may be represented as follows:
w0＝2*pi*f0/fs；A＝10^(cur_gain/40)；
alpha＝sin(w0)/(2*Q)；
a0＝1+alpha/A；a1＝-2*cos(w0)；a2＝1-alpha/A；
b0＝1+alpha*A；b1＝-2*cos(w0)；b2＝1-alpha*A。
Wherein f0 is the center frequency of the enhancement filter, fs is the sampling rate of the audio signal to be processed, cur_gain is the second gain parameter of the enhancement filter, and Q is the quality factor. Based on the above-mentioned filter coefficients, cur_gain in the filter coefficients may be determined according to the first gain parameter. Illustratively, taking the determined envelope magnitude of the audio signal of the specified frequency band as the level shown in the foregoing, the following table is given as an example:
ɡ cur_gain
0.0<ɡ≤α gain*coef1
α<ɡ≤β gain*coef2
β<ɡ≤к gain*coef3
к<ɡ≤θ gain*coef4
...≤1.0 gain*coefn
In the embodiment of the present application, a plurality of amplitude intervals may be established as shown in the above table, and each amplitude interval may correspond to a first gain parameter. After determining an amplitude interval corresponding to the envelope amplitude of the audio signal of the specified frequency band, the determined first gain parameter may be obtained, and then, according to cur_gain=gain coefn, the determined first gain parameter is multiplied by the initial gain of the enhancement filter, and the product is used as the second gain parameter of the enhancement filter for determining the gain.
Furthermore, in the embodiment of the present application, the enhancement strength when the audio signal is enhanced may be determined in combination with the enhancement requirement set by the user, in addition to the enhancement strength when the audio signal is enhanced based on the first gain parameter. As one way, the method provided by the embodiment of the application further includes: and obtaining a preconfigured sound effect enhancement level. In this way, the electronic device may perform enhancement processing on the audio signal corresponding to the specified frequency band among the audio signals to be processed based on the first gain parameter and the audio enhancement level.
Wherein the sound effect enhancement level may characterize the intensity of enhancement currently desired by the user. And, the sound effect enhancement level may be input by a user. Then, as a way, the electronic device may display an enhancement level configuration interface, obtain the sound enhancement level configured by the user in the enhancement level configuration interface, and store the sound enhancement level. The corresponding acquisition of the pre-configured sound enhancement level may be understood as the acquisition of the pre-stored sound enhancement level. Illustratively, as shown in FIG. 7, a switch control 21 and a level selection control 22 are displayed in the enhanced level configuration interface 20. Wherein the user can control the audio enhancement function of the electronic device through the switch control 21.
As one way, the switch control 21 may be used to control whether the electronic device enables the sound enhancement level. In this way, after the electronic device obtains the envelope amplitude of the audio signal in the specified frequency band, it can first detect whether the switch control is in an on state, if so, the electronic device can obtain the corresponding first gain parameter according to the amplitude, and synchronously obtain the sound effect enhancement level. And further, based on the first gain parameter and the sound effect enhancement level, enhancing the audio signal corresponding to the specified frequency band in the audio signal to be processed. If the switch control is in the closed state, after the electronic device obtains the envelope amplitude of the audio signal of the specified frequency band, the electronic device obtains the corresponding first gain parameter only according to the amplitude, and then directly performs enhancement processing on the audio signal corresponding to the specified frequency band in the audio signal to be processed according to the first gain parameter.
Alternatively, the switch control 21 may be used to control whether the electronic device enables sound enhancement. In this way, after the electronic device obtains the audio signal to be processed, it will first detect whether the switch control is in the on state, if so, it will further obtain the audio signal of the specified frequency band from the audio signal to be processed, so as to perform the enhancement processing of the audio signal. If the switch control is in the closed state, after the audio signal to be processed is obtained, the audio signal to be processed is directly played or stored.
Wherein the level selection control 22 is used for the user to select the enhancement level. Wherein the higher the selected enhancement level, the greater the intensity at which the final electronic device performs enhancement of the audio signal. It should be noted that, in some cases, the user may not know the actual playing effect corresponding to the selected sound effect enhancement level. The user may select the sound enhancement level most suitable for his hearing habits in order to facilitate this. The enhancement level configuration interface 20 may further be provided with a level adaptation control, and if a click operation acting on the level adaptation control is detected, the electronic device may sequentially play the audio corresponding to each sound effect enhancement level, so that the user may actually perceive an actual play effect corresponding to each sound effect enhancement level. Optionally, in the process of playing the audio by the electronic device, if a click operation acting on the level adaptation control is detected, the electronic device may store the sound effect enhancement level corresponding to the currently played audio as the sound effect enhancement level selected by the user.
Illustratively, the optional sound enhancement levels include sound enhancement level 1, sound enhancement level 2, sound enhancement level 3, sound enhancement level 4, and sound enhancement level 5. If the clicking operation on the level adaptation control is detected, the electronic equipment starts to play the audio corresponding to the sound effect enhancement level 1, so that a user can perceive how the user has hearing feeling after the sound effect enhancement level 1 is selected. After the audio corresponding to the sound effect enhancement level 1 is played, the audio corresponding to the sound effect enhancement level 2 is automatically played continuously until the audio corresponding to the sound effect enhancement level 5 is played. If a click operation acting on the level adaptation control is detected in the process of playing the audio corresponding to the sound effect enhancement level 2, the electronic device can store the sound effect enhancement level 2 as the sound effect enhancement level selected by the user.
As one way, in the case of enhancing an audio signal by an enhancement filter, enhancement processing of an audio signal corresponding to a specified frequency band among audio signals to be processed based on a first gain parameter and an audio enhancement level may include: and determining a second gain parameter of the enhancement filter based on the first gain parameter and the sound effect enhancement level to obtain the enhancement filter with the determined gain, and performing enhancement processing on the audio signal corresponding to the specified frequency band in the audio signal to be processed based on the enhancement filter with the determined gain. Wherein determining a second gain parameter of the enhancement filter based on the first gain parameter and the sound effect enhancement level comprises: the method comprises the steps of obtaining initial gain of an enhancement filter, and taking the product of the initial gain, the sound effect enhancement level and the first gain parameter as a second gain parameter of the enhancement filter. Exemplary, as shown in the following table:
in the table above, gain characterizes the initial gain of the enhancement filter. cur_gain characterizes the determined second gain parameter of the enhancement filter, wherein cur_gain=gain_level_ coefn. cur_level characterizes the currently acquired sound enhancement level. For example, if the amplitude value is determined to be less than α, the determined first gain parameter is coef1, and gain_level_coef1 may be used as the determined second gain parameter of the enhancement filter.
It should be noted that, in the embodiment of the present application, the strength of the enhancement processing of the audio signal can be determined by combining the first gain parameter and the sound effect enhancement level. In addition to determining which parameters can be specifically combined by detecting the switch control, the electronic device may determine the parameters that can be combined by other methods.
Alternatively, the electronic device may determine parameters that may be combined by the current power level. In the process of determining the intensity of the enhancement processing, if more parameters need to be combined, the more power consumption of the electronic device is. In one mode, after the electronic device obtains the envelope amplitude of the audio signal of the specified frequency band, the current electric quantity of the electronic device can be obtained first, if the current electric quantity is greater than the electric quantity threshold value, the first gain parameter and the sound effect enhancement level can be obtained synchronously, and then enhancement processing is performed on the audio signal corresponding to the specified frequency band in the audio signal to be processed based on the first gain parameter and the sound effect enhancement level. If the current electric quantity is not greater than the electric quantity threshold value, only the first gain parameter or the sound effect enhancement level can be obtained, so that enhancement processing is carried out on the audio signals corresponding to the appointed frequency band in the audio signals to be processed based on the first gain parameter or the sound effect enhancement level.
Furthermore, the electronic device may also determine whether to perform enhancement processing on the audio signal to be processed directly according to the current electric quantity. In this way, after the electronic device obtains the audio signal to be processed, it will first detect whether the current electric quantity is greater than the electric quantity threshold value, if the current electric quantity is greater than the electric quantity threshold value, it will further obtain the audio signal of the specified frequency band from the audio signal to be processed, so as to perform the subsequent enhancement processing of the audio signal. If the current electric quantity is not greater than the electric quantity threshold value, the audio signal to be processed is obtained, and then the audio signal to be processed is directly played or stored.
According to the audio processing method, when the audio signal of the specified frequency band is required to be enhanced, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band outside the specified frequency band, and the audio enhancement effect can be improved.
In this embodiment, the corresponding first gain parameter may be obtained according to the envelope amplitude of the audio signal in the specified frequency band, and then the audio signal corresponding to the specified frequency band in the audio signal to be processed may be enhanced according to the first gain parameter. And the characteristic that the first gain parameter corresponding to the larger envelope amplitude is smaller can be used for enabling the enhancement degree to be larger under the condition that the amplitude is smaller and enabling the enhancement degree to be smaller under the condition that the amplitude is larger, so that the audio signal of the specified frequency band is enhanced dynamically. Furthermore, in the embodiment, the enhancement level of the sound effect is introduced, so that the user can configure the enhancement level, and further user experience is improved.
Referring to fig. 8, an audio processing method provided in an embodiment of the present application includes:
s310: an audio signal to be processed is acquired.
S320: and acquiring the audio signal of the specified frequency band from the audio signal to be processed.
S330: an envelope magnitude of an audio signal of a specified frequency band is obtained.
S340: and determining the actual gain of each of the plurality of enhancement filters based on the envelope amplitude, wherein the center frequencies of the plurality of enhancement filters are different, the center frequencies of the plurality of enhancement filters are all in a specified frequency band, and the plurality of enhancement filters are sequentially connected in series.
As indicated above, the designated frequency band may be a frequency bin. Whereas the center frequency of the enhancement filter is usually fixed, only the audio signal of a part of the frequencies in the frequency interval may be enhanced when the audio signal corresponding to the specified frequency band is subjected to enhancement processing by the enhancement filter. Under the condition that a plurality of enhancement filters are arranged and the center frequencies of the enhancement filters are different, the frequency capable of carrying out enhancement processing is more, and further more comprehensive enhancement processing is realized.
Illustratively, as shown in fig. 9, in the case where the plurality of enhancement filters includes an enhancement filter D1, an enhancement filter D2, and an enhancement filter D3. The audio signal to be processed may be input to the enhancement filter D1 for enhancement processing, then the audio signal output by the enhancement filter D1 is input to the enhancement filter D2 for enhancement processing, and finally the audio signal output by the enhancement filter D2 is input to the enhancement filter D3 for enhancement processing, and then the audio signal output by the enhancement filter D3 is used as the processed audio signal. The processed audio signal may then be used for playback or storage.
S350: the enhancement processing is performed by a plurality of enhancement filters, wherein the enhancement filter connected in series in the front is used for performing the enhancement processing on the audio signal to be processed, and the output of the enhancement filter connected in series in the front is the input of the enhancement filter connected in series in the rear.
According to the audio processing method, when the audio signal of the specified frequency band is required to be enhanced, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band outside the specified frequency band, and the audio enhancement effect can be improved. In addition, in this embodiment, enhancement processing may be performed by using a plurality of enhancement filters together, so that the enhancement effect may be further improved.
The audio processing method provided by the embodiment of the present application is described below in an application scenario shown in fig. 10. The application scenario shown in fig. 10 includes a mobile terminal and an earphone, where the audio processing method provided by the embodiment of the present application may be executed by the earphone in fig. 10. In addition, the audio signal output by the equalizer can be used as an audio signal to be processed in the embodiment of the application, and is filtered by a low-pass filter or a band-pass filter to obtain an audio signal with a corresponding low frequency band (i.e. the designated frequency band is a low frequency band).
Referring to fig. 11, an audio processing apparatus 400 according to an embodiment of the present application, the apparatus 400 includes:
The signal acquisition unit 410 is configured to acquire an audio signal to be processed.
The signal filtering unit 420 is configured to obtain an audio signal of a specified frequency band from the audio signal to be processed.
The amplitude obtaining unit 430 is configured to obtain an envelope amplitude of the audio signal of the specified frequency band.
Wherein the audio signal of the specified frequency band comprises an audio signal of a low frequency band, an audio signal of an intermediate frequency band or an audio signal of a high frequency band.
The signal processing unit 440 is configured to perform enhancement processing on the signal to be processed based on the envelope magnitude, so as to enhance an audio signal corresponding to the specified frequency band in the audio signal to be processed.
As a way, the amplitude obtaining unit 430 is specifically configured to perform envelope detection on the audio signal in the specified frequency band to obtain a corresponding envelope amplitude; and obtaining the envelope amplitude of the audio signal of the specified frequency band according to the envelope amplitude. Optionally, the amplitude obtaining unit 430 is specifically configured to compare the envelope amplitude with a reference envelope value, and use the ratio as the envelope amplitude of the audio signal in the specified frequency band.
As one way, the signal processing unit 440 is specifically configured to obtain a corresponding first gain parameter based on the envelope magnitude, where the larger the envelope magnitude is, the smaller the corresponding first gain parameter is; and carrying out enhancement processing on the audio signals corresponding to the specified frequency band in the audio signals to be processed based on the first gain parameters. Optionally, the signal processing unit 440 is specifically configured to determine a second gain parameter of the enhancement filter based on the first gain parameter, so as to obtain the enhancement filter with a determined gain, where the larger the first gain parameter is, the larger the corresponding determined gain is; and carrying out enhancement processing on the audio signals corresponding to the specified frequency band in the audio signals to be processed based on the enhancement filter for determining the gain.
Optionally, the signal processing unit 440 is further specifically configured to obtain a preconfigured sound effect enhancement level. In this case, the signal processing unit 440 is specifically configured to perform enhancement processing on an audio signal corresponding to a specified frequency band in the audio signal to be processed based on the first gain parameter and the audio enhancement level. The signal processing unit 440 is specifically configured to determine a second gain parameter of the enhancement filter based on the first gain parameter and the sound effect enhancement level, so as to obtain the enhancement filter with the determined gain; and carrying out enhancement processing on the audio signals corresponding to the specified frequency band in the audio signals to be processed based on the enhancement filter for determining the gain. Optionally, the signal processing unit 440 is specifically configured to obtain an initial gain of the enhancement filter; taking the product of the initial gain, the sound effect enhancement level and the first gain parameter as a second gain parameter of the enhancement filter.
As one way, as shown in fig. 12, the apparatus 400 further includes: a level acquisition unit 450 for displaying an enhanced level configuration interface; and acquiring and storing the sound effect enhancement level configured in the enhancement level configuration interface by the user. In this way, the signal processing unit 440 is specifically configured to obtain a pre-stored sound effect enhancement level.
As one way, the signal processing unit 440 is specifically configured to determine the actual gains of each of the plurality of enhancement filters based on the envelope magnitude, where the center frequencies of each of the plurality of enhancement filters are different, and the center frequencies of the plurality of enhancement filters are all in a specified frequency band, and the plurality of enhancement filters are sequentially connected in series; the enhancement processing is performed by a plurality of enhancement filters, wherein the enhancement filter connected in series in the front is used for performing the enhancement processing on the audio signal to be processed, and the output of the enhancement filter connected in series in the front is the input of the enhancement filter connected in series in the rear.
As one approach, the method is applied to an audio playback device. In this way, the signal acquisition unit 410 is specifically configured to take the received audio signal as the audio signal to be processed. The signal processing unit 440 is further configured to play the audio signal after the adding process.
According to the audio processing device provided by the embodiment, after the audio signal to be processed is obtained, the audio signal of the specified frequency band is obtained from the audio signal to be processed, then the envelope amplitude of the audio signal of the specified frequency band is obtained, and further the enhancement processing is performed on the signal to be processed based on the envelope amplitude, so that the audio signal corresponding to the specified frequency band in the audio signal to be processed is enhanced. Therefore, when the audio signal of the specified frequency band is required to be enhanced aiming at the audio signal to be processed, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band beyond the specified frequency band, and the enhancement effect of the audio is further improved.
It should be noted that, in the present application, the device embodiment and the foregoing method embodiment correspond to each other, and specific principles in the device embodiment may refer to the content in the foregoing method embodiment, which is not described herein again.
Referring to fig. 13, based on the above-mentioned audio processing method and apparatus, another electronic device 200 capable of executing the above-mentioned audio processing method is provided in the embodiment of the present application. The electronic device 200 includes one or more (only one shown) processors 202, a memory 204, a network module 206, a sensor module 208, and an audio acquisition apparatus 210 coupled to one another. The memory 204 stores therein a program capable of executing the contents of the foregoing embodiments, and the processor 202 can execute the program stored in the memory 204.
Wherein the processor 202 may include one or more processing cores. The processor 202 utilizes various interfaces and lines to connect various portions of the overall electronic device 200, perform various functions of the electronic device 200, and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 204, and invoking data stored in the memory 204. Alternatively, the processor 202 may be implemented in hardware in at least one of digital signal Processing (DIGITAL SIGNAL Processing, DSP), field-Programmable gate array (Field-Programmable GATE ARRAY, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 202 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for being responsible for rendering and drawing of display content; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 202 and may be implemented solely by a single communication chip.
Memory 204 may include random access Memory (Random Access Memory, RAM) or Read-Only Memory (ROM). Memory 204 may be used to store instructions, programs, code sets, or instruction sets. The memory 204 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (e.g., a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described below, etc.
The network module 206 is configured to implement information interaction between the electronic device 200 and other devices, for example, transmitting a device control command, a manipulation request command, and a status information acquisition command. While the electronic device 200 may be embodied as a different device, its corresponding network module 206 may be different.
The sensor module 208 may include at least one sensor. Specifically, the sensor module 208 may include, but is not limited to: light sensors, motion sensors, pressure sensors, infrared thermal sensors, distance sensors, acceleration sensors, and other sensors.
Wherein the pressure sensor may detect the pressure generated by pressing against the electronic device 200. That is, the pressure sensor detects a pressure generated by contact or pressing between the user and the electronic device, for example, a pressure generated by contact or pressing between the user's ear and the mobile terminal. Thus, the pressure sensor may be used to determine whether contact or pressure has occurred between the user and the electronic device 200, as well as the magnitude of the pressure.
The acceleration sensor may detect the acceleration in each direction (typically, three axes), and may detect the gravity and direction when stationary, and may be used for applications for recognizing the gesture of the electronic device 200 (such as landscape/portrait screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer, and knocking), and so on. In addition, the electronic device 200 may further be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, etc., which will not be described herein.
The audio acquisition device 210 is used for acquiring audio signals. Optionally, the audio capturing device 210 includes a plurality of audio capturing devices. The audio acquisition device may be a microphone. For example, in one approach, the audio acquisition device 210 may include two microphones, in which one microphone may correspond to one analog-to-digital converter and the other microphone may correspond to two analog-to-digital converters of different analog gains. In another approach, the audio collection device 210 may include three microphones. In this manner, two of the microphones (e.g., the primary microphone and the secondary microphone) may each correspond to one analog-to-digital converter, and the other microphone (e.g., the camera microphone) may correspond to two analog-to-digital converters of different analog gains.
As one way, the network module of the electronic device 200 is a radio frequency module, and the radio frequency module is configured to receive and transmit electromagnetic waves, so as to implement mutual conversion between the electromagnetic waves and the electrical signals, thereby communicating with a communication network or other devices. The radio frequency module may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and the like. For example, the radio frequency module can perform information interaction with external equipment through the transmitted or received electromagnetic waves, and further receive audio signals transmitted by the external equipment.
Furthermore, the electronic device 200 may further include an image capturing device for capturing images. For example, video, still pictures or moving pictures can be taken by the image capturing device.
Referring to fig. 14, a block diagram of a computer readable storage medium according to an embodiment of the present application is shown. The computer readable medium 900 has stored therein program code which can be invoked by a processor to perform the methods described in the method embodiments described above.
The computer readable storage medium 900 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Optionally, computer readable storage medium 900 includes non-volatile computer readable media (non-transitory computer-readable storage medium). The computer readable storage medium 900 has storage space for program code 910 that performs any of the method steps described above. The program code can be read from or written to one or more computer program products. Program code 910 may be compressed, for example, in a suitable form.
In summary, after an audio signal to be processed is obtained, an audio signal of a specified frequency band is obtained from the audio signal to be processed, and then an envelope amplitude of the audio signal of the specified frequency band is obtained, and further, based on the envelope amplitude, enhancement processing is performed on the audio signal to be processed, so as to enhance an audio signal corresponding to the specified frequency band in the audio signal to be processed. Therefore, when the audio signal of the specified frequency band is required to be enhanced aiming at the audio signal to be processed, the specific enhanced strength can be determined directly based on the amplitude of the audio signal required to be enhanced, so that the enhancement processing process can be free from the influence of the signals of the frequency band beyond the specified frequency band, and the enhancement effect of the audio is further improved. In addition, in the embodiment of the application, the amplitude of the specified frequency band can be directly used as a reference for audio enhancement processing, and the method is also beneficial to reducing the calculation power so as to reduce the power consumption.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be appreciated by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not drive the essence of the corresponding technical solutions to depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (15)

1. A method of audio processing, the method comprising:
acquiring an audio signal to be processed;
Acquiring an audio signal of a specified frequency band from the audio signal to be processed;
Acquiring the envelope amplitude of the audio signal of the specified frequency band;
And carrying out enhancement processing on the signal to be processed based on the envelope amplitude value, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
2. The method according to claim 1, wherein the enhancing the to-be-processed signal based on the envelope magnitude for enhancing an audio signal corresponding to the specified frequency band among the to-be-processed audio signals includes:
acquiring a corresponding first gain parameter based on the envelope amplitude;
and carrying out enhancement processing on the to-be-processed signals based on the first gain parameters, so as to be used for enhancing the audio signals corresponding to the specified frequency band in the to-be-processed audio signals.
3. The method of claim 2, wherein the larger the envelope magnitude is, the smaller the corresponding first gain parameter is.
4. A method according to claim 3, wherein the enhancing the signal to be processed based on the first gain parameter for enhancing the audio signal corresponding to the specified frequency band in the audio signal to be processed comprises:
Determining a second gain parameter of the enhancement filter based on the first gain parameter, for determining an actual gain of the enhancement filter according to the second gain parameter, wherein the larger the first gain parameter is, the larger the corresponding determined second gain parameter is;
And carrying out enhancement processing on the signal to be processed based on an enhancement filter for determining the actual gain, wherein the enhancement filter is used for enhancing the audio signal corresponding to the specified frequency band in the audio signal to be processed.
5. The method according to claim 4, wherein the method further comprises:
Acquiring a preconfigured sound effect enhancement level;
The enhancing the signal to be processed based on the first gain parameter is used for enhancing an audio signal corresponding to the specified frequency band in the audio signal to be processed, and includes:
And carrying out enhancement processing on the signal to be processed based on the first gain parameter and the sound effect enhancement level, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
6. The method of claim 5, wherein the enhancing the signal to be processed based on the first gain parameter and the sound enhancement level for enhancing the audio signal corresponding to the specified frequency band in the audio signal to be processed comprises:
Determining a second gain parameter of the enhancement filter based on the first gain parameter and the sound effect enhancement level to obtain an enhancement filter with a determined gain;
And carrying out enhancement processing on the signal to be processed based on the enhancement filter for determining the actual gain, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
7. The method of claim 6, wherein the determining a second gain parameter of an enhancement filter based on the first gain parameter and the sound effect enhancement level comprises:
Acquiring an initial gain of the enhancement filter;
taking the product of the initial gain, the sound effect enhancement level and the first gain parameter as a second gain parameter of an enhancement filter.
8. The method of claim 5, wherein the method further comprises:
Displaying an enhancement level configuration interface;
acquiring and storing an audio enhancement level configured in the enhancement level configuration interface by a user;
The obtaining the preconfigured sound effect enhancement level comprises the following steps:
And obtaining a pre-stored sound effect enhancement level.
9. The method according to claim 1, wherein the enhancing the to-be-processed signal based on the envelope magnitude for enhancing an audio signal corresponding to the specified frequency band among the to-be-processed audio signals includes:
Determining respective actual gains of a plurality of enhancement filters based on the envelope amplitude, wherein the respective center frequencies of the enhancement filters are different, the center frequencies of the enhancement filters are all in the specified frequency band, and the enhancement filters are sequentially connected in series;
and performing enhancement processing through the plurality of enhancement filters, wherein the enhancement filter connected in series with the front is used for performing enhancement processing on the audio signal to be processed, and the output of the enhancement filter connected in series with the front is the input of the enhancement filter connected in series with the rear.
10. The method of claim 1, wherein the obtaining the envelope magnitude of the audio signal for the specified frequency band comprises:
performing envelope detection on the audio signal of the specified frequency band to obtain a corresponding envelope amplitude;
and obtaining the envelope amplitude of the audio signal of the specified frequency band according to the envelope amplitude.
11. The method of claim 10, wherein the deriving the envelope magnitude of the audio signal for the specified frequency band from the envelope magnitude comprises:
and comparing the envelope amplitude with a reference envelope value, and taking the ratio as the envelope amplitude of the audio signal of the specified frequency band.
12. The method of claim 1, wherein the audio signal of the specified frequency band comprises an audio signal of a low frequency band, an audio signal of an intermediate frequency band, or an audio signal of a high frequency band.
13. An audio processing apparatus, the apparatus comprising:
A signal acquisition unit for acquiring an audio signal to be processed;
the signal filtering unit is used for acquiring an audio signal of a specified frequency band from the audio signal to be processed;
An amplitude value obtaining unit, configured to obtain an envelope amplitude value of the audio signal in the specified frequency band;
and the signal processing unit is used for carrying out enhancement processing on the signal to be processed based on the envelope amplitude value, so as to enhance the audio signal corresponding to the specified frequency band in the audio signal to be processed.
14. An electronic device comprising one or more processors and memory;
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-12.
15. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a program code, wherein the method of any of claims 1-12 is performed when the program code is run.
CN202211387452.0A 2022-11-07 2022-11-07 Audio processing method and device and electronic equipment Pending CN117998257A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202211387452.0A CN117998257A (en) 2022-11-07 2022-11-07 Audio processing method and device and electronic equipment
PCT/CN2023/118871 WO2024098958A1 (en) 2022-11-07 2023-09-14 Audio processing method and apparatus, and electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211387452.0A CN117998257A (en) 2022-11-07 2022-11-07 Audio processing method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN117998257A true CN117998257A (en) 2024-05-07

Family

ID=90886180

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211387452.0A Pending CN117998257A (en) 2022-11-07 2022-11-07 Audio processing method and device and electronic equipment

Country Status (2)

Country Link
CN (1) CN117998257A (en)
WO (1) WO2024098958A1 (en)

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011029484A1 (en) * 2009-09-14 2011-03-17 Nokia Corporation Signal enhancement processing
US9818424B2 (en) * 2013-05-06 2017-11-14 Waves Audio Ltd. Method and apparatus for suppression of unwanted audio signals
EP3274993B1 (en) * 2015-04-23 2019-06-12 Huawei Technologies Co. Ltd. An audio signal processing apparatus for processing an input earpiece audio signal upon the basis of a microphone audio signal
CN106856623B (en) * 2017-02-20 2020-02-11 鲁睿 Baseband voice signal communication noise suppression method and system
CN113140225B (en) * 2020-01-20 2024-07-02 腾讯科技（深圳）有限公司 Voice signal processing method and device, electronic equipment and storage medium
CN111885458B (en) * 2020-07-20 2022-04-22 歌尔科技有限公司 Audio playing method, earphone and computer readable storage medium
CN113824835A (en) * 2021-10-25 2021-12-21 Oppo广东移动通信有限公司 Volume control method and device, electronic equipment and storage medium
CN115132215A (en) * 2022-06-07 2022-09-30 上海声瀚信息科技有限公司 Single-channel speech enhancement method

Also Published As

Publication number Publication date
WO2024098958A1 (en) 2024-05-16

Similar Documents

Publication Publication Date Title
CN108076226B (en) Method for adjusting call quality, mobile terminal and storage medium
CN107105367B (en) Audio signal processing method and terminal
CN113676804A (en) Active noise reduction method and device
EP3644312B1 (en) Method and apparatus for recovering audio signals
CN111161176B (en) Image processing method and device, storage medium and electronic equipment
CN113676592B (en) Recording method, recording device, electronic equipment and computer readable medium
CN109524016B (en) Audio processing method and device, electronic equipment and storage medium
US9847767B2 (en) Electronic device capable of adjusting an equalizer according to physiological condition of hearing and adjustment method thereof
CN110149517B (en) Video processing method and device, electronic equipment and computer storage medium
CN112133332B (en) Method, device and equipment for playing audio
US20180167515A1 (en) Audio signal processing based on remote user control
CN111445901A (en) Audio data acquisition method and device, electronic equipment and storage medium
CN111415673A (en) Customized audio processing based on user-specific and hardware-specific audio information
CN110602424A (en) Video processing method and electronic equipment
EP4131907A1 (en) Sound recording method and apparatus
KR20190012003A (en) Electronic device and method for adjusting gain of digital audio signal based on hearing recognition characteristics
CN117998257A (en) Audio processing method and device and electronic equipment
CN115696172B (en) Sound image calibration method and device
CN107688451A (en) The electronic installation of equalizer settings can be adjusted according to image of face identification result
CN115206278A (en) Method and device for reducing noise of sound
JP2001352594A (en) Method and device for reducing wind sound
CN109348021B (en) Mobile terminal and audio playing method
CN116349252A (en) Method and apparatus for processing binaural recordings
CN114390406A (en) Method and device for controlling displacement of loudspeaker diaphragm
CN114125735B (en) Earphone connection method and device, computer readable storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination