CN106878866B - Audio signal processing method and device and terminal - Google Patents
Audio signal processing method and device and terminal Download PDFInfo
- Publication number
- CN106878866B CN106878866B CN201710124912.3A CN201710124912A CN106878866B CN 106878866 B CN106878866 B CN 106878866B CN 201710124912 A CN201710124912 A CN 201710124912A CN 106878866 B CN106878866 B CN 106878866B
- Authority
- CN
- China
- Prior art keywords
- audio signal
- sound
- sound effect
- signal processing
- processing module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 315
- 238000003672 processing method Methods 0.000 title claims abstract description 27
- 230000000694 effects Effects 0.000 claims abstract description 134
- 238000000034 method Methods 0.000 claims abstract description 18
- 238000004458 analytical method Methods 0.000 claims description 20
- 230000008569 process Effects 0.000 claims description 10
- 230000009466 transformation Effects 0.000 claims description 6
- 230000005856 abnormality Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 12
- 230000002159 abnormal effect Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention provides an audio signal processing method, an audio signal processing device and a terminal, wherein the method comprises the following steps: the method comprises the steps of collecting audio signals played by a sound playing device, analyzing the sound effect of the sound playing device according to the audio signals, and adjusting the processing parameters of an audio signal processing module in a terminal according to the sound effect so as to correct the sound effect. In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameter corresponding to the sound source, and thus, when any sound source is played, the sound effect played by the speaker or the receiver is in the optimal state.
Description
Technical Field
The present invention relates to the field of terminal technologies, and in particular, to an audio signal processing method, an audio signal processing device, and a terminal.
Background
At present, a standard signal source is mostly used to debug an audio playing module of a mobile terminal, and after an ideal sound effect is debugged, a processing parameter of the audio playing module corresponding to the ideal sound effect is used as a fixed processing parameter of the mobile terminal.
When the mobile terminal plays the audio each time, the mobile terminal adjusts the audio emitted by the sound source based on the fixed processing parameter, so that the played audio has better effect. However, in practical applications, the sound sources played by the mobile terminal are usually random, some sound sources are greatly different from the standard signal source, and the mobile terminal still processes the audio emitted by the sound sources according to the fixed processing parameters, so that the sound effect after playing is poor.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, a first objective of the present invention is to provide an audio signal processing method to dynamically adjust processing parameters of an audio signal processing module of a mobile terminal, so as to solve the problem in the prior art that when a sound source difference is large, sound effects after playing are poor when audio is processed based on fixed processing parameters.
A second object of the invention is to propose an audio signal processing device.
A third object of the present invention is to provide a terminal.
To achieve the above object, an embodiment of a first aspect of the present invention provides an audio signal processing method, including:
collecting audio signals played by a sound playing device;
analyzing the sound effect of the sound playing device according to the audio signal;
and adjusting the processing parameters of an audio signal processing module in the terminal according to the sound effect so as to correct the sound effect.
According to the audio signal processing method provided by the embodiment of the invention, the processing parameters in the audio processing module can be automatically adjusted according to the sound effect played by the loudspeaker or the receiver, so that each sound source has the optimal processing parameters corresponding to the sound source, and the sound effect played by the loudspeaker or the receiver is in the optimal state when any sound source is played.
In addition, the audio signal processing method of the embodiment of the present invention further has the following additional technical features:
in an embodiment of the present invention, the analyzing the sound effect of the sound playing apparatus according to the audio signal includes:
performing fast Fourier transform on the audio signal to obtain a spectrogram of the audio signal;
extracting high-frequency components and low-frequency components of the audio signal from the spectrogram;
determining that the sound effect is a high-low frequency imbalance of sound if the high frequency component is unbalanced with the low frequency component.
In an embodiment of the present invention, the adjusting a processing parameter of an audio signal processing module in a terminal according to the sound effect to modify the sound effect includes:
and adjusting filter parameters of a digital filter in the audio signal processing module so as to enable the high-frequency component and the low-frequency component carried in the subsequently played audio signal to be in an equilibrium state.
In an embodiment of the present invention, the analyzing the sound effect of the sound playing apparatus according to the audio signal includes:
acquiring the amplitude of the audio signal;
comparing the amplitude with a preset threshold range;
if the amplitude is not within the threshold range, determining that the sound effect is a volume anomaly of sound.
In an embodiment of the present invention, the dynamically adjusting the processing parameter of the audio signal processing module in the terminal according to the sound effect includes:
adjusting the gain of an amplifier in the audio signal processing module so that the amplitude of the audio signal played subsequently is within the threshold range.
In an embodiment of the present invention, after adjusting a processing parameter of an audio signal processing module in a terminal according to the sound effect to correct the sound effect, the method includes:
processing the audio signal emitted by the sound source based on the adjusted audio signal processing module;
and playing the processed audio signal through the sound playing device.
In an embodiment of the present invention, the collecting the audio signal played by the sound playing apparatus includes:
and collecting the audio signal played by the sound playing device through a microphone on the terminal.
To achieve the above object, a second embodiment of the present invention provides an audio signal processing apparatus, including:
the acquisition module is used for acquiring the audio signal played by the sound playing device;
the analysis module is used for analyzing the sound effect of the sound playing device according to the audio signal;
and the parameter adjusting module is used for adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect so as to correct the sound effect.
The audio signal processing device provided by the embodiment of the invention can automatically adjust the processing parameters in the audio processing module according to the sound effect played by the loudspeaker or the receiver, so that each sound source has the optimal processing parameter corresponding to the sound source, and the sound effect played by the loudspeaker or the receiver is in the optimal state when any sound source is played.
In addition, the audio signal processing apparatus according to the embodiment of the present invention further has the following additional technical features:
in one embodiment of the present invention, the analysis module includes:
the transformation unit is used for carrying out fast Fourier transformation on the audio signal to obtain a spectrogram of the audio signal;
an extracting unit configured to extract a high frequency component and a low frequency component of the audio signal from the spectrogram;
a first determining unit for determining that the sound effect is a high-low frequency imbalance of sound if the high frequency component is unbalanced with the low frequency component.
In an embodiment of the present invention, the parameter adjusting module is specifically configured to adjust filter parameters of a digital filter in the audio signal processing module, so that the high frequency component and the low frequency component carried in the subsequently played audio signal are in an equilibrium state.
In one embodiment of the present invention, the analysis module includes:
an amplitude acquisition unit configured to acquire an amplitude of the audio signal;
the comparison unit is used for comparing the amplitude with a preset threshold range;
a second determining unit, configured to determine that the sound effect is a volume abnormality of sound if the amplitude is not within the threshold range.
In an embodiment of the present invention, the parameter adjusting module is specifically configured to adjust a gain of an amplifier in the audio signal processing module, so that an amplitude of the audio signal played subsequently is within the threshold range.
In one embodiment of the invention, the apparatus further comprises:
the processing module is used for processing the audio signal emitted by the sound source based on the adjusted audio signal processing module;
and the playing module is used for playing the processed audio signal through the sound playing device.
In an embodiment of the present invention, the collection module is specifically configured to collect, by a microphone on the terminal, an audio signal played by the sound playing device.
To achieve the above object, an embodiment of a third aspect of the present invention provides another terminal, including:
a housing and a processor, a memory, a microphone and a sound playing device located in the housing, wherein the processor runs a program corresponding to an executable program code stored in the memory by reading the executable program code for performing the steps of:
collecting audio signals played by a sound playing device;
analyzing the sound effect of the sound playing device according to the audio signal;
and adjusting the processing parameters of an audio signal processing module in the terminal according to the sound effect so as to correct the sound effect.
The terminal of the embodiment of the invention can automatically adjust the processing parameters in the audio processing module according to the sound effect played by the loudspeaker or the receiver, so that each sound source has the optimal processing parameters corresponding to the sound source, and the sound effect played by the loudspeaker or the receiver is in the optimal state when any sound source is played.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart illustrating an audio signal processing method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another audio signal processing method according to an embodiment of the present invention;
FIG. 3 is a flow chart of another audio signal processing method according to an embodiment of the present invention;
fig. 4 is a schematic diagram illustrating an application of an audio signal processing method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an audio signal processing apparatus according to an embodiment of the present invention;
FIG. 6 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the present invention;
FIG. 7 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
An audio signal processing method, apparatus, and terminal according to embodiments of the present invention are described below with reference to the accompanying drawings.
Fig. 1 is a flowchart illustrating an audio signal processing method according to an embodiment of the present invention. The audio signal processing method of the embodiment of the invention can be applied to various devices or terminal equipment, such as a tablet computer, a notebook computer, a personal computer, a smart phone and the like. As shown in fig. 1, the audio signal processing method includes the steps of:
s101, collecting audio signals played by the sound playing device.
The user can carry out voice call, video chat or playing of audio and video files based on the terminal. After the terminal acquires the sound source, the audio signal emitted by the sound source can be acquired, and the audio signal emitted by the sound source is processed through the audio signal processing module in the terminal and then can be played through sound playing devices such as a receiver or a loudspeaker. In this embodiment, the audio signal played by the sound playing device may be collected, for example, the audio signal played by the sound playing device may be collected by a microphone.
And S102, analyzing the sound effect of the sound playing device according to the audio signal.
After the audio signal played by the sound playing device is collected, the audio signal may be analyzed, for example, features such as frequency and/or amplitude of the audio signal may be extracted, and a sound effect of the sound playing device may be determined according to the extracted features such as frequency and/or amplitude. The sound effect may include that the high and low frequencies of the played sound are in an unbalanced state, for example, the played sound effect is a harsh howling sound, or the played sound effect is a muffled sound, so that the user cannot hear the information carried by the sound, or the volume of the played sound is abnormal, for example, the sound is small or large.
S103, adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect so as to correct the sound effect.
After the sound effect is obtained, the processing parameters of the audio signal processing module in the terminal can be dynamically adjusted according to the sound effect, and then the sound effect is corrected by using the adjusted processing parameters. The processing parameters of the audio signal processing module are corresponding to the ideal sound effect played after debugging based on the standard signal source at the initial moment.
For example, if the sound effect is unbalanced in high and low frequencies, if the high frequency component is large, the cut-off frequency of the digital filter in the audio signal processing module may be lowered, the bandwidth of the digital filter may be reduced, and the high frequency component in the audio signal may be suppressed, that is, the sound effect of unbalanced high and low frequencies currently played may be corrected, so that the sound effect of subsequent playing may be balanced in high and low frequencies.
For another example, if the sound effect is abnormal volume, if the volume is large, the gain in the audio signal processing module may be reduced, so that the signal of the audio signal output by the audio signal processing module is reduced to a low level, so as to achieve the purpose of suppressing the volume, that is, the sound effect with abnormal volume played at present is corrected, so that the volume of the sound effect played subsequently is within a normal range.
According to the audio signal processing method provided by the embodiment of the invention, the audio signal played by the sound playing device is collected, the sound effect of the sound playing device is analyzed according to the audio signal, and the processing parameter of the audio signal processing module in the terminal is adjusted according to the sound effect so as to correct the sound effect. In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameter corresponding to the sound source, and thus, when any sound source is played, the sound effect played by the speaker or the receiver is in the optimal state.
Fig. 2 is a flowchart illustrating another audio signal processing method according to an embodiment of the present invention. As shown in fig. 2, the audio signal processing method includes the steps of:
s201, collecting audio signals played by the sound playing device.
Specifically, the audio signal played by a sound playing device such as a receiver or a speaker can be collected by a microphone or a sound pickup device on the terminal.
S202, performing fast Fourier transform on the audio signal to obtain a spectrogram of the audio signal.
After the audio signals played by the receiver or the loudspeaker are collected, the audio signals can be subjected to characteristic analysis, the frequency characteristics of the audio signals are extracted from the audio signals, and high-frequency components and low-frequency components carried in the audio signals can be obtained. Specifically, a Fast Fourier Transform (FFT) may be used to perform spectrum analysis on the acquired audio signal, so as to obtain a spectrogram of the audio signal. The horizontal coordinate of the spectrogram is time corresponding to the audio signal, the vertical coordinate of the spectrogram is frequency components contained in the audio signal, and the coordinate point value of the spectrogram is an energy value of the audio signal.
And S203, extracting high-frequency components and low-frequency components of the audio signal from the spectrogram.
Specifically, high-frequency components and low-frequency components carried by the audio signal may be extracted from the spectrogram. Generally, the high frequency band is a frequency band above 800hz, and the low frequency band has a frequency range of 20hz-800 hz. After the spectrogram of the audio signal is obtained, the energy on each frequency point exceeding 800hz can be counted to obtain the high-frequency component carried by the audio signal, and further, the energy on each frequency point of 20hz to 800hz can be counted to obtain the low-frequency component carried by the audio signal.
And S204, if the high-frequency component and the low-frequency component are unbalanced, determining that the sound effect is the high-frequency and low-frequency unbalance of the sound.
In practical applications, in order to ensure the quality or effect of the played sound, the ratio between the high frequency component and the low frequency component in the audio signal is usually preset to be 1: 1. When the ratio of the high-frequency components is 1:1, the high-frequency components and the low-frequency components carried in the audio signal are in an equilibrium state, and the played sound effect is optimal. If the ratio between the high frequency component and the low frequency component is not 1:1, it indicates that the collected played audio signal is in high-low frequency imbalance. For example, when the high frequency component is large, the sound effect to be played is a harsh sound, and when the low frequency component is large, the acoustic effect to be played is a dull sound, and the user may not be able to acquire actual information from the sound.
S205, adjusting filter parameters of a digital filter in the audio signal processing module to enable high-frequency components and low-frequency components carried in subsequently played audio signals to be in a balanced state.
When the high and low frequency components carried by the audio signal are unbalanced, the filter parameters of the digital filter in the audio signal processing module, such as the cut-off frequency, the bandwidth, etc., of the digital filter, need to be adjusted. When the high frequency component carried in the audio signal is large, the digital filter may be adjusted to attenuate the high frequency component by the digital filter. When the audio signal carries less high frequency components, the digital filter can be adjusted to raise the high frequency components by the digital filter. After adjustment, high and low frequency components carried in the audio signal played by a receiver or a loudspeaker are in an equilibrium state.
And S206, processing the audio signal emitted by the sound source based on the adjusted audio signal processing module.
The sound source continuously sends out audio signals, and the sent audio signals need to continuously enter the audio signal processing module for processing and then can be input into the receiver or the loudspeaker for playing. After the audio signal enters the audio signal processing module, the audio signal processing module may process the subsequent incoming audio signal based on the adjusted processing parameter. Generally, the characteristics of the audio signals emitted by the same sound source are stable, and when the adjusted audio signal processing module is used for processing the audio signals emitted by the sound source subsequently, the processed audio signals can basically overcome the problem of high-low frequency unbalance, so that the played sound effect is better.
And S207, playing the processed audio signal through a sound playing device.
In this embodiment, after the audio signal processing module processes the audio signal emitted by the sound source, the processed audio signal can be played through the receiver or the speaker.
In this embodiment, collect the audio signal that sound playback devices such as speaker or receiver broadcast, then analyze audio signal's frequency characteristic, when the high low frequency component that audio signal carried is unbalanced, can lead to the high low frequency unbalance of the sound that broadcasts, the sound effect of broadcast is relatively poor, in order to make high low frequency component balanced, adjust the filter parameter of digital filter in the audio signal processing module, can handle the audio signal that follow-up sound source sent based on the processing parameter after the adjustment, sound effect preferred when guaranteeing that the audio signal after the processing is broadcast by speaker or receiver, thereby can overcome the problem that the sound effect that broadcasts before has high low frequency unbalance.
Fig. 3 is a flowchart illustrating another audio signal processing method according to an embodiment of the invention. As shown in fig. 3, the audio signal processing method includes:
s301, collecting the audio signal played by the sound playing device.
S302, obtaining the amplitude of the audio signal.
In particular, the signal strength of the audio signal, i.e. the amplitude of the audio signal, is lifted from the audio signal.
And S303, comparing the amplitude with a preset threshold range.
S304, if the amplitude is not in the threshold range, determining that the sound effect is abnormal volume of the sound.
In this embodiment, a threshold range may be preset, and the threshold range may include an upper threshold and a lower threshold. After the amplitude of the audio signal is obtained, the amplitude of the audio signal may be compared with a threshold range, and if the amplitude exceeds the threshold range, that is, the amplitude is greater than an upper threshold or the amplitude is less than a lower threshold, it indicates that the played sound has an abnormal volume.
S305, adjusting the gain of an amplifier in the audio signal processing module so that the amplitude of the audio signal played subsequently is within a threshold range.
Specifically, the gain of the amplifier in the audio signal processing module may be adjusted according to the specific situation of the abnormal volume. If the volume is abnormal, the gain of an amplifier in the audio signal processing module is increased, so that the sound of the audio signal played subsequently is increased, the amplitude of the audio signal exceeds a lower threshold value, and the audio signal falls into the threshold value range. If the volume is abnormal and the sound is larger, the gain of an amplifier in the audio signal processing module is reduced, the sound of the audio signal played subsequently is reduced, and the amplitude of the audio signal is lower than the upper limit threshold and falls into the threshold range.
And S306, processing the audio signal emitted by the sound source based on the adjusted audio signal processing module.
And S307, playing the processed audio signal through a sound playing device.
For the related descriptions of S306 to S307, reference may be made to the descriptions of the related contents in the above embodiments, and the description is not repeated here.
In this embodiment, collect the audio signal that sound play devices such as speaker or receiver broadcast, extract audio signal's amplitude, when audio signal's amplitude is not in predetermined threshold range, can lead to the sound volume of broadcasting to be unusual, the sound effect of broadcast is relatively poor, when the volume is unusual, can adjust the gain of the amplifier in the audio signal processing module, the audio signal who sends follow-up sound source is handled based on the processing parameter after the adjustment, sound effect preferred when guaranteeing that the audio signal after the processing is broadcast by speaker or receiver, thereby can overcome the problem that the sound effect of broadcast before has high low frequency unbalance.
In practice, the played sound effect may be determined according to the frequency and/or amplitude of the captured audio signal. For example, when the sound effect is poor according to one of the frequency and the amplitude of the audio signal, the processing parameters of the audio signal processing module can be processed. When the sound effect is analyzed, the frequency and the amplitude of the audio signal possibly cause poor sound effect, and the digital filter and the amplifier of the audio signal processing module can be adjusted simultaneously. The present invention is not limited to the examples provided.
Fig. 4 is a schematic application diagram of an audio signal processing method according to an embodiment of the present invention. As shown in fig. 4, the sound source emits an audio signal, the audio signal can enter an audio signal processing module on the terminal after being decoded, and the audio signal processing module can be a speech signal processing module, and can also be a music signal processing module, which can be specifically selected according to the difference of the sound source.
The unit for Processing the Digital audio Signal in the audio Processing module may be integrated in a Digital Signal Processing (DSP) chip. For example, convolution, a digital filter, a Programmable Gain Amplifier (PGA) and a multi-stage dynamic compressor in the audio signal processing module may be integrated in the DSP chip. The digital audio signal generated by the audio signal from the sound source after decoding can be convolved, filtered and multi-section dynamically compressed in the audio signal processing module, then is subjected to digital-to-analog conversion by a digital-to-analog converter, and then is input into a speaker for playing through a Power Amplifier (PA for short).
Furthermore, a microphone arranged near the loudspeaker can collect the sound played by the loudspeaker, and the sound enters the DSP chip after being amplified by the PGA and then subjected to analog-to-digital conversion by the analog-to-digital converter. The DSP chip can be provided with a sound effect analysis module, and the sound effect analysis module can analyze the sound effect of the collected audio signals and then adjust the processing parameters of the audio signal processing module according to the sound effect.
For example, the sound effect analysis module may be provided with an FFT unit, and the FFT unit analyzes high and low frequency components of the collected audio signal, thereby adjusting filter parameters of a digital filter in the audio signal processing module.
For another example, the sound effect analysis module may further include an amplitude comparison unit, where the amplitude comparison unit analyzes whether the sound volume of the collected audio signal is abnormal, and further adjusts the gain of the amplifier in the audio signal processing module.
In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameter corresponding to the sound source, and thus, when any sound source is played, the sound effect played by the speaker or the receiver is in the optimal state.
Fig. 5 is a schematic structural diagram of an audio signal processing apparatus according to an embodiment of the present invention. As shown in fig. 5, the audio signal processing apparatus includes: the system comprises an acquisition module 11, an analysis module 12 and a parameter adjusting module 13.
The collecting module 11 is configured to collect an audio signal played by the sound playing device.
And the analysis module 12 is configured to analyze a sound effect of the sound playing apparatus according to the audio signal.
And the parameter adjusting module 13 is configured to adjust a processing parameter of an audio signal processing module in the terminal according to the sound effect, so as to correct the sound effect.
In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameter corresponding to the sound source, and thus, when any sound source is played, the sound effect played by the speaker or the receiver is in the optimal state.
Fig. 6 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the present invention. As shown in fig. 6, the audio signal processing apparatus includes the acquisition module 11, the analysis module 12, and the parameter adjustment module 13 in the above embodiments.
Optionally, one possible structure manner of the analysis module 12 includes: a transformation unit 121, an extraction unit 122, and a first determination unit 123.
The transforming unit 121 is configured to perform fast fourier transform on the audio signal to obtain a spectrogram of the audio signal.
An extracting unit 122, configured to extract a high frequency component and a low frequency component of the audio signal from the spectrogram.
A first determining unit 123 for determining that the sound effect is a high-low frequency imbalance of sound if the high frequency component is unbalanced with the low frequency component.
Further, the parameter adjusting module 13 is specifically configured to adjust filter parameters of a digital filter in the audio signal processing module, so that the high-frequency component and the low-frequency component carried in the subsequently played audio signal are in an equilibrium state.
In this embodiment, collect the audio signal that sound playback devices such as speaker or receiver broadcast, then analyze audio signal's frequency characteristic, when the high low frequency component that audio signal carried is unbalanced, can lead to the high low frequency unbalance of the sound that broadcasts, the sound effect of broadcast is relatively poor, in order to make high low frequency component balanced, adjust the filter parameter of digital filter in the audio signal processing module, can handle the audio signal that follow-up sound source sent based on the processing parameter after the adjustment, sound effect preferred when guaranteeing that the audio signal after the processing is broadcast by speaker or receiver, thereby can overcome the problem that the sound effect that broadcasts before has high low frequency unbalance.
Fig. 7 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the present invention. As shown in fig. 7, the audio signal processing apparatus includes the acquisition module 11, the analysis module 12, and the parameter adjustment module 13 in the above embodiment.
Optionally, one possible structure manner of the analysis module 12 includes: an amplitude acquisition unit 124, a comparison unit 125, and a second determination unit 126.
An amplitude obtaining unit 124 for obtaining the amplitude of the audio signal.
A comparing unit 125, configured to compare the amplitude with a preset threshold range.
A second determining unit 126, configured to determine that the sound effect is a volume abnormality of sound if the amplitude is not within the threshold range.
Further, the parameter adjusting module 13 is specifically configured to adjust a gain of an amplifier in the audio signal processing module, so that an amplitude of the audio signal played subsequently is within the threshold range.
In this embodiment, collect the audio signal that sound play devices such as speaker or receiver broadcast, extract audio signal's amplitude, when audio signal's amplitude is not in predetermined threshold range, can lead to the sound volume of broadcasting to be unusual, the sound effect of broadcast is relatively poor, when the volume is unusual, can adjust the gain of the amplifier in the audio signal processing module, the audio signal who sends follow-up sound source is handled based on the processing parameter after the adjustment, sound effect preferred when guaranteeing that the audio signal after the processing is broadcast by speaker or receiver, thereby can overcome the problem that the sound effect of broadcast before has high low frequency unbalance.
Fig. 8 is a schematic structural diagram of another audio signal processing apparatus according to an embodiment of the present invention. As shown in fig. 6, the audio signal processing apparatus includes the acquisition module 11, the analysis module 12, and the parameter adjustment module 13 in the above embodiment, and further includes: a processing module 14 and a playing module 15.
In practice, the played sound effect may be determined according to the frequency and/or amplitude of the captured audio signal. The analysis module 12 in this embodiment may include: the transformation unit 121, the extraction unit 122, the first determination unit 123, the amplitude acquisition unit 124, the comparison unit 125, and the second determination unit 126 in the above-described embodiments.
The analysis module 12 provided by the present embodiment can implement the frequency and/or amplitude of the collected audio signal to determine the purpose of the played sound effect. For a specific process, reference may be made to the descriptions of related contents in the above embodiments, which are not described herein again.
And the processing module 14 is configured to process the audio signal emitted by the sound source based on the adjusted audio signal processing module.
And the playing module 15 is configured to play the processed audio signal through the sound playing device.
Further, the collecting module 11 is specifically configured to collect, by a microphone on the terminal, the audio signal played by the sound playing device.
In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameter corresponding to the sound source, and thus, when any sound source is played, the sound effect played by the speaker or the receiver is in the optimal state.
Fig. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present invention. As shown in fig. 5, the terminal device includes one or more of the following components: the housing 21 and the processor 211, the memory 212, the microphone 213 and the speaker 214 or the receiver 215 are located within the housing 21.
Wherein, the processor 211 runs a program corresponding to the executable program code by reading the executable program code stored in the memory 212, for executing the following steps:
collecting audio signals played by a sound playing device; the sound playing device may be the speaker 214 or the receiver 215. Specifically, an audio signal played by the speaker 214 or the receiver 215 can be collected by the microphone 213.
And analyzing the sound effect of the sound playing device according to the audio signal.
And adjusting the processing parameters of an audio signal processing module in the terminal according to the sound effect so as to correct the sound effect.
In this embodiment, the processing parameters inside the audio processing module can be automatically adjusted according to the sound effect played by the speaker or the receiver, so that each sound source has the optimal processing parameter corresponding to the sound source, and thus, when any sound source is played, the sound effect played by the speaker or the receiver is in the optimal state.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (11)
1. An audio signal processing method, comprising:
collecting audio signals played by a sound playing device;
analyzing the sound effect of the sound playing device according to the audio signal;
adjusting processing parameters of an audio signal processing module in the terminal according to the sound effect so as to correct the sound effect;
the analyzing the sound effect of the sound playing device according to the audio signal includes:
performing fast Fourier transform on the audio signal to obtain a spectrogram of the audio signal;
extracting high-frequency components and low-frequency components of the audio signal from the spectrogram;
determining that the sound effect is a high-low frequency imbalance of sound if the high frequency component is unbalanced with the low frequency component;
the horizontal coordinate of the spectrogram is time corresponding to an audio signal, the vertical coordinate of the spectrogram is frequency components contained in the audio signal, the coordinate point value of the spectrogram is an energy value of the audio signal, and the energy values corresponding to the frequency points are counted to extract high-frequency components and low-frequency components of the audio signal from the spectrogram;
after the terminal acquires a sound source, acquiring an audio signal emitted by the sound source, acquiring the audio signal played by the sound playing device through a microphone on the terminal, and after the processing parameter of an audio signal processing module in the terminal is adjusted according to the sound effect to correct the sound effect, enabling the audio signal processing module to process the subsequent audio signal entering the audio signal processing module based on the adjusted processing parameter.
2. The audio signal processing method of claim 1, wherein the adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect to modify the sound effect comprises:
and adjusting filter parameters of a digital filter in the audio signal processing module so as to enable the high-frequency component and the low-frequency component carried in the subsequently played audio signal to be in an equilibrium state.
3. The audio signal processing method of claim 1, wherein the analyzing the sound effect of the sound playing apparatus according to the audio signal comprises:
acquiring the amplitude of the audio signal;
comparing the amplitude with a preset threshold range;
if the amplitude is not within the threshold range, determining that the sound effect is a volume anomaly of sound.
4. The audio signal processing method according to claim 3, wherein the adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect to modify the sound effect comprises:
adjusting the gain of an amplifier in the audio signal processing module so that the amplitude of the audio signal played subsequently is within the threshold range.
5. The audio signal processing method according to claim 2 or 4, wherein the adjusting the processing parameters of the audio signal processing module in the terminal according to the sound effect to modify the sound effect comprises:
processing the audio signal emitted by the sound source based on the adjusted audio signal processing module;
and playing the processed audio signal through the sound playing device.
6. An audio signal processing apparatus, comprising:
the acquisition module is used for acquiring the audio signal played by the sound playing device;
the analysis module is used for analyzing the sound effect of the sound playing device according to the audio signal;
the parameter adjusting module is used for adjusting the processing parameters of an audio signal processing module in the terminal according to the sound effect so as to correct the sound effect;
the analysis module comprises:
the transformation unit is used for carrying out fast Fourier transformation on the audio signal to obtain a spectrogram of the audio signal;
an extracting unit configured to extract a high frequency component and a low frequency component of the audio signal from the spectrogram;
a first determining unit for determining that the sound effect is a high-low frequency imbalance of sound if the high frequency component is unbalanced with the low frequency component;
the horizontal coordinate of the spectrogram is time corresponding to an audio signal, the vertical coordinate of the spectrogram is frequency components contained in the audio signal, the coordinate point value of the spectrogram is an energy value of the audio signal, and the energy values corresponding to the frequency points are counted to extract high-frequency components and low-frequency components of the audio signal from the spectrogram;
after the terminal acquires a sound source, acquiring an audio signal emitted by the sound source, enabling the acquisition module to acquire the audio signal played by the sound playing device through a microphone on the terminal, and after the sound effect is corrected by adjusting the processing parameters of an audio signal processing module in the terminal according to the sound effect, enabling the audio signal processing module to process the subsequent audio signal entering the audio signal processing module based on the adjusted processing parameters.
7. The audio signal processing apparatus according to claim 6, wherein the parameter adjusting module is specifically configured to adjust filter parameters of a digital filter in the audio signal processing module, so that the high frequency component and the low frequency component carried in the subsequently played audio signal are in an equilibrium state.
8. The audio signal processing apparatus of claim 7, wherein the analysis module comprises:
an amplitude acquisition unit configured to acquire an amplitude of the audio signal;
the comparison unit is used for comparing the amplitude with a preset threshold range;
a second determining unit, configured to determine that the sound effect is a volume abnormality of sound if the amplitude is not within the threshold range.
9. The audio signal processing apparatus of claim 8, wherein the parameter adjusting module is specifically configured to adjust a gain of an amplifier in the audio signal processing module, so that an amplitude of the audio signal played subsequently is within the threshold range.
10. The audio signal processing apparatus according to claim 7 or 9, further comprising:
the processing module is used for processing the audio signal emitted by the sound source based on the adjusted audio signal processing module;
and the playing module is used for playing the processed audio signal through the sound playing device.
11. A terminal, comprising: a housing and a processor, a memory, a microphone and a sound playing device located in the housing, wherein the processor runs a program corresponding to an executable program code stored in the memory by reading the executable program code for performing the steps of:
collecting audio signals played by a sound playing device;
analyzing the sound effect of the sound playing device according to the audio signal;
adjusting processing parameters of an audio signal processing module in the terminal according to the sound effect so as to correct the sound effect;
the analyzing the sound effect of the sound playing device according to the audio signal includes:
performing fast Fourier transform on the audio signal to obtain a spectrogram of the audio signal;
extracting high-frequency components and low-frequency components of the audio signal from the spectrogram;
determining that the sound effect is a high-low frequency imbalance of sound if the high frequency component is unbalanced with the low frequency component;
the horizontal coordinate of the spectrogram is time corresponding to an audio signal, the vertical coordinate of the spectrogram is frequency components contained in the audio signal, the coordinate point value of the spectrogram is an energy value of the audio signal, and the energy values corresponding to the frequency points are counted to extract high-frequency components and low-frequency components of the audio signal from the spectrogram;
after the terminal acquires a sound source, acquiring an audio signal emitted by the sound source, acquiring the audio signal played by the sound playing device through a microphone on the terminal, and after the processing parameter of an audio signal processing module in the terminal is adjusted according to the sound effect to correct the sound effect, enabling the audio signal processing module to process the subsequent audio signal entering the audio signal processing module based on the adjusted processing parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710124912.3A CN106878866B (en) | 2017-03-03 | 2017-03-03 | Audio signal processing method and device and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710124912.3A CN106878866B (en) | 2017-03-03 | 2017-03-03 | Audio signal processing method and device and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106878866A CN106878866A (en) | 2017-06-20 |
| CN106878866B true CN106878866B (en) | 2020-01-10 |
Family
ID=59169691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710124912.3A Expired - Fee Related CN106878866B (en) | 2017-03-03 | 2017-03-03 | Audio signal processing method and device and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106878866B (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107197101B (en) * | 2017-06-23 | 2020-12-29 | 努比亚技术有限公司 | Audio adjusting method, mobile terminal and computer readable storage medium |
| TWM550500U (en) * | 2017-07-14 | 2017-10-11 | 正文科技股份有限公司 | Audio playing system |
| CN107479851B (en) * | 2017-08-18 | 2019-07-16 | Oppo广东移动通信有限公司 | Volume adjusting method, device, terminal device and storage medium |
| CN107465824B (en) * | 2017-08-18 | 2020-06-05 | Oppo广东移动通信有限公司 | Volume adjusting method and device, mobile terminal and storage medium |
| CN107479852B (en) * | 2017-08-18 | 2019-08-30 | Oppo广东移动通信有限公司 | Volume adjusting method, device, terminal device and storage medium |
| CN109561222A (en) * | 2017-09-27 | 2019-04-02 | 华为终端（东莞）有限公司 | A kind of method for detecting abnormality and device of voice data |
| CN107979702A (en) * | 2017-11-30 | 2018-05-01 | 北京小米移动软件有限公司 | Acoustic signal processing method, device, terminal and storage medium |
| CN107995559B (en) * | 2017-12-26 | 2020-12-01 | 上海展扬通信技术有限公司 | Audio control terminal and method |
| CN108510999B (en) * | 2018-02-09 | 2020-07-14 | 杭州默安科技有限公司 | Zero-authority terminal equipment identification method based on audio fingerprints |
| CN109547848B (en) | 2018-11-23 | 2021-02-12 | 北京达佳互联信息技术有限公司 | Loudness adjustment method and device, electronic equipment and storage medium |
| JP7115353B2 (en) * | 2019-02-14 | 2022-08-09 | 株式会社Ｊｖｃケンウッド | Processing device, processing method, reproduction method, and program |
| CN109831710A (en) * | 2019-02-19 | 2019-05-31 | 泽丰音频技术(深圳)有限公司 | A kind of microphone sound equipment integrated equipment and adjusting method, system |
| CN110349594A (en) * | 2019-07-18 | 2019-10-18 | Oppo广东移动通信有限公司 | Audio-frequency processing method, device, mobile terminal and computer readable storage medium |
| CN111049972B (en) * | 2019-11-20 | 2021-04-27 | 维沃移动通信有限公司 | Audio playing method and terminal equipment |
| CN112130495A (en) * | 2020-09-22 | 2020-12-25 | 湖北大学 | Digital configurable acoustic signal filtering device and filtering method |
| CN113643719A (en) * | 2021-08-26 | 2021-11-12 | Oppo广东移动通信有限公司 | Audio signal processing method and device, storage medium and terminal equipment |
| CN113784157B (en) * | 2021-08-31 | 2023-11-03 | 江西创成微电子有限公司 | Live broadcast audio signal processing method and sound card |
| CN116157860A (en) * | 2021-09-22 | 2023-05-23 | 京东方科技集团股份有限公司 | Audio adjusting method, device, equipment and storage medium |
| CN117406654B (en) * | 2023-12-15 | 2024-04-16 | 荣耀终端有限公司 | Sound effect processing method and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1932970A (en) * | 2005-09-13 | 2007-03-21 | 乐金电子(中国)研究开发中心有限公司 | Method for generating harmonics using fourier transform and apparatus thereof, method for generating harmonics by down-sampling and apparatus thereof and method for enhancing sound and apparatus there |
| CN101577848A (en) * | 2009-03-12 | 2009-11-11 | 北京中星微电子有限公司 | Supper bass boosting method and system |
| CN106303836A (en) * | 2016-11-15 | 2017-01-04 | 广东小天才科技有限公司 | A kind of method and device regulating played in stereo |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2891150A4 (en) * | 2012-09-02 | 2016-05-25 | Qosound Inc | Adaptive audio signal shaping for improved playback in a noisy environment |
-
2017
- 2017-03-03 CN CN201710124912.3A patent/CN106878866B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1932970A (en) * | 2005-09-13 | 2007-03-21 | 乐金电子(中国)研究开发中心有限公司 | Method for generating harmonics using fourier transform and apparatus thereof, method for generating harmonics by down-sampling and apparatus thereof and method for enhancing sound and apparatus there |
| CN101577848A (en) * | 2009-03-12 | 2009-11-11 | 北京中星微电子有限公司 | Supper bass boosting method and system |
| CN106303836A (en) * | 2016-11-15 | 2017-01-04 | 广东小天才科技有限公司 | A kind of method and device regulating played in stereo |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106878866A (en) | 2017-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106878866B (en) | Audio signal processing method and device and terminal | |
| CN104640054B (en) | Mobile terminal receiver/loudspeaker method of testing and system | |
| US9344822B2 (en) | Estimating nonlinear distortion and parameter tuning for boosting sound | |
| US9344051B2 (en) | Apparatus, method and storage medium for performing adaptive audio equalization | |
| CN101641965A (en) | Acoustic processing system and method for electronic device and mobile telephone terminal | |
| US11632200B2 (en) | Measuring and evaluating a test signal generated by a device under test (DUT) | |
| CN111866690A (en) | Microphone testing method and device | |
| CN111128167A (en) | Far-field voice awakening method and device, electronic product and storage medium | |
| CN110636432A (en) | Microphone testing method and related equipment | |
| CN111796790A (en) | Sound effect adjusting method and device, readable storage medium and terminal equipment | |
| KR20140055932A (en) | Apparatus and method for keeping output loudness and quality of sound among differernt equalizer modes | |
| US9332366B2 (en) | Loudspeaker noise inspection method, loudspeaker noise inspection device and recording medium for recording a loudspeaker noise inspection program | |
| CN105764008B (en) | A kind of method and device for debugging sound reinforcement system transmission frequency characteristic | |
| US20110235815A1 (en) | Method and arrangement for audio signal processing | |
| CN109889170B (en) | Audio signal control method and device | |
| CN111726730A (en) | Sound playing device and method for adjusting output sound | |
| CN114286253B (en) | Audio processing method and device and audio playing equipment | |
| CN110022514B (en) | Method, device and system for reducing noise of audio signal and computer storage medium | |
| JP2012063394A (en) | Noise suppression device, noise suppression method, and program | |
| CN115175081A (en) | Earphone detection method, device, equipment and computer readable storage medium | |
| CN110808064B (en) | Audio processing method and device | |
| CN114640939B (en) | Method, device and system for detecting audio playing device and storage medium | |
| CN110809222B (en) | Multi-section dynamic range control method and system and loudspeaker | |
| CN110996205A (en) | Earphone control method, earphone and readable storage medium | |
| CN106328159B (en) | Audio stream processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200110 |