CN109819376B - Method and device for dynamically and balancedly adjusting audio frequency - Google Patents
Method and device for dynamically and balancedly adjusting audio frequency Download PDFInfo
- Publication number
- CN109819376B CN109819376B CN201910055019.9A CN201910055019A CN109819376B CN 109819376 B CN109819376 B CN 109819376B CN 201910055019 A CN201910055019 A CN 201910055019A CN 109819376 B CN109819376 B CN 109819376B
- Authority
- CN
- China
- Prior art keywords
- frequency
- frequency band
- audio
- range
- equalization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Circuit For Audible Band Transducer (AREA)
Abstract
The application discloses a method and a device for dynamically balancing and adjusting audio frequency, wherein the method comprises the steps of determining balancing ranges of different first frequency bands; dividing each frame of audio into a plurality of second frequency bands; determining a second frequency band for adjustment; adjusting the energy of the adjusted second frequency band to be within the balance range of the first frequency band consistent with the bandwidth of the second frequency band; and sequentially adjusting all the second frequency bands of each frame in the audio to obtain an adjusted second audio. The purpose of carrying out the equalization adjustment of the audio frequency through different frequency scales is achieved, so that the technical effect of accurately eliminating the inaudible components in the sound is achieved, and the technical problem that in the prior art, the audio frequency is divided into a plurality of non-overlapping frequency bands on a frequency domain, and the frequency boundary of each frequency band can automatically change along with time, so that only rough adjustment can be carried out on each frequency band, and the audio frequency cannot be accurately adjusted is solved.
Description
Technical Field
The present application relates to the field of audio adjustment technologies, and in particular, to a method and an apparatus for performing dynamic equalization adjustment on audio.
Background
The existing audio automatic equalization technology mainly comprises several automated steps:
firstly, audio is automatically divided into several non-overlapping frequency bands in the frequency domain, and the frequency boundary of each frequency band can automatically change along with time.
And secondly, the gain of each frequency band can automatically change along with the time.
The problems in the prior art are mainly as follows:
first, when equalization is performed according to frequency bands, the cut-off performance of the filter is not particularly sharp, and the bandwidth of each frequency band is relatively wide and independent of each other, so that it is difficult to perform accurate adjustment on audio.
Aiming at the problem that the audio frequency cannot be accurately adjusted in the related technology, an effective solution is not provided at present.
Disclosure of Invention
The present application mainly aims to provide a method and an apparatus for performing dynamic equalization adjustment on audio, so as to solve the technical problem that the audio cannot be accurately adjusted in the related art.
To achieve the above object, according to one aspect of the present application, there is provided a method of dynamically equalizing audio.
The method for dynamically adjusting the audio equalization comprises the following steps:
determining an equalization range of different first frequency bands; wherein, the different first frequency bands have different frequency bandwidths and are overlapped with each other; the balance range is an energy interval of the first frequency band corresponding to the balance range;
dividing each frame of audio into a plurality of second frequency bands; wherein each of the second frequency bands has a corresponding first frequency band;
determining a second frequency band for adjustment;
adjusting the energy of the adjusted second frequency band to be within the balance range of the first frequency band consistent with the bandwidth of the second frequency band;
and sequentially adjusting all the second frequency bands of each frame in the audio to obtain an adjusted second audio.
Further, the method for dynamically adjusting the equalization of audio according to the foregoing, wherein the determining the equalization range of different first frequency bands, includes:
establishing a singing voice database; the singing voice database stores singing voice data of one or more excellent singers;
dividing the singing voice data frame by frame;
calculating a short-time frequency spectrum corresponding to each frame of the singing voice data to obtain an energy curve of each frame;
calculating to obtain an average curve of all frames according to the energy curve of each frame;
taking the average curve as an upper boundary and a lower boundary, and enabling N% of frames to be completely positioned between the upper boundary and the lower boundary so as to determine a full-band balance range; wherein N is more than or equal to 1 and less than or equal to 100;
and determining the balance range of each first frequency band according to the bandwidth of each first frequency band and the full-frequency-band balance range.
Further, the method for dynamically adjusting the audio equalization as described above, adjusting the energy of the second frequency band to be adjusted within the equalization range of the first frequency band consistent with the bandwidth of the second frequency band, includes:
determining a first frequency band that is consistent with a bandwidth of the adjusted second frequency band;
determining a first equalization range of the corresponding first frequency band;
and adjusting the adjusted second frequency band according to the first equalization range.
Further, the method for dynamically adjusting the equalization of audio according to the first equalization range, which adjusts the adjusted second frequency band, includes:
determining a location at which the first equalization range covers the most spectrum within the second frequency band;
determining a spectrum in the second frequency band that is outside the first equalization range at the location;
the spectrum that exceeds the upper limit of the first equalization range is attenuated and the spectrum that is below the lower limit of the first equalization range is enhanced.
Further, the method for dynamically adjusting the audio frequency according to the foregoing description further includes, after obtaining the adjusted second audio frequency:
presetting a proportional deviation threshold between fundamental frequency and low-order harmonic energy;
determining an energy deviation between a fundamental frequency and low-order harmonic energy for each frame in the second audio;
judging whether the energy deviation in the same frame exceeds the proportional deviation threshold value;
if the difference exceeds the preset threshold, adjusting the fundamental frequency or the low-order harmonic energy in the same frame;
and obtaining a third audio frequency after adjusting the fundamental frequency and the low-order harmonic energy in the second audio frequency frame by frame.
To achieve the above object, according to another aspect of the present application, there is provided an apparatus for performing dynamic equalization adjustment on audio.
The device for dynamically adjusting the audio equalization comprises the following components:
an equalization range determining unit for determining an equalization range of different first frequency bands; wherein, the different first frequency bands have different frequency bandwidths and are overlapped with each other; the balance range is an energy interval of the first frequency band corresponding to the balance range;
a second band dividing unit for dividing each frame of the audio into a plurality of second bands; wherein each of the second frequency bands has a corresponding first frequency band;
a second band determining unit for determining a second band to be adjusted;
a first adjusting unit, configured to adjust the energy of the adjusted second frequency band to be within an equilibrium range of the energy of the first frequency band that is consistent with the bandwidth of the second frequency band;
and the second audio determining unit is used for sequentially adjusting all the second frequency bands of each frame in the audio and obtaining the adjusted second audio.
Further, in the apparatus for dynamically adjusting audio equalization as described above, the equalization range determining unit includes:
the database establishing module is used for establishing a singing voice database; the singing voice database stores singing voice data of one or more excellent singers;
the segmentation module is used for segmenting the singing voice data frame by frame;
the energy curve determining module is used for calculating a short-time frequency spectrum corresponding to each frame of the singing voice data to obtain an energy curve of each frame;
the average curve determining module is used for calculating the average curve of all the frames according to the energy curve of each frame;
the full-band equilibrium range determining module is used for taking the average curve as an upper boundary and a lower boundary, enabling N% of frames to be completely positioned between the upper boundary and the lower boundary, and further determining a full-band equilibrium range; wherein N is more than or equal to 1 and less than or equal to 100;
and the equalization range determining module is used for determining the equalization range of each first frequency band according to the bandwidth of each first frequency band and the full-frequency-band equalization range.
Further, the apparatus for dynamically adjusting audio equalization as described above, the first adjusting unit includes:
a corresponding module, configured to determine a first frequency band that is consistent with a bandwidth of the adjusted second frequency band;
a first equalization range determining module, configured to determine a first equalization range of the corresponding first frequency band;
and the first adjusting module is used for adjusting the adjusted second frequency band according to the first equalization range.
Further, the apparatus for dynamically adjusting audio equalization as described above, the first adjusting module includes:
a position determination submodule for determining a position at which the first equalization range covers the maximum spectrum in the second frequency band;
a range determination submodule for determining a frequency spectrum in the second frequency band at the position which exceeds the first equalisation range;
and the adjusting submodule is used for weakening the frequency spectrum which exceeds the upper limit of the first equalization range and strengthening the frequency spectrum which is lower than the lower limit of the first equalization range.
Further, the apparatus for dynamically adjusting audio equalization as described above further includes: a second adjustment unit including:
the proportional deviation presetting module is used for presetting a proportional deviation threshold value between the fundamental frequency and the low-order harmonic energy;
an energy deviation determination module to determine an energy deviation between a fundamental frequency and low harmonic energy of each frame in the second audio;
the judging module is used for judging whether the energy deviation exceeds the proportional deviation threshold value in the same frame;
the second adjusting module is used for adjusting the fundamental frequency or the low-order harmonic energy in the same frame when the energy exceeds the first adjusting module;
and the third audio determining module is used for obtaining a third audio after adjusting the fundamental frequency and the low-order harmonic energy in the second audio frame by frame.
In the embodiment of the application, the method and the device for dynamically balancing and adjusting the audio frequency are adopted, and the balancing ranges of different first frequency bands are determined; wherein, the different first frequency bands have different frequency bandwidths and are overlapped with each other; dividing each frame of audio into a plurality of second frequency bands; wherein each of the second frequency bands has a corresponding first frequency band; determining a second frequency band for adjustment; adjusting the energy of the adjusted second frequency band to be within the balance range of the first frequency band consistent with the bandwidth of the second frequency band; and sequentially adjusting all the second frequency bands of each frame in the audio to obtain an adjusted second audio. The purpose of carrying out the equalization adjustment of the audio frequency through different frequency scales is achieved, so that the technical effect of accurately eliminating the inaudible components in the sound is achieved, and the technical problem that in the prior art, the audio frequency is divided into a plurality of non-overlapping frequency bands on a frequency domain, and the frequency boundary of each frequency band can automatically change along with time, so that only rough adjustment can be carried out on each frequency band, and the audio frequency cannot be accurately adjusted is solved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, serve to provide a further understanding of the application and to enable other features, objects, and advantages of the application to be more apparent. The drawings and their description illustrate the embodiments of the invention and do not limit it. In the drawings:
FIG. 1 is a flow diagram of a method of dynamic equalization adjustment of audio according to an embodiment of the present application; and
fig. 2 is a schematic structural diagram of functional modules of an apparatus for dynamically adjusting audio equalization according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be used. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In this application, the terms "upper", "lower", "left", "right", "front", "rear", "top", "bottom", "inner", "outer", "middle", "vertical", "horizontal", "lateral", "longitudinal", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings. These terms are used primarily to better describe the present application and its embodiments, and are not used to limit the indicated devices, elements or components to a particular orientation or to be constructed and operated in a particular orientation.
Moreover, some of the above terms may be used to indicate other meanings besides the orientation or positional relationship, for example, the term "on" may also be used to indicate some kind of attachment or connection relationship in some cases. The specific meaning of these terms in this application will be understood by those of ordinary skill in the art as appropriate.
Furthermore, the terms "mounted," "disposed," "provided," "connected," and "sleeved" are to be construed broadly. For example, it may be a fixed connection, a removable connection, or a unitary construction; can be a mechanical connection, or an electrical connection; may be directly connected, or indirectly connected through intervening media, or may be in internal communication between two devices, elements or components. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
According to an embodiment of the present application, a method of dynamic equalization adjustment of audio is provided. As shown in fig. 1, the method includes steps S1 to S5 as follows:
s1, determining the balance ranges of different first frequency bands; wherein, the different first frequency bands have different frequency bandwidths and are overlapped with each other; the balance range is an interval of the energy of the first frequency band corresponding to the balance range;
specifically, since different first frequency bands overlap with each other, there is a frequency bandwidth of the first frequency band a of 80Hz to 450Hz, and a frequency bandwidth of the first frequency band B of 200Hz to 300Hz, resulting in the presence of the first frequency band B contained in the first frequency band a, and therefore, the overlapping portion thereof is the first frequency band B; the energy in the application is a numerical value corresponding to a vertical axis in a spectrogram;
s2, dividing each frame of the audio into a plurality of second frequency bands; wherein each of the second frequency bands has a corresponding first frequency band;
that is, after determining the audio to be adjusted, dividing the audio frame by frame into N audio frames consecutive in time sequence; the time length of each frame of audio is adjusted according to the specific division precision; after obtaining the audio files arranged frame by frame, dividing each frame of the audio files, wherein the width of a specific division time frequency band is consistent with the division method of the first frequency band in the step S1, so that each second frequency band has a corresponding first frequency band;
s3, determining a second frequency band for adjustment;
specifically, this step is used to determine the frequency bandwidth and energy of the second frequency band to be adjusted;
s4, adjusting the energy of the adjusted second frequency band to be in a balance range of the energy of the first frequency band consistent with the bandwidth of the second frequency band;
specifically, according to the step, large-scale balance adjustment of different frequency scales can be carried out; in the prior art, audio is divided into a plurality of non-overlapping frequency bands on a frequency domain, and the frequency boundary of each frequency band can automatically change along with time, so that each frequency band can only be roughly adjusted, and the audio cannot be accurately adjusted;
and S5, sequentially adjusting all the second frequency bands of each frame in the audio frequency to obtain an adjusted second audio frequency.
Because each frequency band has certain auditory physical significance, the inaudible components in the sound can be accurately eliminated.
In some embodiments, the method for dynamically adjusting the equalization of audio as described above, wherein determining the equalization range of the different first frequency bands comprises:
establishing a singing voice database; the singing voice database stores singing voice data of one or more excellent singers;
specifically, the singing voice database includes singing voice data of a plurality of excellent singers, so that by analyzing the singing voice data, a balanced range of audio with high appreciation can be obtained; therefore, the aim of greatly improving the corresponding audibility can be achieved by adjusting the singing voice of a common user in the balance range;
dividing the singing voice data frame by frame;
that is, the singing voice is divided into N audio frames which are continuous in time sequence; the time length of each frame of audio is adjusted according to the specific division precision; preferably, the dividing accuracy is kept consistent with the step S2, after obtaining the audio files arranged frame by frame;
calculating a short-time frequency spectrum corresponding to each frame of the singing voice data to obtain an energy curve of each frame;
that is, the time domain information corresponding to each frame obtained in the above steps is converted into frequency domain information to obtain the corresponding short-time spectrum, and after the short-time spectrum is obtained, the energy curve corresponding to the short-time spectrum can be obtained;
calculating to obtain an average curve of all frames according to the energy curve of each frame;
specifically, after the energy curves of all frames are obtained, the energy of each frequency is averaged, and finally, continuous processing is performed, so that the average curve can be obtained;
taking the average curve as an upper boundary and a lower boundary, and enabling N% of frames to be completely positioned between the upper boundary and the lower boundary so as to determine a full-band balance range; wherein N is more than or equal to 1 and less than or equal to 100;
specifically, in practical application, a frequency band range can be formed by translating the average curve up and down respectively, so that a corresponding full-frequency band equilibrium range can be obtained when 95% of frames are completely in the frequency band; i.e., the balance range of excellent singing voice;
and determining the balance range of each first frequency band according to the bandwidth of each first frequency band and the full-frequency-band balance range.
That is to say: after the full-band equalization range is obtained, the energy corresponding to each frequency and the region range of the full-band energy in the spectrogram can be clearly determined, so that the equalization range corresponding to the obtained corresponding energy can be determined by selecting the frequency bandwidth of each first frequency band in the spectrogram.
In some embodiments, the method for dynamically adjusting the audio equalization as described above, adjusting the energy of the second frequency band to be adjusted to be within the equalization range of the first frequency band consistent with the bandwidth of the second frequency band includes:
determining a first frequency band that is consistent with a bandwidth of the adjusted second frequency band;
determining a first equalization range of the corresponding first frequency band;
and adjusting the adjusted second frequency band according to the first equalization range.
Specifically, the first equalization range consistent with the bandwidth of the adjusted second frequency band can be obtained through fast matching in this step, and then the adjusted second frequency band can be adjusted.
In some embodiments, the method for dynamically adjusting the equalization of audio as described above, wherein the adjusting the adjusted second frequency band according to the first equalization range comprises:
determining a location at which the first equalization range covers the most spectrum within the second frequency band;
determining a spectrum in the second frequency band that is outside the first equalization range at the location;
the spectrum that exceeds the upper limit of the first equalization range is attenuated and the spectrum that is below the lower limit of the first equalization range is enhanced.
Specifically, because the user may have the sound size that causes to take place great deviation apart from the microphone difference far and near when singing, directly cause the great problem of energy error, therefore can compensate the absolute energy error that the volume brought through this step, an application method can be: and shifting the frequency band range up and down to enable the frequency spectrum corresponding to the audio singing by the user to be in the frequency band as much as possible. For example, since the energy of the audio decreases as the frequency band increases when a general user sings, the portion exceeding the upper limit may be attenuated in the range of 400Hz to 4 KHz; the enhancement is performed for a portion below the lower limit in the range of 200Hz to 800 Hz.
In some embodiments, the method for dynamically adjusting equalization of audio as described above further includes, after obtaining the adjusted second audio:
presetting a proportional deviation threshold between fundamental frequency and low-order harmonic energy;
specifically, the low-order harmonic energy may include two, and a proportional deviation threshold of energy between the fundamental frequency and the low-order harmonic energy may be determined according to an average of excellent singing voices;
determining an energy deviation between a fundamental frequency and low-order harmonic energy for each frame in the second audio;
judging whether the energy deviation in the same frame exceeds the proportional deviation threshold value;
if the difference exceeds the preset threshold, adjusting the fundamental frequency or the low-order harmonic energy in the same frame;
and obtaining a third audio frequency after adjusting the fundamental frequency and the low-order harmonic energy in the second audio frequency frame by frame.
Therefore, through the step, when the energy deviation between the fundamental frequency or the low-order harmonic energy exceeds a proportional deviation threshold, the energy of the low-order harmonic energy which causes overlarge deviation is increased or reduced, the finest granularity can be realized to reach a single harmonic, and the coarsest granularity can reach the whole frequency band; and then can realize the fine adjustment to the audio frequency equilibrium degree.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
According to the embodiment of the invention, the device for dynamically adjusting the audio frequency is also provided, wherein the device is used for implementing the method for dynamically adjusting the audio frequency.
The device for dynamically adjusting the audio equalization comprises the following components:
an equalization range determining unit 1 for determining an equalization range of different first frequency bands; wherein, the different first frequency bands have different frequency bandwidths and are overlapped with each other;
a second frequency band dividing unit 2 for dividing each frame of audio into a plurality of second frequency bands; wherein each of the second frequency bands has a corresponding first frequency band;
a second band determining unit 3 for determining a second band to be adjusted;
a first adjusting unit 4, configured to adjust the energy of the adjusted second frequency band to be within an equalization range of the first frequency band that is consistent with the bandwidth of the second frequency band; the balance range is an interval of the energy of the first frequency band corresponding to the balance range;
and the second audio determining unit 5 is configured to adjust all the second frequency bands of each frame in the audio in sequence and obtain an adjusted second audio.
Specifically, the specific process of implementing the functions of each module in the apparatus according to the embodiment of the present invention may refer to the related description in the method embodiment, and is not described herein again.
In some embodiments, the apparatus for dynamically adjusting equalization of audio as described above, the equalization range determining unit includes:
the database establishing module is used for establishing a singing voice database; the singing voice database stores singing voice data of one or more excellent singers;
the segmentation module is used for segmenting the singing voice data frame by frame;
the energy curve determining module is used for calculating a short-time frequency spectrum corresponding to each frame of the singing voice data to obtain an energy curve of each frame;
the average curve determining module is used for calculating the average curve of all the frames according to the energy curve of each frame;
the full-band equilibrium range determining module is used for taking the average curve as an upper boundary and a lower boundary, enabling N% of frames to be completely positioned between the upper boundary and the lower boundary, and further determining a full-band equilibrium range; wherein N is more than or equal to 1 and less than or equal to 100;
and the equalization range determining module is used for determining the equalization range of each first frequency band according to the bandwidth of each first frequency band and the full-frequency-band equalization range.
Specifically, the specific process of implementing the functions of each module in the apparatus according to the embodiment of the present invention may refer to the related description in the method embodiment, and is not described herein again.
In some embodiments, the apparatus for dynamically adjusting equalization of audio as described above, the first adjusting unit includes:
a corresponding module, configured to determine a first frequency band that is consistent with a bandwidth of the adjusted second frequency band;
a first equalization range determining module, configured to determine a first equalization range of the corresponding first frequency band;
and the first adjusting module is used for adjusting the adjusted second frequency band according to the first equalization range.
Specifically, the specific process of implementing the functions of each module in the apparatus according to the embodiment of the present invention may refer to the related description in the method embodiment, and is not described herein again.
In some embodiments, the apparatus for dynamically adjusting audio equalization as described above, the first adjusting module comprises:
a position determination submodule for determining a position at which the first equalization range covers the maximum spectrum in the second frequency band;
a range determination submodule for determining a frequency spectrum in the second frequency band at the position which exceeds the first equalisation range;
and the adjusting submodule is used for weakening the frequency spectrum which exceeds the upper limit of the first equalization range and strengthening the frequency spectrum which is lower than the lower limit of the first equalization range.
Specifically, the specific process of implementing the functions of each module in the apparatus according to the embodiment of the present invention may refer to the related description in the method embodiment, and is not described herein again.
In some embodiments, the apparatus for dynamically adjusting audio equalization as described above further comprises: a second adjustment unit including:
the proportional deviation presetting module is used for presetting a proportional deviation threshold value between the fundamental frequency and the low-order harmonic energy;
an energy deviation determination module to determine an energy deviation between a fundamental frequency and low harmonic energy of each frame in the second audio;
the judging module is used for judging whether the energy deviation exceeds the proportional deviation threshold value in the same frame;
the second adjusting module is used for adjusting the fundamental frequency or the low-order harmonic energy in the same frame when the energy exceeds the first adjusting module;
and the third audio determining module is used for obtaining a third audio after adjusting the fundamental frequency and the low-order harmonic energy in the second audio frame by frame.
Specifically, the specific process of implementing the functions of each module in the apparatus according to the embodiment of the present invention may refer to the related description in the method embodiment, and is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and they may alternatively be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, or fabricated separately as individual integrated circuit modules, or fabricated as a single integrated circuit module from multiple modules or steps. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (10)
1. A method for dynamic equalization adjustment of audio, comprising:
determining an equalization range of different first frequency bands; wherein, the different first frequency bands have different frequency bandwidths and are overlapped with each other; the balance range is an energy interval of the first frequency band corresponding to the balance range;
dividing each frame of audio into a plurality of second frequency bands; wherein, the different second frequency bands have different frequency bandwidths and are overlapped with each other; each second frequency band has a corresponding first frequency band;
determining a second frequency band for adjustment;
adjusting the energy of the adjusted second frequency band to be within the balance range of the first frequency band consistent with the bandwidth of the second frequency band;
and sequentially adjusting all the second frequency bands of each frame in the audio to obtain an adjusted second audio.
2. The method of claim 1, wherein determining the equalization range for the different first frequency bands comprises:
establishing a singing voice database; the singing voice database stores singing voice data of one or more singers;
dividing the singing voice data frame by frame;
calculating a short-time frequency spectrum corresponding to each frame of the singing voice data to obtain an energy curve of each frame;
calculating to obtain an average curve of all frames according to the energy curve of each frame;
taking the average curve as an upper boundary and a lower boundary, and enabling N% of frames to be completely positioned between the upper boundary and the lower boundary so as to determine a full-band balance range; wherein the full frequency band equalization range comprises the equalization range of the singing voice data, and N is more than or equal to 1 and less than or equal to 100;
and determining the balance range of each first frequency band according to the bandwidth of each first frequency band and the full-frequency-band balance range.
3. The method of claim 1, wherein adjusting the energy of the second adjusted frequency band to be within the equalization range of the first frequency band consistent with the bandwidth of the second adjusted frequency band comprises:
determining a first frequency band that is consistent with a bandwidth of the adjusted second frequency band;
determining a first equalization range of the corresponding first frequency band;
and adjusting the adjusted second frequency band according to the first equalization range.
4. The method of claim 3, wherein said adjusting the adjusted second frequency band according to the first equalization range comprises:
determining a location at which the first equalization range covers the most spectrum within the second frequency band;
determining a spectrum in the second frequency band that is outside the first equalization range at the location;
the spectrum that exceeds the upper limit of the first equalization range is attenuated and the spectrum that is below the lower limit of the first equalization range is enhanced.
5. The method of claim 1, further comprising, after obtaining the adjusted second audio:
presetting a proportional deviation threshold between fundamental frequency and low-order harmonic energy;
determining an energy deviation between a fundamental frequency and low-order harmonic energy for each frame in the second audio;
judging whether the energy deviation in the same frame exceeds the proportional deviation threshold value;
if the difference exceeds the preset threshold, adjusting the fundamental frequency or the low-order harmonic energy in the same frame;
and obtaining a third audio frequency after adjusting the fundamental frequency and the low-order harmonic energy in the second audio frequency frame by frame.
6. An apparatus for dynamic equalization adjustment of audio, comprising:
an equalization range determining unit for determining an equalization range of different first frequency bands; wherein, the different first frequency bands have different frequency bandwidths and are overlapped with each other; the balance range is an energy interval of the first frequency band corresponding to the balance range;
a second band dividing unit for dividing each frame of the audio into a plurality of second bands; wherein, the different second frequency bands have different frequency bandwidths and are overlapped with each other; each second frequency band has a corresponding first frequency band;
a second band determining unit for determining a second band to be adjusted;
the first adjusting unit is used for adjusting the energy of the adjusted second frequency band to be within the balance range of the first frequency band consistent with the bandwidth of the second frequency band;
and the second audio determining unit is used for sequentially adjusting all the second frequency bands of each frame in the audio and obtaining the adjusted second audio.
7. The apparatus for performing dynamic equalization adjustment on audio according to claim 6, wherein the equalization range determining unit comprises:
the database establishing module is used for establishing a singing voice database; the singing voice database stores singing voice data of one or more singers;
the segmentation module is used for segmenting the singing voice data frame by frame;
the energy curve determining module is used for calculating a short-time frequency spectrum corresponding to each frame of the singing voice data to obtain an energy curve of each frame;
the average curve determining module is used for calculating the average curve of all the frames according to the energy curve of each frame;
the full-band equilibrium range determining module is used for taking the average curve as an upper boundary and a lower boundary, enabling N% of frames to be completely positioned between the upper boundary and the lower boundary, and further determining a full-band equilibrium range; wherein the full frequency band equalization range comprises the equalization range of the singing voice data, and N is more than or equal to 1 and less than or equal to 100;
and the equalization range determining module is used for determining the equalization range of each first frequency band according to the bandwidth of each first frequency band and the full-frequency-band equalization range.
8. The apparatus for performing dynamic equalization adjustment on audio according to claim 6, wherein the first adjusting unit comprises:
a corresponding module, configured to determine a first frequency band that is consistent with a bandwidth of the adjusted second frequency band;
a first equalization range determining module, configured to determine a first equalization range of the corresponding first frequency band;
and the first adjusting module is used for adjusting the adjusted second frequency band according to the first equalization range.
9. The apparatus for dynamic equalization adjustment of audio according to claim 8, wherein the first adjustment module comprises:
a position determination submodule for determining a position at which the first equalization range covers the maximum spectrum in the second frequency band;
a range determination submodule for determining a frequency spectrum in the second frequency band at the position which exceeds the first equalisation range;
and the adjusting submodule is used for weakening the frequency spectrum which exceeds the upper limit of the first equalization range and strengthening the frequency spectrum which is lower than the lower limit of the first equalization range.
10. The apparatus for dynamic equalization adjustment of audio according to claim 6, further comprising: a second adjustment unit including:
the proportional deviation presetting module is used for presetting a proportional deviation threshold value between the fundamental frequency and the low-order harmonic energy;
an energy deviation determination module to determine an energy deviation between a fundamental frequency and low harmonic energy of each frame in the second audio;
the judging module is used for judging whether the energy deviation exceeds the proportional deviation threshold value in the same frame;
the second adjusting module is used for adjusting the fundamental frequency or the low-order harmonic energy in the same frame when the energy exceeds the first adjusting module;
and the third audio determining module is used for obtaining a third audio after adjusting the fundamental frequency and the low-order harmonic energy in the second audio frame by frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910055019.9A CN109819376B (en) | 2019-01-21 | 2019-01-21 | Method and device for dynamically and balancedly adjusting audio frequency |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910055019.9A CN109819376B (en) | 2019-01-21 | 2019-01-21 | Method and device for dynamically and balancedly adjusting audio frequency |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109819376A CN109819376A (en) | 2019-05-28 |
| CN109819376B true CN109819376B (en) | 2020-11-06 |
Family
ID=66602996
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910055019.9A Active CN109819376B (en) | 2019-01-21 | 2019-01-21 | Method and device for dynamically and balancedly adjusting audio frequency |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109819376B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101952889A (en) * | 2008-02-01 | 2011-01-19 | 摩托罗拉公司 | Method and apparatus for estimating high-band energy in a bandwidth extension system |
| CN104349120A (en) * | 2013-07-26 | 2015-02-11 | 北京计算机技术及应用研究所 | Audio and video decoding system and decoding method thereof |
| CN106375780A (en) * | 2016-10-20 | 2017-02-01 | 腾讯音乐娱乐（深圳）有限公司 | Method and apparatus for generating multimedia file |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7587254B2 (en) * | 2004-04-23 | 2009-09-08 | Nokia Corporation | Dynamic range control and equalization of digital audio using warped processing |
| CN101155438B (en) * | 2006-09-26 | 2011-12-28 | 张秀丽 | Frequency response adaptive equalization method for audio device |
| CN101359902B (en) * | 2008-09-25 | 2012-03-21 | 炬才微电子（深圳）有限公司 | Equalizing method and system for audio signal |
| JP2014154956A (en) * | 2013-02-06 | 2014-08-25 | Onkyo Corp | Channel divider, voice reproduction system including the same, and method for setting cross-over frequency |
| US9906858B2 (en) * | 2013-10-22 | 2018-02-27 | Bongiovi Acoustics Llc | System and method for digital signal processing |
| JP6789690B2 (en) * | 2016-06-23 | 2020-11-25 | キヤノン株式会社 | Signal processing equipment, signal processing methods, and programs |
-
2019
- 2019-01-21 CN CN201910055019.9A patent/CN109819376B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101952889A (en) * | 2008-02-01 | 2011-01-19 | 摩托罗拉公司 | Method and apparatus for estimating high-band energy in a bandwidth extension system |
| CN104349120A (en) * | 2013-07-26 | 2015-02-11 | 北京计算机技术及应用研究所 | Audio and video decoding system and decoding method thereof |
| CN106375780A (en) * | 2016-10-20 | 2017-02-01 | 腾讯音乐娱乐（深圳）有限公司 | Method and apparatus for generating multimedia file |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109819376A (en) | 2019-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103827965B (en) | Adaptive voice intelligibility processor | |
| RU2467406C2 (en) | Method and apparatus for supporting speech perceptibility in multichannel ambient sound with minimum effect on surround sound system | |
| CN102461203B (en) | Systems, methods and apparatus for phase-based processing of multichannel signal | |
| CN102436821B (en) | Method for adaptively adjusting sound effect and equipment thereof | |
| CN101952889B (en) | Method and apparatus for estimating high-band energy in a bandwidth extension system | |
| CN101918942B (en) | Frequency-warped audio equalizer | |
| CN102044242B (en) | Method, device and electronic equipment for voice activation detection | |
| US9183846B2 (en) | Method and device for adaptively adjusting sound effect | |
| CN101939783A (en) | Method and apparatus for estimating high-band energy in a bandwidth extension system | |
| US20190198005A1 (en) | Dynamic sound adjustment based on noise floor estimate | |
| CN105872910A (en) | Audio signal squeaking detection method | |
| CN109845287A (en) | The noise estimation adjusted for dynamic voice | |
| CN112037816B (en) | Correction, howling detection and suppression method and device for frequency domain frequency of voice signal | |
| CN106409311B (en) | Refrain extraction element and method | |
| CN106257584A (en) | The intelligibility of speech improved | |
| GB2489083A (en) | Automatic equalization of colouration in speech recordings | |
| Rämö et al. | Perceptual headphone equalization for mitigation of ambient noise | |
| CN108882115A (en) | loudness adjusting method, device and terminal | |
| JP2019176477A (en) | Arrangement method of wireless loudspeaker, wireless loudspeaker, and terminal device | |
| CN103813251A (en) | Hearing-aid denoising device and method allowable for adjusting denoising degree | |
| CN105992100B (en) | A kind of preset collection determination method for parameter of audio equalizer and device | |
| CN109819376B (en) | Method and device for dynamically and balancedly adjusting audio frequency | |
| Prud'Homme et al. | A harmonic-cancellation-based model to predict speech intelligibility against a harmonic masker | |
| CN101359902A (en) | Equalizing method and system for audio signal | |
| US20220383889A1 (en) | Adapting sibilance detection based on detecting specific sounds in an audio signal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |