CN113936676A - Sound adjusting method and device and electronic equipment - Google Patents
Sound adjusting method and device and electronic equipment Download PDFInfo
- Publication number
- CN113936676A CN113936676A CN202111162688.XA CN202111162688A CN113936676A CN 113936676 A CN113936676 A CN 113936676A CN 202111162688 A CN202111162688 A CN 202111162688A CN 113936676 A CN113936676 A CN 113936676A
- Authority
- CN
- China
- Prior art keywords
- audio data
- processing
- sound
- reverberation
- tonal modification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000012545 processing Methods 0.000 claims abstract description 234
- 230000004048 modification Effects 0.000 claims abstract description 115
- 238000012986 modification Methods 0.000 claims abstract description 115
- 230000000694 effects Effects 0.000 claims description 96
- 230000008859 change Effects 0.000 claims description 48
- 230000008569 process Effects 0.000 claims description 18
- 238000012952 Resampling Methods 0.000 claims description 15
- 230000017105 transposition Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 2
- 230000003750 conditioning effect Effects 0.000 claims 2
- 238000011022 operating instruction Methods 0.000 claims 1
- 238000004891 communication Methods 0.000 description 10
- 238000001914 filtration Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 208000037656 Respiratory Sounds Diseases 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 206010037833 rales Diseases 0.000 description 2
- 241000238631 Hexapoda Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/003—Changing voice quality, e.g. pitch or formants
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
Landscapes
- Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses a sound adjusting method, which is used for acquiring current audio data in real time; performing inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data, wherein the inflexion processing comprises at least one of equalization processing, tonal modification processing and reverberation processing; and obtaining beautification audio data corresponding to the current audio data according to the variable audio data. The sound adjusting method, the sound adjusting device and the electronic equipment can realize acoustic adjustment on the sound equipment, improve the real-time performance of sound adjustment and improve the sound adjusting efficiency.
Description
Technical Field
The present invention relates to the field of sound processing technologies, and in particular, to a sound adjusting method and apparatus, and an electronic device.
Background
With the rapid development of sound processing technology, the PC has already had more sophisticated sound processing software, such as audio, iztope, etc., and more specialized plug-ins, such as Waves, etc. The software and the plug-in can generate a sound effect with higher quality, the parameter adjustment is more flexible, and the sound processing effect can be effectively improved.
However, the existing sound processing software is used in the PC, and the processing is performed only by the hardware support of the PC, and with the rapid development of the sound mobile devices such as smart earphones and recording pens, the sound device also needs to perform sound adjustment.
Disclosure of Invention
The embodiment of the invention provides a sound adjusting method, a sound adjusting device and electronic equipment, which can realize acoustic adjustment on sound equipment, improve the real-time performance of sound adjustment and improve the sound adjusting efficiency.
A first aspect of an embodiment of the present invention provides a sound adjusting method, where the method includes:
acquiring current audio data in real time;
performing inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data, wherein the inflexion processing comprises at least one of equalization processing, tonal modification processing and reverberation processing;
and obtaining beautification audio data corresponding to the current audio data according to the variable audio data.
Optionally, the performing, by the DSP chip, a pitch change process on the current audio data to obtain pitch change audio data includes:
and if the sound changing processing is equalization processing, inputting the current audio data into a filter bank in the DSP chip according to a target equalization sound effect selected from a set equalization sound effect set to obtain equalization audio data, and taking the equalization audio data as the sound changing audio data, wherein the number of frequency bands corresponding to the filter bank is an integer larger than 1.
Optionally, the performing, by the DSP chip, a pitch change process on the current audio data to obtain pitch change audio data includes:
and if the tonal modification processing is tonal modification processing, performing tonal modification processing on the current audio data through a preset tonal modification algorithm arranged in the DSP chip according to a target tonal modification sound effect selected from a set tonal modification sound effect set to obtain tonal modification audio data, and taking the tonal modification audio data as the tonal modification audio data.
Optionally, the performing, according to a target tonal modification sound effect selected from a set tonal modification sound effect set, a tonal modification process on the current audio data through a preset tonal modification algorithm arranged in the DSP chip to obtain tonal modification audio data includes:
processing the current audio data through a speed change algorithm to obtain speed change audio data; and processing the variable speed audio data through a resampling algorithm to obtain the tonal modification audio data, wherein the tonal modification audio data has the same sound speed as the current audio data, and the preset tonal modification algorithm comprises the variable speed algorithm and the resampling algorithm.
Optionally, the performing, by the DSP chip, a pitch change process on the current audio data to obtain pitch change audio data includes:
and if the pitch change processing is reverberation processing, performing reverberation processing on the current audio data through a simulated reverberation algorithm arranged in the DSP chip according to a target reverberation sound effect selected from a set reverberation sound effect set to obtain reverberation audio data, and taking the reverberation audio data as pitch change audio data.
Optionally, the obtaining beautification audio data corresponding to the current audio data according to the inflexion audio data includes:
obtaining the beautification audio data according to the inflected audio data, wherein the inflected audio data comprises at least one of the equalized audio data, the inflected audio data and the reverberation audio data.
A second aspect of an embodiment of the present invention also provides a sound adjusting apparatus, including:
the audio data acquisition unit is used for acquiring current audio data in real time;
the sound processing unit is used for respectively carrying out inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data, wherein the inflexion processing comprises at least one of equalization processing, tonal modification processing and reverberation processing;
and the beautification audio unit is used for obtaining beautification audio data corresponding to the current audio data according to the inflexion audio data.
Optionally, the sound processing unit is configured to, if the inflexion processing is equalization processing, input the current audio data into a filter bank in the DSP chip according to a target equalization sound effect selected from a set equalization sound effect set to obtain equalization audio data, and use the equalization audio data as the inflexion audio data, where the number of frequency bands corresponding to the filter bank is an integer greater than 1.
Optionally, the sound processing unit is configured to, if the tonal modification processing is tonal modification processing, perform tonal modification processing on the current audio data according to a target tonal modification sound effect selected from a set tonal modification sound effect set through a preset tonal modification algorithm arranged in the DSP chip to obtain tonal modification audio data, and use the tonal modification audio data as the tonal modification audio data.
Optionally, the sound processing unit is configured to process the current audio data through a speed change algorithm to obtain speed change audio data; and processing the variable speed audio data through a resampling algorithm to obtain the tonal modification audio data, wherein the tonal modification audio data has the same sound speed as the current audio data, and the preset tonal modification algorithm comprises the variable speed algorithm and the resampling algorithm.
Optionally, the sound processing unit is configured to, if the pitch change processing is reverberation processing, perform reverberation processing on the current audio data according to a target reverberation sound effect selected from a set of reverberation sound effects through a simulated reverberation algorithm arranged in the DSP chip to obtain reverberation audio data, and use the reverberation audio data as pitch change audio data.
A third aspect of an embodiment of the present invention provides an electronic device, including a memory and one or more programs, where the one or more programs are stored in the memory and configured to be executed by one or more processors to execute operation instructions included in the one or more programs for performing the sound adjustment method according to the first aspect.
A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps corresponding to the sound adjusting method provided in the first aspect.
The above one or at least one technical solution in the embodiments of the present application has at least the following technical effects:
based on the technical scheme, the current audio data is acquired in real time; respectively carrying out inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data; according to the inflexion audio data, beautification audio data corresponding to the current audio data are obtained, because inflexion processing comprises at least one of equalization processing, tone changing processing and reverberation processing, the current audio data can be respectively subjected to filtering processing, tone changing processing and reverberation processing through the DSP chip, and then the beautification audio data are obtained according to the inflexion audio data obtained through processing, so that the algorithm and the DSP chip are deeply combined, the algorithm is optimized and accelerated through the DSP chip, the processing efficiency of the algorithm is effectively improved, and the DSP chip is usually arranged on sound equipment, so that the effect of realizing acoustic adjustment on the sound equipment is realized, the real-time performance of the sound adjustment is improved on the basis of improving the processing efficiency, and the sound adjustment efficiency is further improved.
Drawings
Fig. 1 is a schematic flow chart of a sound adjusting method according to an embodiment of the present application;
fig. 2 is a schematic flowchart illustrating processing of current audio data by using a filter bank according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating an overall sound adjustment method according to an embodiment of the present application;
fig. 4 is a block diagram of a sound adjusting apparatus according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The main implementation principle, the specific implementation mode and the corresponding beneficial effects of the technical scheme of the embodiment of the present application are explained in detail with reference to the accompanying drawings.
Examples
Referring to fig. 1, an embodiment of the present application provides a sound adjusting method, including:
s101, acquiring current audio data in real time;
s102, performing inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data, wherein the inflexion processing comprises at least one of equalization processing, inflexion processing and reverberation processing;
s103, obtaining beautification audio data corresponding to the current audio data according to the inflexion audio data.
In the embodiment of the present description, the sound adjusting method is applied to a sound device with a DSP chip, where the DSP chip is a chip capable of implementing a Digital Signal Processing technology. The sound equipment can be, for example, an electronic equipment such as a recording pen and an intelligent earphone
In step S101, current audio data may be obtained in real time through a sound device, for example, when a certain user is speaking or singing, the sound data of the user is collected in real time as the current audio data.
Specifically, the audio data may be collected in real time by a sound collector of the sound device, such as a microphone and a microphone, so that the sound device may acquire the current audio data in real time.
After the current audio data is acquired in real time, step S102 is performed.
In step S102, the pitch change processing is one or more of equalization processing, pitch change processing, reverberation processing, and the like, and may be, for example, single equalization processing, single pitch change processing, and single reverberation processing; the pitch change processing may include an equalization processing and a pitch change processing, or a reverberation processing and an equalization processing, and the like, and the present specification is not particularly limited.
In an embodiment, when the inflexion processing is equalization processing, current audio data may be input to a filter bank in the DSP chip according to a target equalization sound effect selected from a set of equalization sound effects, to obtain equalization audio data, where the number of frequency bands corresponding to the filter bank is an integer greater than 1.
In an embodiment, if the tonal modification processing is tonal modification processing, current audio data is subjected to tonal modification processing through a preset tonal modification algorithm arranged in the DSP chip according to a target tonal modification sound effect selected from the set tonal modification sound effect set to obtain tonal modification audio data, and the tonal modification audio data is used as the tonal modification audio data.
In an embodiment, if the pitch change processing is reverberation processing, according to a target reverberation sound effect selected from the set reverberation sound effect set, reverberation processing is performed on current audio data through a simulated reverberation algorithm arranged in the DSP chip to obtain reverberation audio data, and the reverberation audio data is used as pitch change audio data.
If the inflexion processing is equalization processing and reverberation processing, equalization processing is performed on the current audio data to obtain equalized audio data, and then reverberation processing is performed on the equalized audio data to obtain equalized and reverberated audio data serving as inflexion audio data; correspondingly, if the pitch changing processing is pitch changing processing and reverberation processing, performing the pitch changing processing on the current audio data to obtain pitch changing audio data, and performing the reverberation processing on the pitch changing audio data to obtain pitch changing + reverberation audio data serving as the pitch changing audio data; if the tonal modification processing is tonal modification processing and equalization processing, performing tonal modification processing on the current audio data to obtain tonal modification audio data, and then performing equalization processing on the tonal modification audio data to obtain equalization + tonal modification audio data as the tonal modification audio data; if the pitch change processing is pitch change processing, equalization processing and reverberation processing, equalization processing can be carried out on the current audio data to obtain equalized audio data, and then reverberation processing and pitch change processing are carried out on the equalized audio data in sequence to obtain equalized + reverberated + pitch change audio data; of course, the reverberation processing, the equalization processing, and the pitch change processing may be performed on the current audio data in sequence, or the pitch change processing, the equalization processing, the reverberation processing, and the like may be performed on the current audio data in sequence, and the present specification is not particularly limited with respect to the sequence of the processing manners of the reverberation processing, the equalization processing, the pitch change processing, and the like.
In this embodiment of the present specification, the set of equalized sound effects may include one or more of sound effects such as a phonograph sound effect, a pop sound effect, an electronic sound effect, and a light music sound effect; the set tonal modification sound effect set can comprise one or more of tonal modification sound effects such as tonal modification sound effects and tonal modification sound effects, wherein the tonal modification sound effects can comprise tonal modification rale sound effects, tonal modification doll sound effects, tonal modification mellow sound effects and the like, and correspondingly, the tonal modification sound effects can comprise tonal modification rale sound effects, tonal modification doll sound effects, tonal modification mellow sound effects and the like; the set of reverberation sound effects may include church sound effects, KTV sound effects, studio sound effects, field sound effects, and the like. Of course, the setting of the balanced sound effect set, the setting of the tonal sound effect set, and the setting of the reverberation sound effect set may be set according to actual requirements, and the description is not particularly limited.
Specifically, when the filter bank is used for processing the current audio data, a filter bank needs to be preset, a graphical equalizer is formed through the set filter bank, and after a target equalization sound effect or a default target equalization sound effect selected from a set equalization sound effect set by a user is received, the current audio data is processed through the graphical equalizer according to the target equalization sound effect, so that the processed equalization audio data is matched with the target equalization sound effect. Of course, after the filter bank is preset, a parametric equalizer may be formed by the set filter bank, and this description is not particularly limited.
In the embodiment of the present specification, the illustrated equalizer is an illustrated equalizer that divides a full frequency band into several fixed frequency bands to adjust energy in the fixed frequency band, for example, the full frequency band may be divided into 10, 20, and 30 frequency bands, and the adjustment is more precise as the number of frequency bands divided is larger. Further, the filter may employ a biquad filter.
In the practical application process, as shown in fig. 2, step a1 is first executed, equalizer parameters are determined, and according to practical requirements, the equalizer parameters are determined; step A2 is executed again to obtain a filter bank, and the filter bank is designed according to the equalizer parameters; after obtaining the filter bank, executing step a3, inputting the unit impact signal into the filter bank to obtain an output signal, where the unit impact signal may be a meta signal, and the unit impact response obtained after filtering by the filter bank is the output signal obtained by the meta signal passing through the filter bank; step A4 is executed, current audio data is input, namely the current audio data is input into the unit impact response processing; after the execution of A3 and A4 is finished, executing A5 unit impulse response processing, specifically performing convolution processing on the output signal and the current audio data to obtain equalized audio data; next, step a6 is executed to output audio and output equalized audio data.
For example, if the target equalized sound effect selected by the user from the set equalized sound effect set is the phonograph sound effect, the current audio data is processed by the illustrated equalizer, for example, the sound-recorder-wav representation, and then the obtained phonograph audio data is the phonograph-recorder-wav. Therefore, the reverberation processing can be performed by using the filter of the DSP chip when the filtering processing is performed, the filtering processing is deeply combined with the DSP chip, and the data processing amount of the filtering processing is low due to the fact that the hardware performance of the DSP chip is low, so that the data processing amount of the filtering processing is matched with the hardware performance of the DSP chip, and the real-time filtering processing on the DPS chip can be realized.
Specifically, when the current audio data is subjected to tonal modification, firstly, a target tonal modification sound effect selected from a set tonal modification sound effect set or a default tonal modification sound effect is taken as the target tonal modification sound effect, and then the current audio data is processed through a speed change algorithm to obtain speed change audio data; and processing the variable-speed audio data through a resampling algorithm according to the target variable-pitch sound effect to obtain variable-pitch audio data, wherein the variable-pitch audio data has the same sound speed as the current audio data, and the preset variable-pitch algorithm comprises a variable-speed algorithm and a resampling algorithm.
In the embodiments of the present specification, the shift algorithm may be, for example, an Overlap-and-Add (OLA) algorithm, a WSOLA algorithm, or the like.
Specifically, after the current audio data is processed by a speed change algorithm, speed change audio data with speed change and tone change unchanged is obtained; and processing the variable-speed audio data through a resampling algorithm to obtain the tone-changing audio data with tone changing and no speed changing.
For example, if the target tonal modification sound effect selected by the user from the set tonal modification sound effect set is a raelian sound effect, the current audio data is processed by, for example, the girl's original sound wav expression through the WSOLA algorithm and the resampling algorithm, and the girl's rising tone raelian wav is obtained. Due to the fact that the data volume of the WSOLA algorithm and the resampling algorithm is low, the data volume in the tone-changing processing process is matched with the hardware performance of the DSP, and therefore the tone-changing processing can be carried out on a DPS chip in real time.
In the embodiment of the present specification, a time domain method is used when performing the tonal modification processing on the current audio data, and of course, a frequency domain method may also be used to perform the tonal modification processing on the current audio data. When the current audio data is modified by using a frequency domain method, a time domain signal can be transformed to a frequency domain signal by Fast Fourier Transform (FFT); compressing or stretching the whole signal in a frequency domain through spectrum contraction and expansion; the processed frequency domain signal is restored into a time domain signal through a phase synthesizer, and thus, the tonal modification audio data with tonal modification and no speed change can be obtained.
Specifically, when performing reverberation processing on current audio data, a target reverberation sound effect is first required to be obtained, if a reverberation selection operation from a set of reverberation sound effects set by a user is received, a reverberation sound corresponding to the reverberation selection operation is used as the target reverberation sound effect, and if the reverberation selection operation is not received within a set time period, a default reverberation sound effect is used as the target reverberation sound effect; and after the target reverberation sound effect is determined, performing reverberation processing on the current audio data through a simulated reverberation algorithm arranged in the DSP chip to obtain the reverberation audio data. Of course, the reverberation processing may also be performed on the current audio data through a convolution reverberation algorithm, and the description is not particularly limited.
In the embodiment of the present specification, the simulated reverberation algorithm may be, for example, a Schroeder algorithm, an adaptive weight prediction estimation algorithm, and the like, and the present specification is not particularly limited.
Specifically, when the current audio data is subjected to reverberation processing by using a simulated reverberation algorithm, early reflected sound in reverberation can be simulated by a delayer and an attenuation factor; then simulating a reflecting process of later reverberation confusion through the comb filters connected in parallel; finally, the reverberation density is increased through an all-pass filter, so that the reverberation audio data is obtained. Therefore, the simulated reverberation algorithm can use the delayer and the filter of the DSP chip to perform reverberation processing, so that the simulated reverberation algorithm is deeply combined with the DSP chip, and the data processing amount of the simulated reverberation algorithm is low due to the low hardware performance of the DSP chip, so that the data processing amount of the simulated reverberation algorithm is matched with the hardware performance of the DSP chip, and the real-time reverberation processing on the DPS chip can be realized.
For example, if the target reverberation sound effect selected by the user from the set reverberation sound effect set is a church sound effect, the current audio data is processed by, for example, a Schroeder algorithm, and a church wav is obtained.
Therefore, in the process of carrying out filtering processing, tone changing processing and reverberation processing on the current audio data, the data volume is low and is matched with the hardware performance of the DSP chip, so that the real-time filtering processing, tone changing processing and reverberation processing on the DPS chip can be realized.
After the inflected audio data is obtained, step S103 is performed.
In step S103, if the pitch change processing includes equalization processing, pitch change processing, and reverberation processing, the DSP chip may sequentially perform equalization processing, pitch change processing, and reverberation processing on the current audio data to obtain the equalization + reverberation + pitch change audio data, and then perform timing synchronization on the equalization + reverberation + pitch change audio data and the current audio data to obtain beautified audio data. Of course, the pitch modification process may include at least one of equalization, pitch modification, and reverberation according to the user's needs. The following specifically takes, as an example, the inflexion processing including the equalization processing, the transposition processing, and the reverberation processing.
For example, referring to fig. 3, an audio stream is obtained in real time, the audio stream obtained in real time is respectively input into an equalizer algorithm 30, a reverberation algorithm 31 and a pitch change algorithm 32 in a DSP chip, and after the audio stream is processed by the equalizer algorithm 30, equalized audio data is obtained; performing reverberation processing on the equalized audio data through a reverberation algorithm 31 to obtain equalized and reverberated audio data; and after the tonal modification processing is performed on the balance + reverberation audio data through the tonal modification algorithm 32, obtaining the tonal modification + balance + reverberation audio data, at this time, the obtained tonal modification + balance + reverberation audio data can be directly used as beautifying audio data, of course, the tonal modification + balance + reverberation audio data and the audio stream can also be subjected to time sequence synchronization, and the data after the time sequence synchronization is used as beautifying audio data.
Thus, by the technical scheme, background sound of a specific environment, such as rain sound, sea wave sound, bird cry sound, insect singing sound and the like, can be added to sound, and sound can be quickly or slowly adjusted without changing tone color, tone and the like of the sound.
Based on the technical scheme, the current audio data is acquired in real time; respectively carrying out inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data; according to the inflexion audio data, beautification audio data corresponding to the current audio data are obtained, because inflexion processing comprises at least one of equalization processing, tone changing processing and reverberation processing, the current audio data can be respectively subjected to filtering processing, tone changing processing and reverberation processing through the DSP chip, and then the beautification audio data are obtained according to the inflexion audio data obtained through processing, so that the algorithm and the DSP chip are deeply combined, the algorithm is optimized and accelerated through the DSP chip, the processing efficiency of the algorithm is effectively improved, and the DSP chip is usually arranged on sound equipment, so that the effect of realizing acoustic adjustment on the sound equipment is realized, the real-time performance of the sound adjustment is improved on the basis of improving the processing efficiency, and the sound adjustment efficiency is further improved.
In view of the foregoing, an embodiment of the present application provides a sound adjusting method, and an embodiment of the present application also provides a sound adjusting apparatus, please refer to fig. 4, where the apparatus includes:
an audio data acquiring unit 401, configured to acquire current audio data in real time;
a sound processing unit 402, configured to perform inflexion processing on the current audio data through a DSP chip, respectively, to obtain inflexion audio data, where the inflexion processing includes at least one of equalization processing, pitch change processing, and reverberation processing;
and a beautification audio unit 403, configured to obtain beautification audio data corresponding to the current audio data according to the inflexion audio data.
In an optional implementation manner, the sound processing unit 402 is configured to, if the inflexion processing is equalization processing, input the current audio data into a filter bank in the DSP chip according to a target equalization sound effect selected from a set equalization sound effect set to obtain equalization audio data, and use the equalization audio data as the inflexion audio data, where a number of frequency bands corresponding to the filter bank is an integer greater than 1.
In an optional implementation manner, the sound processing unit 402 is configured to, if the tonal modification processing is tonal modification processing, perform tonal modification processing on the current audio data according to a target tonal modification sound effect selected from a set tonal modification sound effect set through a preset tonal modification algorithm arranged in the DSP chip to obtain tonal modification audio data, and use the tonal modification audio data as the tonal modification audio data.
In an alternative embodiment, the sound processing unit 402 is configured to process the current audio data through a variable speed algorithm to obtain variable speed audio data; and processing the variable speed audio data through a resampling algorithm to obtain the tonal modification audio data, wherein the tonal modification audio data has the same sound speed as the current audio data, and the preset tonal modification algorithm comprises the variable speed algorithm and the resampling algorithm.
In an optional implementation manner, the sound processing unit 402 is configured to, if the inflexion processing is reverberation processing, perform reverberation processing on the current audio data according to a target reverberation sound effect selected from a set reverberation sound effect set by using a simulated reverberation algorithm arranged in the DSP chip to obtain reverberation audio data, and use the reverberation audio data as inflexion audio data.
In an optional implementation, the beautification audio unit 403 is configured to obtain the beautification audio data according to the inflected audio data, where the inflected audio data includes at least one of the equalized audio data, the inflected audio data, and the reverberation audio data.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 5 is a block diagram of an electronic device 800 illustrating a method of sound adjustment according to an example embodiment. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, a voice pen, a smart headset, and the like.
Referring to fig. 5, electronic device 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/presentation (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 806 provides power to the various components of the electronic device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.
The multimedia component 808 includes a screen that provides a presentation interface between the electronic device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to present and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for presenting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the electronic device 800. For example, the sensor assembly 814 may detect an open/closed state of the device 800, the relative positioning of components, such as a display and keypad of the electronic device 800, the sensor assembly 814 may also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, orientation or acceleration/deceleration of the electronic device 800, and a change in the temperature of the electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the electronic device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium having instructions therein, which when executed by a processor of a mobile terminal, enable the mobile terminal to perform a sound adjustment method, the method comprising:
acquiring current audio data in real time;
performing inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data, wherein the inflexion processing comprises at least one of equalization processing, tonal modification processing and reverberation processing;
and obtaining beautification audio data corresponding to the current audio data according to the variable audio data.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is only limited by the appended claims
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (13)
1. A sound conditioning method, characterized in that the method comprises:
acquiring current audio data in real time;
performing inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data, wherein the inflexion processing comprises at least one of equalization processing, tonal modification processing and reverberation processing;
and obtaining beautification audio data corresponding to the current audio data according to the variable audio data.
2. The method of claim 1, wherein the obtaining of inflexion audio data by performing inflexion processing on the current audio data through a DSP chip respectively comprises:
and if the sound changing processing is equalization processing, inputting the current audio data into a filter bank in the DSP chip according to a target equalization sound effect selected from a set equalization sound effect set to obtain equalization audio data, and taking the equalization audio data as the sound changing audio data, wherein the number of frequency bands corresponding to the filter bank is an integer larger than 1.
3. The method of claim 2, wherein the obtaining of inflexion audio data by performing inflexion processing on the current audio data through a DSP chip respectively comprises:
and if the tonal modification processing is tonal modification processing, performing tonal modification processing on the current audio data through a preset tonal modification algorithm arranged in the DSP chip according to a target tonal modification sound effect selected from a set tonal modification sound effect set to obtain tonal modification audio data, and taking the tonal modification audio data as the tonal modification audio data.
4. The method as claimed in claim 3, wherein the obtaining the tonal modification audio data by performing the tonal modification processing on the current audio data according to the target tonal modification sound effect selected from the set of tonal modification sound effects by using a preset tonal modification algorithm disposed in the DSP chip comprises:
processing the current audio data through a speed change algorithm to obtain speed change audio data; and processing the variable speed audio data through a resampling algorithm to obtain the tonal modification audio data, wherein the tonal modification audio data has the same sound speed as the current audio data, and the preset tonal modification algorithm comprises the variable speed algorithm and the resampling algorithm.
5. The method of claim 4, wherein the obtaining of inflexion audio data by performing inflexion processing on the current audio data through a DSP chip respectively comprises:
and if the pitch change processing is reverberation processing, performing reverberation processing on the current audio data through a simulated reverberation algorithm arranged in the DSP chip according to a target reverberation sound effect selected from a set reverberation sound effect set to obtain reverberation audio data, and taking the reverberation audio data as pitch change audio data.
6. The method according to any one of claims 1-5, wherein the obtaining beautification audio data corresponding to the current audio data according to the inflected audio data comprises:
obtaining the beautification audio data according to the inflected audio data, wherein the inflected audio data comprises at least one of the equalized audio data, the inflected audio data and the reverberation audio data.
7. A sound conditioning apparatus, the apparatus comprising:
the audio data acquisition unit is used for acquiring current audio data in real time;
the sound processing unit is used for respectively carrying out inflexion processing on the current audio data through a DSP chip to obtain inflexion audio data, wherein the inflexion processing comprises at least one of equalization processing, tonal modification processing and reverberation processing;
and the beautification audio unit is used for obtaining beautification audio data corresponding to the current audio data according to the inflexion audio data.
8. The apparatus of claim 7, wherein the sound processing unit is configured to, if the inflexion processing is equalization processing, input the current audio data into a filter bank in the DSP chip according to a target equalization sound effect selected from a set equalization sound effect set to obtain equalized audio data, and use the equalized audio data as the inflexion audio data, where the number of frequency bands corresponding to the filter bank is an integer greater than 1.
9. The apparatus of claim 8, wherein the sound processing unit is configured to, if the transposition process is a transposition process, perform transposition process on the current audio data according to a target transposition sound effect selected from a set of transposition sound effects through a preset transposition algorithm provided in the DSP chip to obtain transposition audio data, and use the transposition audio data as the transposition audio data.
10. The apparatus of claim 9, wherein the sound processing unit is configured to process the current audio data through a variable-speed algorithm to obtain variable-speed audio data; and processing the variable speed audio data through a resampling algorithm to obtain the tonal modification audio data, wherein the tonal modification audio data has the same sound speed as the current audio data, and the preset tonal modification algorithm comprises the variable speed algorithm and the resampling algorithm.
11. The apparatus of claim 10, wherein the sound processing unit is configured to, if the voicing process is a reverberation process, perform a reverberation process on the current audio data according to a target reverberation sound effect selected from a set reverberation sound effect set by using a simulated reverberation algorithm disposed in the DSP chip to obtain reverberation audio data, and use the reverberation audio data as the voicing audio data.
12. An electronic device comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors to execute operating instructions included in the one or more programs for performing the corresponding method according to any one of claims 1 to 6.
13. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps corresponding to the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111162688.XA CN113936676A (en) | 2021-09-30 | 2021-09-30 | Sound adjusting method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111162688.XA CN113936676A (en) | 2021-09-30 | 2021-09-30 | Sound adjusting method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113936676A true CN113936676A (en) | 2022-01-14 |
Family
ID=79277806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111162688.XA Pending CN113936676A (en) | 2021-09-30 | 2021-09-30 | Sound adjusting method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113936676A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116160955A (en) * | 2023-04-25 | 2023-05-26 | 科大讯飞(苏州)科技有限公司 | Active sound wave enhancement method and device for vehicle, storage medium and equipment |
-
2021
- 2021-09-30 CN CN202111162688.XA patent/CN113936676A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116160955A (en) * | 2023-04-25 | 2023-05-26 | 科大讯飞(苏州)科技有限公司 | Active sound wave enhancement method and device for vehicle, storage medium and equipment |
| CN116160955B (en) * | 2023-04-25 | 2023-08-29 | 科大讯飞(苏州)科技有限公司 | Active sound wave enhancement method and device for vehicle, storage medium and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109686347B (en) | Sound effect processing method, sound effect processing device, electronic equipment and readable medium | |
| CN110808063A (en) | Voice processing method and device for processing voice | |
| CN111128221B (en) | Audio signal processing method and device, terminal and storage medium | |
| CN109410973B (en) | Sound changing processing method, device and computer readable storage medium | |
| CN111179960B (en) | Audio signal processing method and device and storage medium | |
| CN111009257B (en) | Audio signal processing method, device, terminal and storage medium | |
| CN111402917B (en) | Audio signal processing method and device and storage medium | |
| CN108845787B (en) | Audio adjusting method, device, terminal and storage medium | |
| CN109524016B (en) | Audio processing method and device, electronic equipment and storage medium | |
| CN114040285B (en) | Method and device for generating feedforward filter parameters of earphone, earphone and storage medium | |
| CN111445901A (en) | Audio data acquisition method and device, electronic equipment and storage medium | |
| CN113170260B (en) | Audio processing method and device, storage medium and electronic equipment | |
| CN111654806B (en) | Audio playing method and device, storage medium and electronic equipment | |
| CN115273831A (en) | Voice conversion model training method, voice conversion method and device | |
| CN106060707B (en) | Reverberation processing method and device | |
| CN113936676A (en) | Sound adjusting method and device and electronic equipment | |
| CN106328111B (en) | Audio-frequency processing method and device | |
| CN111724801A (en) | Audio signal processing method and device and storage medium | |
| CN111667842B (en) | Audio signal processing method and device | |
| CN115065921A (en) | Method and device for preventing hearing aid from howling | |
| CN111696566A (en) | Voice processing method, apparatus and medium | |
| CN113194387A (en) | Audio signal processing method, audio signal processing device, electronic equipment and storage medium | |
| CN111429934B (en) | Audio signal processing method and device and storage medium | |
| CN113223543B (en) | Speech enhancement method, device and storage medium | |
| WO2023240887A1 (en) | Dereverberation method and apparatus, device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |