CN111796790A - Sound effect adjusting method and device, readable storage medium and terminal equipment - Google Patents
Sound effect adjusting method and device, readable storage medium and terminal equipment Download PDFInfo
- Publication number
- CN111796790A CN111796790A CN201910281281.5A CN201910281281A CN111796790A CN 111796790 A CN111796790 A CN 111796790A CN 201910281281 A CN201910281281 A CN 201910281281A CN 111796790 A CN111796790 A CN 111796790A
- Authority
- CN
- China
- Prior art keywords
- noise
- sound effect
- training
- determining
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The present invention relates to the field of sound effect adjustment technologies, and in particular, to a sound effect adjustment method and apparatus, a computer-readable storage medium, and a terminal device. The sound effect adjusting method provided by the invention comprises the following steps: acquiring a noise signal of an environment where terminal equipment is located, and determining the noise power of the noise signal; acquiring the spectral characteristics of the noise signal, and determining the noise type of the noise signal according to the spectral characteristics; and determining a target sound effect matched with the environment according to the noise type and the noise power, and adjusting the current sound effect of the terminal equipment according to the target sound effect so as to automatically adjust the playing sound effect of the terminal equipment according to the noise power and the spectral characteristic of the external environment noise, so that the convenience and the intelligence of the terminal equipment are improved, and the use experience of a user is greatly improved.
Description
Technical Field
The present invention relates to the field of sound effect adjustment technologies, and in particular, to a sound effect adjustment method and apparatus, a computer-readable storage medium, and a terminal device.
Background
At present, terminal devices such as smart speakers have gradually become an important branch in the field of artificial intelligence, and have also taken an important position in the consumer electronics market. Present terminal equipment such as intelligent audio amplifier under the circumstances of broadcast sound, often provides multiple audio and supplies user's selection or adjustment etc, but among current terminal equipment such as intelligent audio amplifier, the selection of audio or adjustment etc. often need the user to go the execution for manual, reduced terminal equipment such as intelligent audio amplifier's convenience and intellectuality, greatly influenced user's use and experienced.
Disclosure of Invention
The embodiment of the invention provides a sound effect adjusting method and device, a computer readable storage medium and a terminal device, which can realize automatic adjustment of sound effects in the terminal device, improve the convenience and intelligence of the terminal device and improve the use experience of a user.
In a first aspect of the embodiments of the present invention, a sound effect adjusting method is provided, including:
acquiring a noise signal of an environment where terminal equipment is located, and determining the noise power of the noise signal;
acquiring the spectral characteristics of the noise signal, and determining the noise type of the noise signal according to the spectral characteristics;
and determining a target sound effect matched with the environment according to the noise type and the noise power, and adjusting the current sound effect of the terminal equipment according to the target sound effect.
Further, the acquiring the noise signal of the environment where the terminal device is located includes:
acquiring a first voice signal of an environment where the terminal equipment is located;
determining a second voice signal in the first voice signal, wherein the second voice signal is located in a preset frequency spectrum range;
deleting the second voice signal from the first voice signal, and determining the first voice signal from which the second voice signal is deleted as the noise signal.
Preferably, the determining the noise power of the noise signal comprises:
performing framing processing on the noise signals, and acquiring vibration amplitude corresponding to the noise signals in each frame;
and summing and accumulating the vibration amplitudes, and determining the noise power of the noise signal according to the result of the summation and accumulation.
Optionally, the acquiring the spectral characteristics of the noise signal includes:
preprocessing the noise signal, and acquiring a noise frequency spectrum of the preprocessed noise signal through fast Fourier transform;
converting the noise spectrum into a corresponding Mel-frequency spectrum using a Mel-frequency filter;
and filtering and discrete cosine transforming the Mel frequency spectrum to obtain the frequency spectrum characteristic of the noise signal.
Further, the determining a target sound effect matched with the environment according to the noise type and the noise power includes:
and inputting the noise type and the noise power into a trained sound effect matching model to obtain a matching result output by the sound effect matching model, and determining the matching result as a target sound effect matched with the environment.
Preferably, the training process of the sound effect matching model comprises the following steps:
acquiring training noise types and training noise powers for training, and marking standard matching results of the training noise types and the corresponding training noise powers;
respectively inputting each training noise type and corresponding training noise power into an initial sound effect matching model to obtain a training matching result output by the initial sound effect matching model;
determining the training error of the current training according to the training matching result and the standard matching result;
if the training error meets a preset condition, determining that the training of the sound effect matching model is finished;
and if the training error does not meet the preset condition, adjusting the model parameters of the sound effect matching model, determining the sound effect matching model after the model parameters are adjusted as an initial sound effect matching model, and returning to execute the step of inputting each training noise type and the corresponding training noise power into the initial sound effect matching model respectively to obtain the training matching result output by the initial sound effect matching model and the subsequent steps.
In a second aspect of the embodiments of the present invention, there is provided a sound effect adjusting apparatus, including:
the noise power determination module is used for acquiring a noise signal of an environment where the terminal equipment is located and determining the noise power of the noise signal;
the noise type determining module is used for acquiring the spectral characteristics of the noise signal and determining the noise type of the noise signal according to the spectral characteristics;
and the sound effect adjusting module is used for determining a target sound effect matched with the environment according to the noise type and the noise power and adjusting the current sound effect of the terminal equipment according to the target sound effect.
In a third aspect of the embodiments of the present invention, there is provided a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the sound effect adjusting method according to the first aspect when executing the computer program.
In a fourth aspect of the embodiments of the present invention, a computer-readable storage medium is provided, where a computer program is stored, and the computer program, when executed by a processor, implements the steps of the sound effect adjusting method according to the first aspect.
According to the technical scheme, the embodiment of the invention has the following advantages:
in the embodiment of the invention, the noise signal of the environment where the terminal equipment is located can be obtained firstly, and the noise power of the noise signal is determined; secondly, acquiring the spectral characteristics of the noise signal, and determining the noise type of the noise signal according to the spectral characteristics; and finally, determining a target sound effect matched with the environment according to the noise type and the noise power, and adjusting the current sound effect of the terminal equipment according to the target sound effect. In other words, in the embodiment of the invention, the playing sound effect of the terminal equipment can be automatically adjusted according to the noise power and the spectral characteristic of the external environment noise, so that the convenience and the intelligence of the terminal equipment are improved, and the use experience of a user is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a flowchart illustrating an embodiment of a sound effect adjusting method according to the present invention;
FIG. 2 is a schematic flow chart illustrating a method for adjusting sound effects according to an embodiment of the present invention, in which a noise signal is obtained in an application scenario;
FIG. 3 is a schematic flow chart illustrating a process of obtaining spectrum characteristics in an application scenario by a sound effect adjustment method according to an embodiment of the present invention;
FIG. 4 is a schematic flow chart of a sound effect adjustment method for training a sound effect matching model in an application scenario according to an embodiment of the present invention;
FIG. 5 is a structural diagram of an embodiment of a sound effect adjusting apparatus according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The embodiment of the invention provides a sound effect adjusting method and device, a computer readable storage medium and terminal equipment, which are used for realizing automatic adjustment of sound effects in the terminal equipment, improving the convenience and intelligence of the terminal equipment and improving the use experience of a user.
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an embodiment of the present invention provides a sound effect adjusting method, where the sound effect adjusting method includes:
s101, acquiring a noise signal of an environment where terminal equipment is located, and determining the noise power of the noise signal;
the execution main body of the embodiment of the invention is a terminal device, for example, the terminal device can be an intelligent sound box, a microphone array is arranged in the terminal device such as the intelligent sound box, the microphone array can collect voice signals in the current environment of the terminal device such as the intelligent sound box from various angles, and can send the collected voice signals to a processing device in the terminal device such as the intelligent sound box, and the processing device can extract noise signals from the voice signals and determine the noise power corresponding to the noise signals.
Specifically, as shown in fig. 2, in the embodiment of the present invention, the acquiring a noise signal of an environment where the terminal device is located may include:
step S201, acquiring a first voice signal of an environment where the terminal equipment is located;
it can be understood that, when a terminal device such as a smart speaker plays or starts to play music, a microphone array in the terminal device such as the smart speaker may collect a first voice signal in an environment where the terminal device such as the smart speaker is currently located, where the collected first voice signal may include a noise signal in an external environment and a second voice signal generated by playing music in the terminal device such as the smart speaker.
Step S202, determining a second voice signal in the first voice signal, wherein the second voice signal is located in a preset frequency spectrum range;
step S203, deleting the second voice signal from the first voice signal, and determining the first voice signal from which the second voice signal is deleted as the noise signal.
As for the above step S202 and step S203, the sound effect adjustment in the embodiment of the present invention mainly adjusts the music playing effect of the terminal device such as the smart speaker according to the external environment noise in the current environment of the terminal device such as the smart speaker, so that, when the first voice signal acquired by the microphone array includes the second voice signal generated by playing music in the terminal device such as the smart speaker, the second voice signal may be filtered, that is, the second voice signal may be deleted from the first voice signal, for example, the spectral component corresponding to the second voice signal may be filtered and deleted by using a specific filter, and the first voice signal after filtering and deleting the second voice signal may be determined as the external noise signal in the current environment of the terminal device such as the smart speaker.
Here, the second speech signal is a normal music signal played by a terminal device such as an intelligent sound box, wherein a frequency spectrum of the normal music signal is located in a preset frequency spectrum range, and the determination process of the preset frequency spectrum range may specifically be: and placing terminal equipment such as an intelligent sound box and the like in an experimental environment without external noise to play music, collecting and playing the generated voice signals, and determining the preset frequency spectrum range by analyzing and playing the generated voice signals.
Further, in this embodiment of the present invention, the determining the noise power of the noise signal may include:
step a, performing framing processing on the noise signal, and acquiring the vibration amplitude corresponding to the noise signal in each frame;
and b, summing and accumulating the vibration amplitudes, and determining the noise power of the noise signal according to the result of summation and accumulation.
With regard to the above step a and step b, it can be understood that after the noise signal corresponding to the external environment is determined, the vibration amplitude corresponding to the noise signal may be further obtained, so that the noise power of the noise signal may be determined according to the vibration amplitude, for example, the noise signal may be firstly subjected to framing processing, then the vibration amplitude corresponding to the noise signal in each frame may be obtained through fourier transform, finally the vibration amplitudes corresponding to the frames may be summed and accumulated, and a result obtained by summing and accumulating may be determined as the noise power of the noise signal, where the obtained noise power may be used to characterize the volume of the noise.
Step S102, acquiring the spectral characteristics of the noise signal, and determining the noise type of the noise signal according to the spectral characteristics;
in the embodiment of the present invention, after the noise signal of the current environment of the terminal device such as the smart speaker is obtained, the spectral characteristic of the noise signal may be further obtained, for example, the spectral characteristic of the noise signal may be obtained by a mel-frequency cepstrum coefficient method, so that the noise type of the noise signal may be determined according to the spectral characteristic, so as to determine the current environment type of the current environment of the terminal device such as the smart speaker.
Further, as shown in fig. 3, in the embodiment of the present invention, the acquiring the spectral characteristic of the noise signal may include:
step S301, preprocessing the noise signal, and acquiring a noise frequency spectrum of the preprocessed noise signal through fast Fourier transform;
step S302, converting the noise spectrum into a corresponding Mel spectrum by utilizing a Mel filter;
step S303, filtering and discrete cosine transforming the Mel frequency spectrum to obtain the frequency spectrum characteristic of the noise signal.
As for the above steps S301 to S303, it can be understood that, when obtaining the spectral characteristics of the noise signal, the noise signal may be subjected to preprocessing such as windowing and framing, then, for each analysis window, the noise spectrum in the analysis window may be obtained through fast fourier transform, and after obtaining the noise spectrum in each analysis window, each noise spectrum may be converted into a corresponding Mel spectrum by using a Mel filter bank, and finally, the Mel frequency cepstrum coefficient corresponding to each Mel spectrum may be obtained by performing filtering and Discrete Cosine Transform (DCT) on each Mel spectrum, so as to obtain the spectral characteristics corresponding to the noise signal.
Here, after determining the spectral characteristic of the noise signal, the noise type of the noise signal may be determined according to the spectral characteristic, for example, whether the noise type of the noise signal is natural white noise, or speech mechanical noise, or the like is determined.
It should be noted that the spectral characteristics may include a frequency coverage range and a time variation degree of the spectral characteristics, and the noise signals may be divided into full-band noise and narrow-band noise according to the frequency coverage range, and divided into periodic noise, impulse noise, stationary noise and soft-varying noise according to the time variation degree of the spectral characteristics. In the embodiment of the present invention, determining the noise type of the noise signal according to the spectral characteristic is mainly determined according to a spectral coverage and a time variation degree of the spectral characteristic, for example, when it is determined that the noise signal is full-band noise and stationary noise, it is determined that the noise type of the noise signal is natural white noise, that is, it is determined that an environment where a terminal device such as an intelligent speaker is currently located is a natural white noise environment; and when the noise signal is determined to be narrow-band noise and periodic noise, determining that the noise type of the noise signal is voice mechanical noise, namely determining that the current environment of the terminal equipment such as the intelligent sound box is a voice mechanical noise environment.
And S103, determining a target sound effect matched with the environment according to the noise type and the noise power, and adjusting the current sound effect of the terminal equipment according to the target sound effect.
In the embodiment of the invention, after the noise type of the noise signal is determined and the noise power of the noise signal is obtained, the target sound effect matched with the environment can be determined according to the noise type and the noise power, so that the current sound effect of terminal equipment such as an intelligent sound box can be adjusted according to the target sound effect, and the playing effect of the terminal equipment such as the intelligent sound box is improved.
It should be noted that the sound effects may include volume, subwoofer effect, and music equalization effect best suitable for receiving by human ears in different environments, wherein the volume in the target sound effect is related to the noise power, and the subwoofer effect and the music equalization effect are related to the noise type, for example, the subwoofer effect required by natural white noise environment is stronger, and the sound band of the middle frequency part is best suitable for receiving by human ears in the voice mechanical noise environment.
Specifically, the volume in the target sound effect may be determined according to the noise power and the sound power currently played by the terminal device such as the smart sound box, and when the noise power exceeds or approaches the sound power currently played by the terminal device such as the smart sound box, for example, when the noise power reaches 70% or more of the sound power, it may be considered that the noise power approaches the sound power, which indicates that the playing volume currently played by the terminal device such as the smart sound box needs to be adjusted, and at this time, the determined volume in the target sound effect may be greater than the playing volume currently played by the terminal device such as the smart sound box.
Here, when it is determined that the noise type is the natural white noise, it is known that the subwoofer effect of the determined target sound effect is strong, at this time, the subwoofer effect in the current playing of the terminal devices such as the smart sound box can be strengthened according to the target sound effect, and meanwhile, the volume in the target sound effect can be determined according to the noise power and the current playing sound power of the terminal devices such as the smart sound box, so that the current playing volume of the terminal devices such as the smart sound box can be adjusted according to the determined volume, and if the noise power exceeds or approaches the sound power, the current playing volume can be increased, so that the sound power of the current playing volume exceeds the noise power; when the noise type is determined to be voice mechanical noise, it can be known that the sound wave band of the intermediate frequency part of the determined target sound effect needs to be higher, at this moment, the sound wave band of the intermediate frequency part in the music currently played by the terminal equipment such as the intelligent sound box can be automatically increased according to the target sound effect, the sound wave bands of the high frequency part and the low frequency part can be properly reduced, meanwhile, the volume of the target sound effect can be determined according to the noise power and the sound power currently played by the terminal equipment such as the intelligent sound box, and the current playing volume of the terminal equipment such as the intelligent sound box can be adjusted according to the determined volume.
It can be understood that, in an application scenario, a corresponding relationship between a target sound effect and a noise type and a corresponding noise power may be preset, and the set corresponding relationship is stored in a storage device of a terminal device such as a smart speaker, so that, after the noise type and the noise power are determined, the corresponding target sound effect may be found according to the corresponding relationship, and a current sound effect of the terminal device such as the smart speaker may be adjusted according to the found target sound effect. In another application scenario, a corresponding target sound effect can be matched by constructing a sound effect matching model, wherein the input parameters of the sound effect matching model are a noise type and a noise power, and the output result is a specific sound effect type.
Specifically, in the embodiment of the present invention, the determining the target sound effect matched with the environment according to the noise type and the noise power may include:
and inputting the noise type and the noise power into a trained sound effect matching model to obtain a matching result output by the sound effect matching model, and determining the matching result as a target sound effect matched with the environment.
Further, as shown in fig. 4, in the embodiment of the present invention, the training process of the sound effect matching model may include:
step S401, obtaining training noise types and training noise powers for training, and marking standard matching results of the training noise types and the corresponding training noise powers;
s402, inputting the training noise type and the corresponding training noise power into an initial sound effect matching model to obtain a training matching result output by the initial sound effect matching model;
step S403, determining a training error of the current training according to the training matching result and the standard matching result;
step S404, judging whether the training error meets a preset condition;
step S405, if the training error meets the preset condition, determining that the training of the sound effect matching model is finished;
step S406, if the training error does not meet the preset condition, adjusting the model parameters of the sound effect matching model, determining the sound effect matching model after the model parameters are adjusted as an initial sound effect matching model, and returning to execute the step of inputting each training noise type and the corresponding training noise power into the initial sound effect matching model to obtain the training matching result output by the initial sound effect matching model and the subsequent steps.
As for the step S401, it can be understood that, before the sound effect matching model is trained, training noise types and training noise powers for training need to be obtained in advance, and a standard matching result of each training noise type and the corresponding training noise power can be marked according to a plurality of test results, for example, music playing can be performed in a noise environment corresponding to each training noise type and each training noise power, and sound effect adjustment can be performed according to feedback of related personnel on the music playing effect, so that a sound effect corresponding to an optimal playing effect fed back by the related personnel is determined as the standard matching result corresponding to the training noise type and the corresponding training noise power.
For the step S402, after the standard matching result of each training noise type and the corresponding training noise power is marked, each training noise type and the corresponding training noise power may be respectively input into the initial sound effect matching model to obtain the training matching result of each training noise type and the corresponding training noise power output by the initial sound effect matching model, and since the sound effect matching model is not trained yet at the beginning, a certain error or deviation may exist between the output training matching result and the standard matching result at this time.
For the above steps S403 and S404, after obtaining each training matching result, a training error of the current training may be calculated according to the training matching result and the standard matching result, and it is determined whether the training error meets a preset condition, for example, whether the training error is less than 5%. The preset condition may be determined when a specific sound effect matching model is trained, for example, the preset condition may be that a training error is smaller than a specific threshold.
With respect to the above step S405 and step S406, it can be understood that when the training error satisfies the preset condition, for example, when the training error is less than 5%, it is determined that the training of the prominence matching model is completed. And when the training error does not satisfy the preset condition, for example, when the training error is 8%, the model parameters of the sound effect matching model can be adjusted, the sound effect matching model after the model parameters are adjusted can be used as an initial sound effect matching model, then training is carried out again, so that the training error of subsequent training is minimized by repeatedly adjusting the model parameters of the sound effect matching model and carrying out training for many times until the training error satisfies the preset condition.
In this scene, after the audio matching model is constructed and trained, the audio matching model can be used for quickly determining the target audio matched with the current environment of the terminal equipment such as the intelligent sound box, so that the audio can be accurately and quickly adjusted, the accuracy and the efficiency of audio adjustment are improved, the convenience and the intelligence of the terminal equipment such as the intelligent sound box are realized, and the use experience of a user is improved.
In the embodiment of the invention, the noise signal of the environment where the terminal equipment is located can be obtained firstly, and the noise power of the noise signal is determined; secondly, acquiring the spectral characteristics of the noise signal, and determining the noise type of the noise signal according to the spectral characteristics; and finally, determining a target sound effect matched with the environment according to the noise type and the noise power, and adjusting the current sound effect of the terminal equipment according to the target sound effect. In other words, in the embodiment of the invention, the playing sound effect of the terminal equipment can be automatically adjusted according to the noise power and the spectral characteristic of the external environment noise, so that the convenience and the intelligence of the terminal equipment are improved, and the use experience of a user is greatly improved.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
The above mainly describes a sound effect adjusting method, and a sound effect adjusting apparatus will be described in detail below.
Fig. 5 is a block diagram showing an embodiment of a sound effect adjusting apparatus according to an embodiment of the present invention. As shown in fig. 5, the sound effect adjusting apparatus includes:
a noise power determining module 501, configured to obtain a noise signal of an environment where a terminal device is located, and determine a noise power of the noise signal;
a noise type determining module 502, configured to obtain a spectral characteristic of the noise signal, and determine a noise type of the noise signal according to the spectral characteristic;
and the sound effect adjusting module 503 is configured to determine a target sound effect matched with the environment according to the noise type and the noise power, and adjust the current sound effect of the terminal device according to the target sound effect.
Further, the noise power determination module 501 may include:
the terminal equipment comprises a first voice signal acquisition unit, a second voice signal acquisition unit and a voice signal processing unit, wherein the first voice signal acquisition unit is used for acquiring a first voice signal of the environment where the terminal equipment is located;
the second voice signal determining unit is used for determining a second voice signal which is positioned in a preset frequency spectrum range in the first voice signal;
a noise signal determination unit configured to delete the second voice signal from the first voice signal, and determine the first voice signal from which the second voice signal is deleted as the noise signal.
Preferably, the noise power determination module 501 may further include:
the vibration amplitude acquisition unit is used for performing framing processing on the noise signals and acquiring vibration amplitude corresponding to the noise signals in each frame;
and the noise power determining unit is used for summing and accumulating the vibration amplitudes and determining the noise power of the noise signal according to the result of summation and accumulation.
Optionally, the noise type determining module 502 may include:
the noise spectrum acquisition unit is used for preprocessing the noise signal and acquiring the noise spectrum of the preprocessed noise signal through fast Fourier transform;
a noise spectrum conversion unit for converting the noise spectrum into a corresponding Mel spectrum using a Mel filter;
and the spectrum characteristic acquisition unit is used for carrying out filtering and discrete cosine transform on the Mel spectrum to obtain the spectrum characteristic of the noise signal.
Further, the sound effect adjusting module 503 may include:
and the target sound effect determining unit is used for inputting the noise type and the noise power into the trained sound effect matching model to obtain a matching result output by the sound effect matching model, and determining the matching result as a target sound effect matched with the environment.
Preferably, the sound effect adjusting module 503 may further include:
the training noise acquisition unit is used for acquiring training noise types and training noise power for training and marking a standard matching result of each training noise type and the corresponding training noise power;
the training unit is used for respectively inputting the training noise types and the corresponding training noise powers into an initial sound effect matching model to obtain a training matching result output by the initial sound effect matching model;
the training error determining unit is used for determining the training error of the current training according to the training matching result and the standard matching result;
a training completion determining unit, configured to determine that the training of the sound effect matching model is completed if the training error meets a preset condition;
and the model parameter adjusting unit is used for adjusting the model parameters of the sound effect matching model if the training error does not meet the preset condition, determining the sound effect matching model after the model parameters are adjusted as an initial sound effect matching model, and returning to execute the step of inputting each training noise type and the corresponding training noise power into the initial sound effect matching model respectively to obtain the training matching result output by the initial sound effect matching model and the subsequent steps.
Fig. 6 is a schematic diagram of a terminal device according to an embodiment of the present invention. As shown in fig. 6, the terminal device 6 of this embodiment includes: a processor 60, a memory 61 and a computer program 62, such as a sound effect adjustment program, stored in said memory 61 and executable on said processor 60. The processor 60 executes the computer program 62 to implement the steps of the sound effect adjusting method embodiments, such as the steps S101 to S103 shown in fig. 1. Alternatively, the processor 60, when executing the computer program 62, implements the functions of each module/unit in the above-mentioned device embodiments, for example, the functions of the modules 501 to 503 shown in fig. 5.
Illustratively, the computer program 62 may be partitioned into one or more modules/units that are stored in the memory 61 and executed by the processor 60 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 62 in the terminal device 6. For example, the computer program 62 may be divided into a noise power determination module, a noise type determination module, and a sound effect adjustment module, and the specific functions of each module are as follows:
the noise power determination module is used for acquiring a noise signal of an environment where the terminal equipment is located and determining the noise power of the noise signal;
the noise type determining module is used for acquiring the spectral characteristics of the noise signal and determining the noise type of the noise signal according to the spectral characteristics;
and the sound effect adjusting module is used for determining a target sound effect matched with the environment according to the noise type and the noise power and adjusting the current sound effect of the terminal equipment according to the target sound effect.
The terminal device 6 may be a desktop computer, a notebook computer, a palm computer, an intelligent sound box, a robot, or other devices capable of outputting sound. The terminal device may include, but is not limited to, a processor 60, a memory 61. Those skilled in the art will appreciate that fig. 6 is merely an example of a terminal device 6 and does not constitute a limitation of terminal device 6 and may include more or less components than those shown, or some components in combination, or different components, for example, the terminal device may also include input output devices, network access devices, buses, etc.
The Processor 60 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or a memory of the terminal device 6. The memory 61 may also be an external storage device of the terminal device 6, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the terminal device 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the terminal device 6. The memory 61 is used for storing the computer program and other programs and data required by the terminal device. The memory 61 may also be used to temporarily store data that has been output or is to be output.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art would appreciate that the modules, elements, and/or method steps of the various embodiments described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A sound effect adjustment method, comprising:
acquiring a noise signal of an environment where terminal equipment is located, and determining the noise power of the noise signal;
acquiring the spectral characteristics of the noise signal, and determining the noise type of the noise signal according to the spectral characteristics;
and determining a target sound effect matched with the environment according to the noise type and the noise power, and adjusting the current sound effect of the terminal equipment according to the target sound effect.
2. The sound effect adjusting method according to claim 1, wherein the obtaining of the noise signal of the environment where the terminal device is located comprises:
acquiring a first voice signal of an environment where the terminal equipment is located;
determining a second voice signal in the first voice signal, wherein the second voice signal is located in a preset frequency spectrum range;
deleting the second voice signal from the first voice signal, and determining the first voice signal from which the second voice signal is deleted as the noise signal.
3. The sound effect adjustment method of claim 1 wherein the determining the noise power of the noise signal comprises:
performing framing processing on the noise signals, and acquiring vibration amplitude corresponding to the noise signals in each frame;
and summing and accumulating the vibration amplitudes, and determining the noise power of the noise signal according to the result of the summation and accumulation.
4. The sound effect adjusting method according to claim 1, wherein the obtaining the spectral characteristics of the noise signal comprises:
preprocessing the noise signal, and acquiring a noise frequency spectrum of the preprocessed noise signal through fast Fourier transform;
converting the noise spectrum into a corresponding Mel-frequency spectrum using a Mel-frequency filter;
and filtering and discrete cosine transforming the Mel frequency spectrum to obtain the frequency spectrum characteristic of the noise signal.
5. The sound effect adjustment method according to any one of claims 1-4, wherein the determining a target sound effect matching the environment according to the noise type and the noise power comprises:
and inputting the noise type and the noise power into a trained sound effect matching model to obtain a matching result output by the sound effect matching model, and determining the matching result as a target sound effect matched with the environment.
6. The sound-effect adjustment method of claim 5, wherein the training process of the sound-effect matching model comprises:
acquiring training noise types and training noise powers for training, and marking standard matching results of the training noise types and the corresponding training noise powers;
respectively inputting each training noise type and corresponding training noise power into an initial sound effect matching model to obtain a training matching result output by the initial sound effect matching model;
determining the training error of the current training according to the training matching result and the standard matching result;
if the training error meets a preset condition, determining that the training of the sound effect matching model is finished;
and if the training error does not meet the preset condition, adjusting the model parameters of the sound effect matching model, determining the sound effect matching model after the model parameters are adjusted as an initial sound effect matching model, and returning to execute the step of inputting each training noise type and the corresponding training noise power into the initial sound effect matching model respectively to obtain the training matching result output by the initial sound effect matching model and the subsequent steps.
7. An audio effect adjustment apparatus, comprising:
the noise power determination module is used for acquiring a noise signal of an environment where the terminal equipment is located and determining the noise power of the noise signal;
the noise type determining module is used for acquiring the spectral characteristics of the noise signal and determining the noise type of the noise signal according to the spectral characteristics;
and the sound effect adjusting module is used for determining a target sound effect matched with the environment according to the noise type and the noise power and adjusting the current sound effect of the terminal equipment according to the target sound effect.
8. The sound-effect adjustment device of claim 7, wherein the noise power determination module comprises:
the terminal equipment comprises a first voice signal acquisition unit, a second voice signal acquisition unit and a voice signal processing unit, wherein the first voice signal acquisition unit is used for acquiring a first voice signal of the environment where the terminal equipment is located;
the second voice signal determining unit is used for determining a second voice signal which is positioned in a preset frequency spectrum range in the first voice signal;
a noise signal determination unit configured to delete the second voice signal from the first voice signal, and determine the first voice signal from which the second voice signal is deleted as the noise signal.
9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the sound-effect adjustment method according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the sound-effect adjustment method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910281281.5A CN111796790B (en) | 2019-04-09 | 2019-04-09 | Sound effect adjusting method and device, readable storage medium and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910281281.5A CN111796790B (en) | 2019-04-09 | 2019-04-09 | Sound effect adjusting method and device, readable storage medium and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111796790A true CN111796790A (en) | 2020-10-20 |
| CN111796790B CN111796790B (en) | 2023-09-08 |
Family
ID=72805158
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910281281.5A Active CN111796790B (en) | 2019-04-09 | 2019-04-09 | Sound effect adjusting method and device, readable storage medium and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111796790B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112506341A (en) * | 2020-12-01 | 2021-03-16 | 瑞声新能源发展(常州)有限公司科教城分公司 | Vibration effect generation method and device, terminal equipment and storage medium |
| CN113793623A (en) * | 2021-08-17 | 2021-12-14 | 咪咕音乐有限公司 | Sound effect setting method, device, equipment and computer readable storage medium |
| CN114449339A (en) * | 2022-02-16 | 2022-05-06 | 深圳万兴软件有限公司 | Background sound effect conversion method and device, computer equipment and storage medium |
| CN114666706A (en) * | 2021-11-30 | 2022-06-24 | 北京达佳互联信息技术有限公司 | Sound effect enhancement method, device and system |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060018492A1 (en) * | 2004-07-23 | 2006-01-26 | Inventec Corporation | Sound control system and method |
| CN104064196A (en) * | 2014-06-20 | 2014-09-24 | 哈尔滨工业大学深圳研究生院 | Method for improving speech recognition accuracy on basis of voice leading end noise elimination |
| CN104104800A (en) * | 2014-07-25 | 2014-10-15 | Tcl通讯（宁波）有限公司 | Method for adjusting volume output of mobile terminal according to environment noises and mobile terminal |
| CN105448289A (en) * | 2015-11-16 | 2016-03-30 | 努比亚技术有限公司 | Speech synthesis method, speech synthesis device, speech deletion method, speech deletion device and speech deletion and synthesis method |
| CN105827853A (en) * | 2016-04-29 | 2016-08-03 | 维沃移动通信有限公司 | Method for controlling terminal loudspeaker volume output and mobile terminal |
| CN107371102A (en) * | 2017-08-18 | 2017-11-21 | 广东欧珀移动通信有限公司 | Control method, device and the storage medium and mobile terminal of audio broadcast sound volume |
| CN107766030A (en) * | 2017-11-13 | 2018-03-06 | 百度在线网络技术（北京）有限公司 | Volume adjusting method, device, equipment and computer-readable medium |
| CN107786709A (en) * | 2017-11-09 | 2018-03-09 | 广东欧珀移动通信有限公司 | Call noise-reduction method, device, terminal device and computer-readable recording medium |
| CN107910013A (en) * | 2017-11-10 | 2018-04-13 | 广东欧珀移动通信有限公司 | The output processing method and device of a kind of voice signal |
| CN108012035A (en) * | 2017-12-26 | 2018-05-08 | 奇酷互联网络科技（深圳）有限公司 | The tinkle of bells adjusting method, device, readable storage medium storing program for executing and intelligent terminal |
| CN108766454A (en) * | 2018-06-28 | 2018-11-06 | 浙江飞歌电子科技有限公司 | A kind of voice noise suppressing method and device |
| CN109327752A (en) * | 2018-11-01 | 2019-02-12 | 深圳市智驾实业有限公司 | Bluetooth sound pick-up, mobile unit and automobile |
| CN109559755A (en) * | 2018-12-25 | 2019-04-02 | 沈阳品尚科技有限公司 | A kind of sound enhancement method based on DNN noise classification |
-
2019
- 2019-04-09 CN CN201910281281.5A patent/CN111796790B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060018492A1 (en) * | 2004-07-23 | 2006-01-26 | Inventec Corporation | Sound control system and method |
| CN104064196A (en) * | 2014-06-20 | 2014-09-24 | 哈尔滨工业大学深圳研究生院 | Method for improving speech recognition accuracy on basis of voice leading end noise elimination |
| CN104104800A (en) * | 2014-07-25 | 2014-10-15 | Tcl通讯（宁波）有限公司 | Method for adjusting volume output of mobile terminal according to environment noises and mobile terminal |
| CN105448289A (en) * | 2015-11-16 | 2016-03-30 | 努比亚技术有限公司 | Speech synthesis method, speech synthesis device, speech deletion method, speech deletion device and speech deletion and synthesis method |
| CN105827853A (en) * | 2016-04-29 | 2016-08-03 | 维沃移动通信有限公司 | Method for controlling terminal loudspeaker volume output and mobile terminal |
| CN107371102A (en) * | 2017-08-18 | 2017-11-21 | 广东欧珀移动通信有限公司 | Control method, device and the storage medium and mobile terminal of audio broadcast sound volume |
| CN107786709A (en) * | 2017-11-09 | 2018-03-09 | 广东欧珀移动通信有限公司 | Call noise-reduction method, device, terminal device and computer-readable recording medium |
| CN107910013A (en) * | 2017-11-10 | 2018-04-13 | 广东欧珀移动通信有限公司 | The output processing method and device of a kind of voice signal |
| CN107766030A (en) * | 2017-11-13 | 2018-03-06 | 百度在线网络技术（北京）有限公司 | Volume adjusting method, device, equipment and computer-readable medium |
| CN108012035A (en) * | 2017-12-26 | 2018-05-08 | 奇酷互联网络科技（深圳）有限公司 | The tinkle of bells adjusting method, device, readable storage medium storing program for executing and intelligent terminal |
| CN108766454A (en) * | 2018-06-28 | 2018-11-06 | 浙江飞歌电子科技有限公司 | A kind of voice noise suppressing method and device |
| CN109327752A (en) * | 2018-11-01 | 2019-02-12 | 深圳市智驾实业有限公司 | Bluetooth sound pick-up, mobile unit and automobile |
| CN109559755A (en) * | 2018-12-25 | 2019-04-02 | 沈阳品尚科技有限公司 | A kind of sound enhancement method based on DNN noise classification |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112506341A (en) * | 2020-12-01 | 2021-03-16 | 瑞声新能源发展(常州)有限公司科教城分公司 | Vibration effect generation method and device, terminal equipment and storage medium |
| CN112506341B (en) * | 2020-12-01 | 2022-05-03 | 瑞声新能源发展(常州)有限公司科教城分公司 | Vibration effect generation method and device, terminal equipment and storage medium |
| CN113793623A (en) * | 2021-08-17 | 2021-12-14 | 咪咕音乐有限公司 | Sound effect setting method, device, equipment and computer readable storage medium |
| CN113793623B (en) * | 2021-08-17 | 2023-08-18 | 咪咕音乐有限公司 | Sound effect setting method, device, equipment and computer readable storage medium |
| CN114666706A (en) * | 2021-11-30 | 2022-06-24 | 北京达佳互联信息技术有限公司 | Sound effect enhancement method, device and system |
| CN114449339A (en) * | 2022-02-16 | 2022-05-06 | 深圳万兴软件有限公司 | Background sound effect conversion method and device, computer equipment and storage medium |
| CN114449339B (en) * | 2022-02-16 | 2024-04-12 | 深圳万兴软件有限公司 | Background sound effect conversion method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111796790B (en) | 2023-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111796790B (en) | Sound effect adjusting method and device, readable storage medium and terminal equipment | |
| Välimäki et al. | All about audio equalization: Solutions and frontiers | |
| CN104966522B (en) | Effect adjusting method, cloud server, stereo set and system | |
| CN109493877B (en) | Voice enhancement method and device of hearing aid device | |
| US8755545B2 (en) | Stability and speech audibility improvements in hearing devices | |
| CN111128214B (en) | Audio noise reduction method and device, electronic equipment and medium | |
| CN110111769B (en) | Electronic cochlea control method and device, readable storage medium and electronic cochlea | |
| CN112565981B (en) | Howling suppression method, howling suppression device, hearing aid, and storage medium | |
| CN110024419B (en) | Gain Phase Equalization (GPEQ) filter and tuning method | |
| CN112820315A (en) | Audio signal processing method, audio signal processing device, computer equipment and storage medium | |
| CN109493883A (en) | A kind of audio time-delay calculation method and apparatus of smart machine and its smart machine | |
| CN110956973A (en) | Echo cancellation method and device and intelligent terminal | |
| CN111640411B (en) | Audio synthesis method, device and computer readable storage medium | |
| CN116405823B (en) | Intelligent audio denoising enhancement method for bone conduction earphone | |
| Chabot-Leclerc et al. | The role of auditory spectro-temporal modulation filtering and the decision metric for speech intelligibility prediction | |
| Agcaer et al. | Optimization of amplitude modulation features for low-resource acoustic scene classification | |
| CN116884429A (en) | Audio processing method based on signal enhancement | |
| CN110390954A (en) | Method and device for evaluating quality of voice product | |
| JP6233625B2 (en) | Audio processing apparatus and method, and program | |
| CN115243183A (en) | Audio detection method, device and storage medium | |
| US8756265B1 (en) | Audio filter bank design | |
| CN111045633A (en) | Method and apparatus for detecting loudness of audio signal | |
| CN110992969B (en) | Filter bank configuration method and device of electronic cochlea | |
| CN112233693B (en) | Sound quality evaluation method, device and equipment | |
| CN107197403A (en) | A kind of terminal audio frequency parameter management method, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |