CN106548782A - The processing method and mobile terminal of acoustical signal - Google Patents

Abstract

The embodiment of the present invention discloses a sound signal processing method, and the sound signal processing method includes: acquiring a first sound signal collected by a microphone of a mobile terminal; calculating a short-time zero-crossing rate of the first sound signal, the short The time zero-crossing rate includes the zero-crossing rate of the sound in 5ms-15ms; remove the low-frequency part and high-frequency part of the first sound signal to obtain the second sound signal; obtain the energy data of the second sound signal; according to the The short-term zero-crossing rate and the energy data, remove the non-speech part of the second sound signal, to obtain a third sound signal; obtain the howling signal of the third sound signal; in the third sound signal , removing the single-frequency signal of the howling signal to obtain a fourth sound signal; amplifying and processing the fourth sound signal. The invention also discloses a corresponding mobile terminal. The sound signal processing method disclosed in the embodiment of the present invention realizes the combination of human voice recognition, suppresses or eliminates howling sound while ensuring the playback quality of human voice, and obtains better user experience.

Description

Sound signal processing method and mobile terminal

technical field

The invention relates to the technical field of mobile communication, in particular to a sound signal processing method and a mobile terminal.

Background technique

As users rely more and more on portable mobile terminals, especially mobile phones, the utilization rate of mobile terminals is also increasing. Among them, more and more users use external audio equipment connected to mobile terminals for entertainment such as real-time singing and recording synthesis. For example, applications such as mobile KTV can be installed in mobile terminals, so that users can sing and entertain in KTV-like occasions. It can be said that mobile KTV has brought more fun and convenience to users' leisure and entertainment life.

In the prior art, when using a mobile terminal and audio equipment for singing entertainment, because the sound of the audio equipment is generally relatively loud, its audio sound will be mixed with the human voice sung by the user and recorded by the microphone of the mobile terminal. When performing sound effect processing, the mobile terminal will amplify the recorded sound. When the recorded sound is amplified and louder than the sound played by the audio system, it will always be superimposed to form self-excitation, and there will be a relatively loud howling sound when it is finally played. Therefore, on the one hand, there needs to be a certain distance between the audio equipment and the microphone of the mobile terminal; on the other hand, there are relatively high requirements for the quality of the audio equipment. At present, the method of echo cancellation can also be used to eliminate the howling sound. This solution requires another microphone to collect the signal next to the audio equipment, but this solution will have a relatively large impact on the human voice, and the playback effect is poor.

Contents of the invention

Embodiments of the present invention provide a sound signal processing method and a mobile terminal to solve the problem in the prior art that it is difficult to suppress or eliminate howling sound while ensuring the quality of human voice.

On the one hand, an embodiment of the present invention provides a sound signal processing method, which is applied to a mobile terminal, and the method includes:

Obtaining the first sound signal collected by the microphone of the mobile terminal;

Calculate the short-term zero-crossing rate of the first sound signal, the short-term zero-crossing rate includes the zero-crossing rate of the sound within 5ms-15ms;

removing the low-frequency part and the high-frequency part of the first sound signal to obtain a second sound signal;

acquiring energy data of the second sound signal;

removing the non-speech part of the second sound signal according to the short-term zero-crossing rate and the energy data, to obtain a third sound signal;

acquiring a howling signal of the third sound signal;

In the third sound signal, removing the single-frequency signal of the howling signal to obtain a fourth sound signal;

Amplify and process the fourth sound signal.

On the other hand, the embodiment of the present invention also provides a mobile terminal, including:

The first obtaining module is used to obtain the first sound signal collected by the microphone of the mobile terminal;

A calculation module, configured to calculate the short-term zero-crossing rate of the first sound signal, and the short-term zero-crossing rate includes the zero-crossing rate of the sound within 5ms-15ms;

A first filtering module, configured to remove the low-frequency part and high-frequency part of the first sound signal to obtain a second sound signal;

A second acquisition module, configured to acquire energy data of the second sound signal;

A mute module, configured to remove the non-speech part of the second sound signal according to the short-term zero-crossing rate and the energy data, to obtain a third sound signal;

A third acquisition module, configured to acquire a howling signal of the third sound signal;

The second filtering module is configured to remove the single-frequency signal of the howling signal from the third sound signal to obtain a fourth sound signal;

The amplifying module is used for amplifying and processing the fourth sound signal.

The sound signal processing method provided by the embodiment of the present invention obtains the first sound signal collected by the microphone of the mobile terminal; calculates the short-term zero-crossing rate of the first sound signal, and the short-term zero-crossing rate includes 5 ms- The zero-crossing rate of the sound within 15ms; remove the low-frequency part and high-frequency part of the first sound signal to obtain a second sound signal; obtain the energy data of the second sound signal; according to the short-term zero-crossing rate and The energy data, removing the non-speech part of the second sound signal to obtain a third sound signal; obtaining the howling signal of the third sound signal; removing the howling signal from the third sound signal The single-frequency signal is obtained to obtain a fourth sound signal; the fourth sound signal is amplified and processed to achieve a combination of human voice recognition, while suppressing or eliminating howling sound while ensuring the playback quality of human voice, and obtaining a better user experience.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention For those skilled in the art, other drawings can also be obtained based on these drawings without creative work.

Fig. 1 is the flow chart of the first embodiment of the processing method of sound signal of the present invention;

Fig. 2 is the flow chart of the second embodiment of the processing method of sound signal of the present invention;

Fig. 3 is a structural block diagram of the first embodiment of the mobile terminal of the present invention;

Fig. 4 is a structural block diagram of the second embodiment of the mobile terminal of the present invention;

Fig. 5 is a structural block diagram of the third embodiment of the mobile terminal of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

first embodiment

As shown in FIG. 1 , it is a flow chart of the first embodiment of the method for processing sound signals of the present invention. The processing method of this sound signal comprises:

Step 101, acquiring a first sound signal collected by a microphone of a mobile terminal.

In the embodiment of the present invention, the first sound signal is collected by the microphone of the mobile terminal, and the first sound signal includes all sounds collected by the microphone in real time, such as human voice, music played by audio equipment, and the like. The first sound signal is obtained for further processing.

Step 102, calculating the short-term zero-crossing rate of the first sound signal.

In the embodiment of the present invention, the short-term zero-crossing rate of the first sound signal is calculated. Knownly, the zero-crossing rate (zero-crossing rate, ZCR) refers to the ratio of a sign change of a signal, for example, the signal changes from a positive number to a zero-crossing rate. Negative or reversed. This feature is widely used in the fields of speech comparison, speech recognition and music information retrieval, and is the main feature for classifying percussion sounds.

Step 103, removing the low-frequency part and the high-frequency part of the first sound signal to obtain a second sound signal.

In the embodiment of the present invention, the actual human voice frequency is generally in the range of 80 Hz-1.1 KHz, and the frequencies that are too low or too high are all non-speech frequencies, so they need to be preliminarily removed. For example, the low-frequency part and the high-frequency part of the first sound signal may be removed by a band-pass filter.

Step 104, acquiring energy data of the second sound signal.

In the embodiment of the present invention, energy data is important data for speech recognition. The energy data includes energy values corresponding to each frequency point of the second sound signal.

Step 105, according to the short-term zero-crossing rate and the energy data, remove the non-speech part of the second sound signal to obtain a third sound signal.

In the embodiment of the present invention, comprehensive analysis is carried out according to the short-term zero-crossing rate and energy data to obtain the human voice part and non-speech part of the second sound signal, and remove the non-speech part to obtain the human voice without further processing part, the third sound signal.

Step 106, acquiring a howling signal of the third sound signal.

In the embodiment of the present invention, because the human voice of the third sound signal includes both the real-time voice of the user and the human voice played by the external audio equipment, when the two parts of the human voice are self-excited, a howling signal will be generated. These howling signals will produce howling sounds when the sound is played, so these howling signals need to be further processed.

Step 107, removing the single-frequency signal of the howling signal from the third sound signal to obtain a fourth sound signal.

In the embodiment of the present invention, the third sound signal needs to be further processed to eliminate the single-frequency signal in the howling signal and restore the human voice, so as to achieve the purpose of eliminating the howling sound.

Step 108, amplifying and processing the fourth sound signal.

In the embodiment of the present invention, before the sound is played, further amplification processing is required to ensure the playback effect of the external sound.

The sound signal processing method provided by the embodiment of the present invention obtains the first sound signal collected by the microphone of the mobile terminal; calculates the short-term zero-crossing rate of the first sound signal, and the short-term zero-crossing rate includes 5 ms- The zero-crossing rate of the sound within 15ms; remove the low-frequency part and high-frequency part of the first sound signal to obtain a second sound signal; obtain the energy data of the second sound signal; according to the short-term zero-crossing rate and The energy data, removing the non-speech part of the second sound signal to obtain a third sound signal; obtaining the howling signal of the third sound signal; removing the howling signal from the third sound signal The single-frequency signal is obtained to obtain a fourth sound signal; the fourth sound signal is amplified and processed to achieve a combination of human voice recognition, while suppressing or eliminating howling sound while ensuring the playback quality of human voice, and obtaining a better user experience.

second embodiment

As shown in FIG. 2 , it is a flow chart of the second embodiment of the sound signal processing method of the present invention. The processing method of this sound signal comprises:

Step 201, acquiring a first sound signal collected by a microphone of a mobile terminal.

Step 202, calculating the short-term zero-crossing rate of the first sound signal.

Step 203, removing the low-frequency part and the high-frequency part of the first sound signal to obtain a second sound signal.

Steps 201 to 203 are the same as the corresponding steps in the first embodiment of the sound signal processing method of the present invention, and will not be repeated here.

Step 204, performing fast Fourier transform on the second sound signal to obtain spectrum data of the second sound signal.

In the embodiment of the present invention, since the Fourier transform expresses various forms of signals with sinusoidal signals, the spectral data of the second sound signal can be obtained after the Fourier transform. Fast Fourier transform (fast Fourier transform), that is, the use of computers to calculate discrete Fourier transform (DFT) is a general term for efficient and fast calculation methods, referred to as FFT, so the second sound signal can be obtained quickly by using fast Fourier transform spectrum data.

Step 205: Acquire the energy data from the frequency spectrum data, where the energy data includes energy peak signals of the second sound signal at low frequency, medium frequency, and high frequency.

In the embodiment of the present invention, the energy data can be obtained from the waveform of the frequency spectrum data. Here, the energy peak signals are respectively obtained from the low frequency, middle frequency and high frequency parts of the frequency spectrum. These energy peak signals can reflect the sound characteristics of the second sound signal, such as amplitude and so on. Specifically, the low frequency range includes 20 Hz to 1600 Hz, the middle frequency range includes 1600 Hz to 3000 Hz, and the high frequency range includes above 3000 Hz.

Step 206, analyzing the short-term zero-crossing rate and the energy data to obtain frequency data and amplitude data of the second sound signal.

In the embodiment of the present invention, the frequency data and amplitude data of the second sound signal can be obtained according to the short-term zero-crossing rate and energy data, and the short-term zero-crossing rate includes the zero-crossing rate of the sound within 5ms-15ms.

Step 207, according to the frequency data and the amplitude data, determine whether the non-speech part exists in the second sound signal.

In the embodiment of the present invention, the sound components of the second sound signal can be judged according to the frequency data and amplitude data.

Step 208, if yes, silently process the non-speech part to obtain the third sound signal.

In the embodiment of the present invention, when it is determined that there is a non-speech part in the second sound signal, the non-speech part is muted to obtain a third sound signal. Knownly, the mute process is to set the corresponding audio signal to zero, and no sound is output.

Step 209, according to the energy data, obtain the maximum energy signals of the low frequency, medium frequency and high frequency of the third sound signal.

In the embodiment of the present invention, since the howling signal generated by self-excitation has a characteristic of relatively large energy value, the maximum energy signals of the low frequency, intermediate frequency and high frequency of the third sound signal are obtained first.

Step 210, judging whether the maximum energy signal is a continuous signal.

In the embodiment of the present invention, since the howling signal not only has a large energy value, but also has a longer duration, it can be determined whether the signal is a howling signal according to these two conditions. Wherein, when the duration of the maximum energy signal is 30-40 ms, it can be judged as a continuous signal.

Step 211, if yes, determine that the maximum energy signal is a howling signal.

In the embodiment of the present invention, when the maximum energy signal is a continuous signal, it can be determined that the signal is a howling signal.

Step 212, process the third sound signal with an adaptive notch filter, remove the single-frequency signal of the howling signal, and obtain the fourth sound signal.

In the embodiment of the present invention, the adaptive notch filter controls one or some parameters of the filter according to the output of the filter, so as to automatically filter out certain frequency components. Among them, the adaptive notch filter eliminates the unknown interference contained in the basic signal in an optimal manner in a certain sense. The base signal is used as the desired response of the adaptive filter and the reference signal is used as the input to the filter. The reference signal comes from a sensor or set of sensors positioned and fed to the base signal in such a way that the innovation-bearing signal is weak or largely unpredictable.

Specifically, first set the initial frequency of the adaptive notch filter to eliminate the single-frequency signal of the howling signal, and then calculate a more accurate frequency according to the calculation result of the notch filter, and update the frequency of the notch filter and perform a cleanup operation.

Step 213, amplifying and processing the fourth sound signal.

Step 213 is the same as the corresponding step in the first embodiment of the method for processing the sound signal of the present invention, and will not be repeated here.

The sound signal processing method provided by the embodiment of the present invention obtains the first sound signal collected by the microphone of the mobile terminal; calculates the short-term zero-crossing rate of the first sound signal, and the short-term zero-crossing rate includes 5 ms- The zero-crossing rate of the sound within 15ms; removing the low-frequency part and high-frequency part of the first sound signal to obtain a second sound signal; performing fast Fourier transform on the second sound signal to obtain the second sound The spectrum data of the signal; the energy data is obtained from the spectrum data, the energy data includes the energy peak signals of the second sound signal at low frequency, medium frequency, and high frequency; the short-term zero-crossing rate and the According to the energy data, frequency data and amplitude data of the second sound signal are obtained; according to the frequency data and the amplitude data, it is judged whether there is the non-speech part in the second sound signal; if so, the mute processing According to the non-speech part, the third sound signal is obtained; according to the energy data, the maximum energy signal of the low frequency, intermediate frequency and high frequency of the third sound signal is obtained; whether the maximum energy signal is a continuous signal is judged; if , determine that the maximum energy signal is a howling signal; use an adaptive notch filter to process the third sound signal, eliminate the single-frequency signal of the howling signal, and obtain the fourth sound signal; amplify and process the Fourth sound signal. As a result, it is possible to better remove non-speech signals and process howling signals in human voices, thereby improving user experience.

The embodiments of the display method for the mobile terminal of the present invention are described in detail above. The device (ie the mobile terminal) corresponding to the above method will be further elaborated below. Wherein, the mobile terminal may be a mobile phone, a tablet computer, MP3 or MP4, and the like.

third embodiment

As shown in FIG. 3 , it is a structural block diagram of the first embodiment of the mobile terminal of the present invention. The mobile terminal 300 can implement the steps of the first embodiment of the sound signal processing method of the present invention, wherein the mobile terminal 300 includes a first acquisition module 301, a calculation module 302, a first filter module 303, and a second acquisition module 304 , a mute module 305 , a third acquisition module 306 , a second filter module 307 and an amplification module 308 .

The first obtaining module 301 is connected with the computing module 302 and is used for obtaining the first sound signal collected by the microphone of the mobile terminal.

In the embodiment of the present invention, the first sound signal is collected by the microphone of the mobile terminal, and the first sound signal includes all sounds collected by the microphone in real time, such as human voice, music played by audio equipment, and the like. The first acquiring module 301 acquires the first sound signal for further processing.

The calculating module 302 is connected with the first filtering module 303, and is used for calculating the short-term zero-crossing rate of the first sound signal.

In the embodiment of the present invention, the calculation module 302 calculates the short-term zero-crossing rate of the first sound signal. Knownly, the zero-crossing rate (zero-crossing rate, ZCR) refers to the ratio of the sign change of a signal, for example, the signal changes from Positive numbers become negative or reversed. This feature is widely used in the fields of speech comparison, speech recognition and music information retrieval, and is the main feature for classifying percussion sounds.

The first filtering module 303 is connected with the second acquiring module 304, and is used for removing the low-frequency part and the high-frequency part of the first sound signal to obtain the second sound signal.

In the embodiment of the present invention, the actual human voice frequency is generally in the range of 80 Hz-1.1 KHz, and the frequencies that are too low or too high are all non-speech signals, so they need to be preliminarily removed. For example, the first filtering module 303 may remove the low-frequency part and the high-frequency part of the first sound signal through a band-pass filter.

The second acquisition module 304 is connected to the mute module 305 and configured to acquire energy data of the second sound signal.

In the embodiment of the present invention, energy data is important data for speech recognition. The energy data includes energy values corresponding to each frequency point of the second sound signal.

The mute module 305 is connected with the third acquisition module 306, and is configured to remove the non-speech part of the second sound signal according to the short-term zero-crossing rate and the energy data, so as to obtain a third sound signal.

In the embodiment of the present invention, comprehensive analysis is carried out according to the short-term zero-crossing rate and energy data to obtain the human voice part and non-speech part of the second sound signal, and remove the non-speech part to obtain the human voice without further processing part, the third sound signal.

The third acquiring module 306 is connected to the second filtering module 307, and is configured to acquire the howling signal of the third sound signal.

In the embodiment of the present invention, since the human voice of the third sound signal includes both the real-time voice of the user and the human voice played by the external audio equipment, when the two parts of the human voice are self-excited, a howling signal will be generated. These howling signals will produce howling sounds when the sound is played, so these howling signals need to be further processed.

The second filter module 307 is connected with the amplification module 308, and is used for removing the single-frequency signal of the howling signal from the third sound signal to obtain a fourth sound signal.

In the embodiment of the present invention, the third sound signal needs to be further processed to eliminate the single-frequency signal in the howling signal and restore the human voice, so as to achieve the purpose of eliminating the howling sound.

The amplifying module 308 is configured to amplify and process the fourth sound signal.

In the embodiment of the present invention, before the sound is played, further amplification processing is required to ensure the playback effect of the external sound.

The mobile terminal provided by the embodiment of the present invention obtains the first sound signal collected by the microphone of the mobile terminal; calculates the short-time zero-crossing rate of the first sound signal, and the short-time zero-crossing rate includes 5ms-15ms The zero-crossing rate of the sound; removing the low-frequency part and the high-frequency part of the first sound signal to obtain the second sound signal; obtaining the energy data of the second sound signal; according to the short-term zero-crossing rate and the energy Data, removing the non-speech part of the second sound signal to obtain a third sound signal; obtaining the howling signal of the third sound signal; removing the single frequency of the howling signal from the third sound signal signal to obtain a fourth sound signal; the fourth sound signal is amplified and processed to achieve a combination of human voice recognition, while suppressing or eliminating howling sound while ensuring the playback quality of human voice, and obtaining a better user experience.

Fourth embodiment

As shown in FIG. 4 , it is a structural block diagram of the second embodiment of the mobile terminal of the present invention. The mobile terminal 400 can implement the steps of the second embodiment of the sound signal processing method of the present invention, wherein the mobile terminal 400 includes a first acquisition module 401, a calculation module 402, a first filter module 403, and a second acquisition module 404 , a mute module 405 , a third acquisition module 406 , a second filter module 407 and an amplification module 408 .

The first acquisition module 401 is connected with the calculation module 402 and configured to acquire the first sound signal collected by the microphone of the mobile terminal.

The calculating module 402 is connected with the first filtering module 403 and is used for calculating the short-term zero-crossing rate of the first sound signal.

The first filtering module 403 is connected with the second acquiring module 404, and is used for removing the low-frequency part and the high-frequency part of the first sound signal to obtain the second sound signal.

The first obtaining module 401, the calculating module 402 and the first filtering module 403 are the same as the corresponding modules in the first embodiment of the mobile terminal of the present invention, and will not be repeated here.

The second acquiring module 404 is connected with the mute module 405 and configured to acquire energy data of the second sound signal.

Wherein, the second acquisition module 404 includes:

The Fourier transform unit 4041 is connected to the second acquisition unit 4042, and is configured to perform fast Fourier transform on the second sound signal to obtain spectrum data of the second sound signal.

In the embodiment of the present invention, since the Fourier transform expresses various forms of signals with sinusoidal signals, the spectral data of the second sound signal can be obtained after the Fourier transform. Fast Fourier transform (fast Fouriertransform), that is, the use of computers to calculate discrete Fourier transform (DFT) efficient and fast calculation methods collectively, referred to as FFT, so the use of fast Fourier transform can quickly obtain the second sound signal spectrum data.

The second acquiring unit 4042 is configured to acquire the energy data from the frequency spectrum data, where the energy data includes energy peak signals of the second sound signal at low frequency, medium frequency, and high frequency.

In the embodiment of the present invention, the energy data can be obtained from the waveform of the frequency spectrum data. Here, the energy peak signals are respectively obtained from the low frequency, middle frequency and high frequency parts of the frequency spectrum. These energy peak signals can reflect the sound characteristics of the second sound signal, such as amplitude and so on. Specifically, the low frequency range includes 20 Hz to 1600 Hz, the middle frequency range includes 1600 Hz to 3000 Hz, and the high frequency range includes above 3000 Hz.

The mute module 405 is connected with the third acquisition module 406, and is configured to remove the non-speech part of the second sound signal according to the short-term zero-crossing rate and the energy data, so as to obtain a third sound signal.

Wherein, the mute module 405 includes:

The analyzing unit 4051 is connected with the first judging unit 4052, and is configured to analyze the short-term zero-crossing rate and the energy data, and obtain frequency data and amplitude data of the second sound signal.

In the embodiment of the present invention, the frequency data and amplitude data of the second sound signal can be obtained according to the short-term zero-crossing rate and energy data, and the short-term zero-crossing rate includes the zero-crossing rate of the sound within 5ms-15ms.

The first judging unit 4052 is connected to the mute unit 4053, and is configured to judge whether the non-speech part exists in the second sound signal according to the frequency data and the amplitude data.

In the embodiment of the present invention, the sound components of the second sound signal can be judged according to the frequency data and amplitude data.

The mute unit 4053 is configured to mute the non-speech part to obtain the third sound signal.

In the embodiment of the present invention, when it is determined that there is a non-speech part in the second sound signal, the non-speech part is muted to obtain a third sound signal. Knownly, the mute process is to set the corresponding audio signal to zero, and no sound is output.

The third acquiring module 406 is connected with the second filtering module 407, and is configured to acquire the howling signal of the third sound signal.

Wherein, the third acquisition module 406 includes:

The first acquiring unit 4061 is connected with the second judging unit 4062, and is configured to acquire the maximum energy signals of the low frequency, medium frequency and high frequency of the third sound signal according to the energy data.

In the embodiment of the present invention, since the howling signal generated by self-excitation has a characteristic of relatively large energy value, the maximum energy signals of the low frequency, intermediate frequency and high frequency of the third sound signal are obtained first.

The second judging unit 4062 is connected to the determining unit 4063, and is used for judging whether the maximum energy signal is a continuous signal.

In the embodiment of the present invention, since the howling signal not only has a large energy value, but also has a longer duration, it can be determined whether the signal is a howling signal according to these two conditions. Wherein, when the duration of the maximum energy signal is 30-40 ms, it can be judged as a continuous signal.

A determining unit 4063, configured to determine that the maximum energy signal is a howling signal.

In the embodiment of the present invention, when the maximum energy signal is a continuous signal, it can be determined that the signal is a howling signal.

The second filter module 407 is connected with the amplification module 408, and is used for removing the single-frequency signal of the howling signal from the third sound signal to obtain a fourth sound signal.

Specifically, the second filtering module 407 includes:

The filtering unit 4071 is configured to use an adaptive notch filter to process the third sound signal, remove the single-frequency signal of the howling signal, and obtain the fourth sound signal.

In the embodiment of the present invention, the adaptive notch filter controls one or some parameters of the filter according to the output of the filter, so as to automatically filter out certain frequency components. Among them, the adaptive notch filter eliminates the unknown interference contained in the basic signal in an optimal manner in a certain sense. The base signal is used as the desired response of the adaptive filter and the reference signal is used as the input to the filter. The reference signal comes from a sensor or set of sensors positioned and fed to the base signal in such a way that the innovation-bearing signal is weak or largely unpredictable.

Specifically, first set the initial frequency of the adaptive notch filter to eliminate the single-frequency signal of the howling signal, and then calculate a more accurate frequency according to the calculation result of the notch filter, and update the frequency of the notch filter and perform a cleanup operation.

The amplification module 408 is configured to amplify and process the fourth sound signal.

The amplifying module 408 is the same as the corresponding module in the first embodiment of the mobile terminal of the present invention, and will not be repeated here.

The mobile terminal provided by the embodiment of the present invention obtains the first sound signal collected by the microphone of the mobile terminal; calculates the short-time zero-crossing rate of the first sound signal, and the short-time zero-crossing rate includes 5ms-15ms The zero-crossing rate of the sound; removing the low-frequency part and the high-frequency part of the first sound signal to obtain a second sound signal; performing fast Fourier transform on the second sound signal to obtain the spectrum of the second sound signal data; obtain the energy data from the spectrum data, the energy data includes the energy peak signals of the second sound signal at low frequency, intermediate frequency, and high frequency; analyze the short-term zero-crossing rate and the energy data , to obtain frequency data and amplitude data of the second sound signal; according to the frequency data and the amplitude data, judge whether there is the non-speech part in the second sound signal; if so, silently process the non-speech part, obtain the third sound signal; according to the energy data, obtain the maximum energy signal of the low frequency, intermediate frequency and high frequency of the third sound signal; judge whether the maximum energy signal is a continuous signal; if so, determine the The maximum energy signal is a howling signal; the third sound signal is processed by using an adaptive notch filter to eliminate the single-frequency signal to obtain the fourth sound signal; and the fourth sound signal is amplified and processed. As a result, it is possible to better remove non-speech and process howling signals in human voices, thereby improving user experience.

fifth embodiment

Fig. 5 is a structural block diagram of the third embodiment of the mobile terminal of the present invention. The mobile terminal 800 shown in FIG. 5 includes: at least one processor 801 , memory 802 , at least one network interface 804 , user interface 803 and other components 806 , and the other components 806 include an eye tracking sensor and a front camera. Various components in the mobile terminal 800 are coupled together through a bus system 805 . It can be understood that the bus system 805 is used to realize connection and communication between these components. In addition to the data bus, the bus system 805 also includes a power bus, a control bus and a status signal bus. However, the various buses are labeled as bus system 805 in FIG. 5 for clarity of illustration.

Wherein, the user interface 803 may include a display, a keyboard, or a pointing device (for example, a mouse, a trackball (trackball), a touch panel, or a touch screen, and the like.

It can be understood that the memory 802 in the embodiment of the present invention may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electronically programmable Erase Programmable Read-Only Memory (Electrically EPROM, EEPROM) or Flash. The volatile memory can be Random Access Memory (RAM), which acts as an external cache. By way of illustration and not limitation, many forms of RAM are available such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data RateSDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (Synchlink DRAM, SLDRAM) and Direct memory bus random access memory (DirectRambus RAM, DRRAM). The memory 802 of the systems and methods described in embodiments of the present invention is intended to include, but is not limited to, these and any other suitable types of memory.

In some implementations, the memory 802 stores the following elements, executable modules or data structures, or their subsets, or their extended sets: an operating system 8021 and an application program 8022 .

Among them, the operating system 8021 includes various system programs, such as framework layer, core library layer, driver layer, etc., for realizing various basic services and processing hardware-based tasks. The application program 8022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., and is used to implement various application services. The program for realizing the method of the embodiment of the present invention may be included in the application program 8022 .

In the embodiment of the present invention, by calling the program or instruction stored in the memory 802, specifically, the program or instruction stored in the application program 8022, the processor 801 is used to obtain the first sound signal collected by the microphone of the mobile terminal; Obtain the short-term zero-crossing rate of the first sound signal, the short-time zero-crossing rate includes the zero-crossing rate of the sound within 5ms-15ms; remove the low-frequency part and high-frequency part of the first sound signal to obtain the second Two sound signals; acquiring energy data of the second sound signal; removing the non-speech part of the second sound signal according to the short-term zero-crossing rate and the energy data to obtain a third sound signal; obtaining the A howling signal of the third sound signal; removing the single-frequency signal of the howling signal from the third sound signal to obtain a fourth sound signal; amplifying and processing the fourth sound signal.

The methods disclosed in the foregoing embodiments of the present invention may be applied to the processor 801 or implemented by the processor 801 . The processor 801 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 801 or instructions in the form of software. The above-mentioned processor 801 may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other available Program logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like. The steps of the methods disclosed in the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, register. The storage medium is located in the memory 802, and the processor 801 reads the information in the memory 802, and completes the steps of the above method in combination with its hardware.

It can be understood that the embodiments described in the embodiments of the present invention may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing device (DSP Device, DSPD), programmable logic Device (Programmable Logic Device, PLD), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), general-purpose processor, controller, microcontroller, microprocessor, other electronic units for performing the functions described in this application or a combination thereof.

For software implementation, the techniques described in the embodiments of the present invention may be implemented through modules (such as procedures, functions, etc.) that execute the functions described in the embodiments of the present invention. Software codes can be stored in memory and executed by a processor. Memory can be implemented within the processor or external to the processor.

Optionally, the processor 801 is further configured to: analyze the short-term zero-crossing rate and the energy data to obtain frequency data and amplitude data of the second sound signal; according to the frequency data and the amplitude data, Judging whether the non-speech part exists in the second sound signal; if yes, silently processing the non-speech part to obtain the third sound signal.

Optionally, the processor 801 is further configured to: acquire, according to the energy data, the maximum energy signals of the low frequency, medium frequency, and high frequency of the third sound signal; determine whether the maximum energy signal is a continuous signal; if so, determine The maximum energy signal is a howling signal.

Optionally, the processor 801 is further configured to: use an adaptive notch filter to process the third sound signal, remove a single-frequency signal of the howling signal, and obtain the fourth sound signal.

Optionally, the processor 801 is further configured to: perform a fast Fourier transform on the second sound signal to obtain spectral data of the second sound signal; obtain the energy data from the spectral data, the The energy data includes energy peak signals of the second sound signal at low frequency, medium frequency, and high frequency.

The mobile terminal 800 can implement various processes implemented by the mobile terminal in the foregoing embodiments, and details are not repeated here to avoid repetition.

The mobile terminal 800 provided in the embodiment of the present invention obtains the first sound signal collected by the microphone of the mobile terminal; calculates the short-term zero-crossing rate of the first sound signal, and the short-time zero-crossing rate includes 5ms-15ms The zero-crossing rate of the sound; remove the low-frequency part and high-frequency part of the first sound signal to obtain the second sound signal; obtain the energy data of the second sound signal; according to the short-term zero-crossing rate and the Energy data, removing the non-speech part of the second sound signal to obtain a third sound signal; obtaining the howling signal of the third sound signal; removing a single part of the howling signal from the third sound signal frequency signal to obtain a fourth sound signal; the fourth sound signal is amplified and processed to achieve a combination of human voice recognition, while suppressing or eliminating howling sound while ensuring the playback quality of human voice, and obtaining a better user experience.

Those of ordinary skill in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed in the embodiments of the present invention can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the embodiments provided in this application, it should be understood that the disclosed devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media capable of storing program codes such as U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk.

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (10)

1. a kind of processing method of acoustical signal, it is characterised in that include：

Obtain the first acoustical signal of the mike collection of mobile terminal；

The short-time zero-crossing rate of first acoustical signal is calculated, the short-time zero-crossing rate includes the sound in 5ms-15ms Zero-crossing rate；

The low frequency part and HFS of first acoustical signal are removed, second sound signal is obtained；

Obtain the energy datum of the second sound signal；

The non-speech portion of the second sound signal according to the short-time zero-crossing rate and the energy datum, is removed, the is obtained Three acoustical signals；

Obtain the signal of uttering long and high-pitched sounds of the 3rd acoustical signal；

In the 3rd acoustical signal, the simple signal of signal of uttering long and high-pitched sounds described in removal obtains falling tone message number；

Falling tone message number described in processing and amplifying.

2. method according to claim 1, it is characterised in that described according to the zero-crossing rate and the energy datum, goes Except the non-speech portion of the second sound signal, the step of obtain three acoustical signals, including：

The short-time zero-crossing rate and the energy datum are analyzed, the frequency data and amplitude number of the second sound signal are obtained According to；

According to the frequency data and the amplitude data, in judging the second sound signal, whether there is the non-voice portion Point；

If so, non-speech portion described in silence processing, obtains the 3rd acoustical signal.

3. method according to claim 1, it is characterised in that the signal of uttering long and high-pitched sounds of the acquisition the 3rd acoustical signal Step, including：

According to the energy datum, the low frequency of acquisition the 3rd acoustical signal, intermediate frequency, the ceiling capacity signal of high frequency；

Judge whether the ceiling capacity signal is persistent signal；

If so, the ceiling capacity signal is determined for signal of uttering long and high-pitched sounds.

4. method according to claim 1, it is characterised in that described in the 3rd acoustical signal, removes the howl The simple signal of signal is, the step of obtain falling tone message, including：

Process the 3rd acoustical signal using adaptive notch filter, remove described in utter long and high-pitched sounds the simple signal of signal, obtain The falling tone message number.

5. method according to claim 1, it is characterised in that the energy datum of the acquisition second sound signal Step, including：

Fast Fourier transform is carried out to the second sound signal, the frequency spectrum data of the second sound signal is obtained；

Obtain the energy datum from the frequency spectrum data, the energy datum include the second sound signal low frequency, The energy peak signal of intermediate frequency, high frequency.

6. a kind of mobile terminal, it is characterised in that include：

First acquisition module, the first acoustical signal that the mike for obtaining mobile terminal is gathered；

Computing module, for being calculated the short-time zero-crossing rate of first acoustical signal, the short-time zero-crossing rate includes 5ms- The zero-crossing rate of the sound in 15ms；

First filtration module, for removing the low frequency part and HFS of first acoustical signal, obtains rising tone message Number；

Second acquisition module, for obtaining the energy datum of the second sound signal；

Quiet module, for according to the short-time zero-crossing rate and the energy datum, removing the non-language of the second sound signal Line point, obtains the 3rd acoustical signal；

3rd acquisition module, for obtaining the signal of uttering long and high-pitched sounds of the 3rd acoustical signal；

Second filtration module, for the simple signal of signal of in the 3rd acoustical signal, uttering long and high-pitched sounds described in removal, obtains the 4th Acoustical signal；

Amplification module, for falling tone message number described in processing and amplifying.

7. mobile terminal according to claim 6, it is characterised in that the quiet module includes：

Analytic unit, for analyzing the short-time zero-crossing rate and the energy datum, obtains the frequency of the second sound signal Data and amplitude data；

First judging unit, for according to the frequency data and the amplitude data, in judging the second sound signal being It is no to there is the non-speech portion；

Quiet unit, for non-speech portion described in silence processing, obtains the 3rd acoustical signal.

8. mobile terminal according to claim 6, it is characterised in that the 3rd acquisition module includes：

First acquisition unit, for according to the energy datum, obtaining the low frequency of the 3rd acoustical signal, intermediate frequency, high frequency Ceiling capacity signal；

Second judging unit, for judging whether the ceiling capacity signal is persistent signal；

Determining unit, for determining the ceiling capacity signal for signal of uttering long and high-pitched sounds.

9. mobile terminal according to claim 6, it is characterised in that second filtration module includes：

Filter unit, for processing the 3rd acoustical signal using adaptive notch filter, remove described in utter long and high-pitched sounds signal Simple signal, obtains the falling tone message number.

10. mobile terminal according to claim 6, it is characterised in that second acquisition module includes：

Fourier transform unit, for carrying out fast Fourier transform to the second sound signal, obtains the second sound The frequency spectrum data of signal；

Second acquisition unit, for the energy datum is obtained from the frequency spectrum data, the energy datum includes described Two acoustical signals low frequency, intermediate frequency, high frequency energy peak signal.