CN109461455B - System and method for eliminating howling - Google Patents
System and method for eliminating howling Download PDFInfo
- Publication number
- CN109461455B CN109461455B CN201811455923.0A CN201811455923A CN109461455B CN 109461455 B CN109461455 B CN 109461455B CN 201811455923 A CN201811455923 A CN 201811455923A CN 109461455 B CN109461455 B CN 109461455B
- Authority
- CN
- China
- Prior art keywords
- howling
- signal
- audio signal
- audio
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
Abstract
The invention discloses a system and a method for eliminating howling, wherein the system comprises an acquisition end and a playing end, and the acquisition end comprises: the detection module is used for detecting whether a howling signal exists in the acquired audio signals; the first processing module is used for performing howling suppression processing on the howling signal when the audio signal comprises the howling signal, and calculating a gain value of howling frequency in the audio signal after the howling suppression processing; the sending module is used for sending the data packet comprising the audio signal and the gain value after the howling suppression processing to a playing end; the playing end comprises: the receiving module is used for receiving the data packet; and the second processing module is used for controlling the audio signal after the howling suppression processing according to the gain value in the data packet. According to the scheme, the howling signal is thoroughly inhibited, the howling signal in the hearing range does not exist in the audio signal played by the playing end, and the user experience is improved.
Description
Technical Field
The present invention relates to the field of audio signal processing technologies, and in particular, to a method and a system for eliminating howling.
Background
In the prior art, the application of voice chat is more and more extensive, such as teleconference, video conference, etc. In the voice chat, if the echo of the terminal at one end is not completely eliminated and then the echo of the terminal is transmitted to the terminal at the other end along with the audio signal when the audio signal is transmitted to the terminal at the other end, a gain closed loop is formed to generate howling;
in the prior art, the method for eliminating howling is to use a frequency shift method at one end (the playing end or the acquisition end) to shift the howling to a high frequency, so as to avoid strong gain at a fixed frequency. The frequency shift method affects the sound quality, and users sensitive to the sound quality can easily hear the method, so the user experience effect of the method for eliminating howling in the prior art is not good.
Disclosure of Invention
The embodiment of the invention aims to provide a method and a system for eliminating howling, so as to solve the technical problem that the howling is eliminated by adopting a frequency shift method in the prior art, and the user experience effect is not good.
To solve the above technical problem, the embodiment of the present invention is implemented as follows:
the system for eliminating howling provided by the embodiment of the invention comprises an audio signal acquisition end and a playing end, wherein the acquisition end comprises:
the detection module is used for detecting whether the acquired audio signals contain howling signals or not;
the first processing module is used for performing howling suppression processing on the howling signal when the audio signal comprises the howling signal, and calculating a gain value of howling frequency in the audio signal after the howling suppression processing;
the sending module is used for sending the data packet comprising the audio signal subjected to the howling suppression processing and the gain value to a playing end;
the playing end comprises:
a receiving module, configured to receive the data packet;
and the second processing module is used for controlling the gain value of the audio signal after the howling suppression processing according to the gain value in the data packet.
In one embodiment, the detection module specifically includes:
the first determination unit is used for determining a suspicious howling signal and the state of the suspicious howling signal; wherein the state is true or false;
the statistical unit is used for counting the howling states of a plurality of audio frames before the time point corresponding to the suspicious howling signal with the true state;
the second determining unit is used for determining that the suspected howling signal is the howling signal when the suspected howling audio signal determining unit determines that the state of the suspected signal is true and the statistical unit counts that the howling states of a plurality of audio frames before the time point corresponding to the suspected signal are all true;
and the suspicious howling signals are frequency points of the audio signals, wherein the energy of the frequency points meets preset requirements.
In one embodiment, the apparatus further comprises a feedback module configured to:
and when the specific gravity of the residual howling energy in the audio signal after the howling suppression processing is not less than a preset value, adjusting the bandwidth of the harmonic signal and the gain value of the howling frequency, and feeding back the adjusted audio signal to the first processing module.
In one embodiment, the first processing module includes:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring the howling state of an audio signal and an audio frame and an index corresponding to the howling;
the calculation unit is used for calculating the frequency of the howling signal and the energy and the bandwidth corresponding to the harmonic wave if the howling state is true;
and the wave trap determining unit is used for determining howling suppression bandwidth and gain of the wave trap according to the preset value, the frequency of the howling signal, the energy corresponding to the harmonic wave and the bandwidth, and filtering the audio signal to suppress the howling signal.
In one embodiment of the present invention,
the first processing module is further configured to:
coding the audio signal after the howling suppression processing and the gain value of the howling frequency;
the second processing module is further configured to:
and decoding the audio signal subjected to the howling suppression processing and the gain value of the howling frequency from the data packet.
According to the method for eliminating howling provided by the embodiment of the invention, the method comprises the following steps:
the method comprises the steps that a collecting end detects whether a howling signal exists in collected audio signals;
when the audio signal comprises a howling signal, carrying out howling suppression processing on the howling signal, and calculating a gain value of howling frequency in the audio signal after the howling suppression processing;
sending the audio signal after the howling suppression processing and the data packet of the gain value to a playing end;
the playing end receives the data packet;
and controlling the gain value of the audio signal after the howling suppression processing according to the gain value in the data packet.
In an embodiment, the detecting whether there is a howling signal in the collected audio signal specifically includes:
determining a suspicious howling signal and the state of the suspicious howling signal; wherein the status is true or false;
the statistical state is the howling state of a plurality of audio frames before the time point corresponding to the true suspicious howling signal;
when the suspicious howling audio signal determining unit determines that the status of the suspicious signal is true and the statistical unit counts that the howling statuses of a plurality of audio frames before the time point corresponding to the suspicious signal are all true, the suspicious howling audio signal is determined to be a howling signal.
In one embodiment, further comprising:
judging whether the proportion of the residual howling energy in the audio signal after the howling suppression processing is smaller than a preset value;
if the harmonic signal is not less than the preset value, the bandwidth of the harmonic signal and the gain value of the howling frequency are adjusted, and the adjusted audio signal is fed back to the first processing module.
In an embodiment, the performing howling suppression processing on the howling signal specifically includes:
acquiring a howling state of an audio signal and an audio frame and an index corresponding to the howling;
if the howling state is true, calculating the frequency of the howling signal and the energy and bandwidth corresponding to the harmonic wave;
and determining the bandwidth and the gain of a wave trap according to the preset value, the frequency of the howling signal, the energy corresponding to the harmonic wave and the bandwidth, and filtering the audio signal to suppress the howling signal.
In one embodiment, further comprising:
the acquisition end encodes the audio signal after the howling suppression processing and the gain value of the howling frequency;
and the playing end decodes the audio signal subjected to the howling suppression treatment and the gain value of the howling frequency from the data packet.
In the embodiment of the invention, when the acquisition end detects that the acquired audio signals comprise howling signals, the first processing module of the acquisition end performs suppression processing on the howling signals and sends the audio signals with residual howling signals and the howling frequency gain values after the suppression processing to the playing end, and the playing end is provided with the second processing module and performs gain control on the received audio signals with residual howling signals according to the howling frequency gain values received by the receiving module, so that the howling signals are completely suppressed, the howling signals in an auditory range are absent in the audio signals played by the playing end, and the user experience is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and do not limit the invention. In the drawings:
fig. 1 is a schematic structural diagram of a system for eliminating howling according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of another system for eliminating howling in an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a system for eliminating howling according to another embodiment of the present invention;
fig. 4 is a diagram of an application scenario of a system for eliminating howling according to an embodiment of the present invention;
5a-5b are schematic diagrams of audio signals and their spectrogram collected by terminal A;
fig. 6a-6b are schematic diagrams of an audio signal and a spectrogram thereof after the terminal a performs the howling suppression processing operation;
FIGS. 7a-7B are schematic diagrams and spectrograms of audio signals after the terminal B performs gain control on the audio signals with residual howling according to the gain values;
fig. 8 is a flowchart of a method for eliminating howling according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
The embodiment of the invention provides a method and a system for eliminating howling, which aim to solve the technical problem of poor user experience effect caused by the howling eliminating method in the prior art.
Referring to fig. 1, the system for eliminating howling provided by the embodiment of the present invention includes an acquisition end 11 and a playing end 12 for audio signals, where the acquisition end 11 includes, in addition to an acquisition module for acquiring audio signals,: a detection module 111, a first processing module 112 and a sending module 113. The detection module 111 is configured to detect whether a howling signal exists in the acquired audio signal; the first processing module 112 is configured to, when the audio signal includes a howling signal, perform howling suppression processing on the howling signal, and calculate a gain value of a howling frequency in the audio signal after the howling suppression processing; and a sending module 113, configured to send the data packet including the audio signal and the gain value after the howling suppression processing to a playing end.
The playing end includes a receiving module 121 and a second processing module 122 besides a playing module for playing the received audio signal, where the receiving module 121 is configured to receive the data packet sent by the sending module 113, and the second processing module 122 is configured to perform gain control on the audio signal with howling suppression processing according to a gain value in the data packet.
According to the method provided by the embodiment of the invention, when the detection module detects that the howling signal exists in the acquired audio signal, the first processing module carries out suppression processing on the detected howling signal and calculates the gain value of the howling frequency after the howling suppression processing, and the playing end carries out gain control processing on the received audio signal after the howling suppression processing of the acquisition end according to the gain value, so that the howling is thoroughly suppressed. Such as:
after the first processing module performs suppression processing on the howling signal, and the calculated gain value of the howling frequency after the howling suppression processing is 2, the playing end receives the gain value (2) of the howling frequency in the audio signal after the howling suppression processing on the audio signal after the suppression processing, and can control the gain value to reduce the gain value of the howling frequency in the audio signal after the processing of the first processing module, so that the howling signal in the received audio signal is not played, for example, the gain value is reduced to be below 1, such as 0.5, 0.3, or 0.7. Therefore, the embodiment of the invention processes the received audio signal twice, thereby thoroughly eliminating the howling signal.
In the embodiment of the present invention, referring to fig. 2, the detection module 111 specifically includes a first determination unit 1111, a statistics unit 1112, and a second determination unit 1113, where:
a first determining unit 1111, configured to determine a suspected howling signal and a state of the suspected howling signal; wherein the state is true or false;
in the embodiment of the invention, the suspicious howling point is determined according to the energy of the frequency point, namely the frequency point with the energy meeting the preset requirement is determined as the suspicious howling point. After the suspected howling point is determined, the state of the suspected howling point needs to be further judged, and the specific method may be as follows:
step one, peak search method:
in the embodiment of the invention, the frequency spectrum of the audio signal can be obtained by windowing and Fourier transform of the collected audio frame; and then searching peak values through the energy relation of adjacent frequency points, sequencing the searched peak values according to the energy sequence from large to small, and taking the first frequency points with larger energy and indexes as suspicious howling points.
And then, performing frequency domain interpolation in a certain bandwidth range around each suspected howling point one by one, and if a new peak value is obtained, replacing the corresponding suspected howling point with the new peak value.
Then, a threshold value is preset, when the average energy of the suspected howling point is greater than the threshold value, the state of the suspected howling point is true, otherwise, the state of the suspected howling point is false. As an optional implementation manner, after the average energy of the audio frame is calculated, the average energy is uniformly converted into decibels, decibels of all suspected howling points and the average energy decibel are compared, under the same decibel, when the average energy decibel is greater than a threshold, the state of the suspected howling point is true, otherwise, the state of the suspected howling point is false.
If the status of the suspected howling point is true, the second step is continued.
Step two, a harmonic energy comparison method:
and (4) calculating the odd harmonic energy of each suspected howling point, converting the odd harmonic energy into decibels, comparing the decibels of all the suspected howling points, if the decibels of all the suspected howling points are greater than a preset threshold value, judging that the suspected howling points are in a true state, and continuing to perform the third step, otherwise, judging that the suspected howling points are in a false state.
And thirdly, adjacent frequency point energy comparison method:
calculating the energy of adjacent sound frequency points of the suspected howling point, converting the energy into decibels, finally, comparing the decibel number of all the suspected howling points with the energy decibel number of the adjacent sound frequency points, if the decibel numbers are both greater than a preset threshold value, the state of the suspected howling point is true, otherwise, the state of the suspected howling point is false.
Through the judgment of the first step, the second step and the third step, if the state of the suspected howling point is still true, the state of the suspected howling point is true, otherwise, the state of the suspected howling point is false.
A counting unit 1112, configured to count howling states of a plurality of audio frames before a time point corresponding to the suspected howling signal whose state is true;
if the state of one or a plurality of suspected howling points is judged to be true through the steps, the howling states of a plurality of audio frames before the time point corresponding to the suspected howling signal with the state of true are counted. It should be noted that, the howling status of how many audio frames before the time point corresponding to the suspected howling frame is specifically counted may be set according to the requirement, and is not specifically limited herein.
A second determining unit 1113, configured to determine that the suspected howling frame is a howling frame when the suspected howling audio signal determining unit determines that the state of the suspected frame is true, and the statistical unit counts that the howling states of a plurality of audio frames before the time point corresponding to the suspected frame are all true.
In this embodiment of the present invention, if the suspected howling signal determining unit 1111 determines that the howling status of the suspected howling frame is true, and the counting unit 1112 counts that the howling statuses of a plurality of audio frames before the time point corresponding to the suspected howling frame whose howling status is true are all true, it is determined that the suspected howling frame is a howling frame.
In the embodiment of the present invention, the howling elimination system further includes a feedback module 114, configured to adjust a bandwidth of the harmonic signal and a gain value of the howling frequency when a specific gravity of energy of residual howling in the audio signal after the howling suppression processing is not less than a preset value, and feed back the adjusted audio signal to the first processing module; wherein the harmonic signal is determined according to a howling signal in the audio signal.
In the embodiment of the present invention, a preset value is set in the feedback module, and it is determined whether an energy proportion of a residual howling in an audio signal after the howling suppression processing performed by the first processing module is smaller than the preset value, so as to determine whether the audio signal after the howling suppression processing performed by the first processing module meets a requirement. When the audio signal processed by the first processing module does not meet the requirement (the energy proportion of the residual howling in the audio signal after the howling suppression processing by the first processing module is not less than the preset value), the bandwidth and the gain of the harmonic signal are adjusted, and the adjusted audio signal is fed back to the first processing module, so that the first processing module determines the suppression bandwidth and the gain value of the wave trap according to the bandwidth of the harmonic signal and the gain value of the howling frequency, and the howling suppression processing is performed on the audio signal after the howling suppression processing.
In the embodiment of the present invention, referring to fig. 3, the first processing module 112 includes an obtaining unit 1121, a calculating unit 1122, and a wave trap determining unit 1123. Wherein:
an obtaining unit 1121, configured to obtain the howling status of the current audio frame, the audio whose all the howling statuses are true, and the indexes of the audio;
in this embodiment of the present invention, the obtaining unit 1121 is configured to obtain the howling status of the current audio frame, all audio frames in the audio signal whose howling status is true, and the index of the audio frame whose howling status is true. The index is obtained in order to quickly find the corresponding audio frame through the index.
A calculating unit 1122, configured to calculate a frequency of the howling signal and an energy and a bandwidth corresponding to the harmonic if the howling state is true;
a wave trap determining unit 1123, configured to determine a howling suppression bandwidth and a gain of the wave trap according to the preset value, the frequency of the howling signal, the energy corresponding to the harmonic, and the bandwidth, and perform filtering processing on the audio signal to suppress the howling signal.
In this embodiment of the present invention, the first processing module may further include a coding unit configured to code the audio signal after the howling suppression processing and the gain value of the howling frequency, and the second processing module may include a decoding unit configured to decode the signal coded by the coding unit, so as to obtain the audio signal after the howling suppression processing and the gain value of the howling frequency.
In the embodiment of the invention, after receiving a data packet sent by an acquisition end, a receiving module of a playing end judges a howling state command, and if the audio signal contains a howling state and a howling frame, the howling suppression and the output gain control are carried out on the audio signal according to the gain value.
In the embodiment of the invention, a detection module and a first processing module can be arranged at the playing end at the same time, if the playing end does not receive a data packet which is sent by a sending end and comprises an audio signal for executing inhibition and elimination and a gain value, the detection module at the playing end detects whether the audio signal collected by the playing end has a howling signal; the first processing module is positioned at the playing end, when a howling signal exists in the audio signals collected by the playing end, the howling suppression processing is carried out on the howling signal, the gain value of the howling frequency in the audio signals after the howling suppression processing is calculated, and the second processing module can control the gain of the audio signals after the howling suppression processing according to the gain value in the data packet so as to effectively suppress the howling signal which is not completely eliminated at the receiving end or is introduced in a transmission line.
In the embodiment of the present invention, the playing end further includes an acquisition module and a first processing module in addition to the second processing module and the receiving module, so that the system for eliminating howling in the embodiment of the present invention can eliminate the howling frame in the audio signal acquired by the acquisition end, and also can eliminate the howling frame in the audio signal received by the playing end through other channels.
As follows, a specific example is illustrated:
referring to fig. 4, a terminal a and a terminal B perform a voice call, and the case that the terminal a sends voice information to the terminal B is described, where an audio signal acquired by the terminal a is shown in fig. 5a, it can be known through frequency domain analysis that howling occurs near 3kH and harmonics exist near 5.7Hz, and a spectrogram of the audio signal is shown in fig. 5B.
A first processing module of the terminal a performs howling suppression processing on the acquired howling frame, so that the amplitude of howling attenuation is greater than 20dB, but residual howling still exists, which is specifically shown in fig. 6a and 6 b. And the sending module sends the audio signal and the gain value after the howling suppression processing to a playing end.
The second processing module of the playing end controls the gain value according to the received audio signal and gain value after the howling suppression processing, so that the residual howling is finally suppressed, the speech spectrogram and the audio signal are respectively as shown in fig. 7a and 7B, and no obvious howling signal exists in the audio signal played by the terminal B.
The system for eliminating howling provided by the embodiment of the invention can effectively eliminate the howling signal in the audio signal collected by the collection end, and can inhibit the howling signal introduced by the playing end due to other reasons. The system for eliminating howling of the embodiment of the invention can thoroughly inhibit the howling signal of the acquisition end or the playing end,
based on the same idea as that of the system for eliminating howling provided by the embodiment of the present invention, the embodiment of the present invention further provides a method for eliminating howling, fig. 8 shows a flowchart of the method for eliminating howling provided by the embodiment of the present invention, and the flowchart shown in fig. 8 includes:
step S81, the acquisition end detects whether there is a howling signal in the acquired audio signals;
step S83, when the audio signal includes a howling signal, performing howling suppression processing on the howling signal, and calculating a gain value of howling frequency in the audio signal after the howling suppression processing;
step S85, sending the audio signal after squeal suppression processing and the data packet of the gain value to a playing end;
step S87, the playing end receives the data packet;
and step S89, controlling the gain value of the audio signal after the howling suppression treatment according to the gain value in the data packet.
Preferably, the detecting whether there is a howling signal in the acquired audio signal specifically includes:
determining a suspicious howling signal and the state of the suspicious howling signal; wherein the state is true or false;
counting howling states of a plurality of audio frames before a time point corresponding to a true suspicious howling signal;
when the suspicious howling audio signal determining unit determines that the status of the suspicious signal is true and the statistical unit counts that the howling statuses of a plurality of audio frames before the time point corresponding to the suspicious signal are all true, the suspicious howling audio signal is determined to be a howling signal.
Preferably, the method further comprises:
judging whether the proportion of the residual howling energy in the audio signal after the howling suppression processing is smaller than a preset value;
if the harmonic signal is not less than the preset value, the bandwidth of the harmonic signal and the gain value of the howling frequency are adjusted, and the adjusted audio signal is fed back to the first processing module.
Preferably, the performing howling suppression processing on the howling signal specifically includes:
acquiring a howling state of an audio signal and an audio frame and an index corresponding to the howling;
if the howling state is true, calculating the frequency of the howling signal and the energy and bandwidth corresponding to the harmonic wave;
and determining the bandwidth and the gain of a wave trap according to the preset value, the frequency of the howling signal, the energy corresponding to the harmonic wave and the bandwidth, and filtering the audio signal to suppress the howling signal.
Preferably, the method further comprises:
the acquisition end encodes the audio signal after the howling suppression processing and the gain value of the howling frequency;
and the playing end decodes the audio signal subjected to the howling suppression processing and the gain value of the howling frequency from the data packet.
In the method for eliminating howling provided by the embodiment of the invention, the playing end can simultaneously set the process of detecting whether a howling frame exists in the acquired audio signals and inhibiting the howling signal when the howling frame exists, namely, the playing end can also execute the step S81 and the step S83, so that the playing end can effectively inhibit the howling signal introduced by the playing end.
The method for eliminating howling provided by the embodiment of the present invention is applied to each system for eliminating howling in the system embodiments of fig. 1 to fig. 7, and is not described herein again to avoid repetition.
According to the method for eliminating howling provided by the embodiment of the invention, when a howling frame is contained in an audio signal detected and collected by a collection end, a howling suppression processing process is executed, and the audio signal with residual howling after the howling suppression processing and a gain value of howling frequency are sent to a playing end; after the playing end receives the audio signal which is sent by the acquisition end and is subjected to the howling suppression processing and the gain value of the howling frequency, the playing end performs gain control on the audio signal with the residual howling according to the gain value, so that the howling signal is completely suppressed, the audio signal played by the playing end cannot be heard as the howling signal, and the user experience is improved.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. A system for eliminating howling comprises an acquisition end and a playing end of an audio signal, and is characterized in that the acquisition end comprises:
the detection module is used for detecting whether the acquired audio signals contain howling signals or not;
the first processing module is used for performing howling suppression processing on the howling signal when the audio signal comprises the howling signal, and calculating a gain value of howling frequency in the audio signal after the howling suppression processing;
the sending module is used for sending the data packet comprising the audio signal and the gain value after the howling suppression processing to a playing end;
the playing end comprises:
a receiving module, configured to receive the data packet;
and the second processing module is used for carrying out howling suppression and output gain control on the received audio signal subjected to the acquisition end howling suppression according to the gain value in the data packet.
2. The system according to claim 1, wherein the detection module specifically includes:
the first determination unit is used for determining a suspicious howling signal and the state of the suspicious howling signal; wherein the state is true or false;
the statistical unit is used for counting the howling states of a plurality of audio frames before the time point corresponding to the suspicious howling signal with the true state;
the second determining unit is used for determining that the suspected howling signal is the howling signal when the suspected howling audio signal determining unit determines that the state of the suspected signal is true and the statistical unit counts that the howling states of a plurality of audio frames before the time point corresponding to the suspected signal are all true;
and the suspicious howling signal is a frequency point in the audio signal, wherein the energy of the frequency point meets the preset requirement.
3. The system of claim 1, further comprising a feedback module to:
when the proportion of the residual howling energy in the audio signal after the howling suppression processing is not less than a preset value, adjusting the bandwidth of a harmonic signal and the gain value of the howling frequency, and feeding back the adjusted audio signal to a first processing module;
wherein the harmonic signal is determined according to a howling signal in the audio signal.
4. The system of claim 3, wherein the first processing module comprises:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring the howling state of an audio signal and an audio frame and an index corresponding to the howling;
the calculation unit is used for calculating the frequency of the howling signal and the energy and the bandwidth corresponding to the harmonic wave if the howling state is true;
and the wave trap determining unit is used for determining howling suppression bandwidth and gain of the wave trap according to the preset value, the frequency of the howling signal, the energy corresponding to the harmonic wave and the bandwidth, and filtering the audio signal to suppress the howling signal.
5. The system according to any one of claims 1 to 4,
the first processing module is further configured to:
coding the audio signal after the howling suppression processing and the gain value of the howling frequency;
the second processing module is further configured to:
and decoding the audio signal subjected to the howling suppression processing and the gain value of the howling frequency from the data packet.
6. A method for canceling howling, comprising:
the method comprises the steps that a collecting end detects whether a howling signal exists in collected audio signals;
when the audio signal comprises a howling signal, carrying out howling suppression processing on the howling signal, and calculating a gain value of howling frequency in the audio signal after the howling suppression processing;
sending the audio signal after the howling suppression processing and the data packet of the gain value to a playing end;
the playing end receives the data packet;
and carrying out howling suppression and output gain control on the received audio signal subjected to the acquisition terminal howling suppression according to the gain value in the data packet.
7. The method according to claim 6, wherein the detecting whether there is a howling signal in the collected audio signals specifically comprises:
determining a suspicious howling signal and the state of the suspicious howling signal; wherein the state is true or false;
the statistical state is the howling state of a plurality of audio frames before the time point corresponding to the true suspicious howling signal;
when the suspicious howling audio signal determining unit determines that the state of the suspicious signal is true and the statistical unit counts that the howling states of a plurality of audio frames before the time point corresponding to the suspicious signal are all true, the suspicious howling audio signal is determined to be a howling signal.
8. The method of claim 7, further comprising:
judging whether the proportion of the residual howling energy in the audio signal after the howling suppression processing is smaller than a preset value;
if the harmonic signal is not less than the preset value, the bandwidth of the harmonic signal and the gain value of the howling frequency are adjusted, and the adjusted audio signal is fed back to the first processing module.
9. The method according to claim 8, wherein the performing howling suppression processing on the howling signal specifically includes:
acquiring a howling state of an audio signal and an audio frame and an index corresponding to the howling;
if the howling state is true, calculating the frequency of the howling signal and the energy and bandwidth corresponding to the harmonic wave;
and determining the bandwidth and the gain of a wave trap according to the preset value, the frequency of the howling signal, the energy corresponding to the harmonic wave and the bandwidth, and filtering the audio signal to suppress the howling signal.
10. The method according to any one of claims 6-9, further comprising:
the acquisition end encodes the audio signal after the howling suppression processing and the gain value of the howling frequency;
and the playing end decodes the audio signal subjected to the howling suppression treatment and the gain value of the howling frequency from the data packet.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811455923.0A CN109461455B (en) | 2018-11-30 | 2018-11-30 | System and method for eliminating howling |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811455923.0A CN109461455B (en) | 2018-11-30 | 2018-11-30 | System and method for eliminating howling |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109461455A CN109461455A (en) | 2019-03-12 |
| CN109461455B true CN109461455B (en) | 2022-08-30 |
Family
ID=65612108
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811455923.0A Active CN109461455B (en) | 2018-11-30 | 2018-11-30 | System and method for eliminating howling |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109461455B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110213694B (en) * | 2019-04-16 | 2020-12-04 | 浙江大华技术股份有限公司 | Audio device and howling processing method thereof, and computer storage medium |
| CN110505555B (en) * | 2019-08-29 | 2021-05-18 | 昆腾微电子股份有限公司 | Acoustic gain regulation and control method and device based on sound system |
| CN110708330B (en) * | 2019-10-16 | 2021-12-24 | 北京字节跳动网络技术有限公司 | Howling prevention method, device, equipment and storage medium |
| CN111210021B (en) * | 2020-01-09 | 2023-04-14 | 腾讯科技（深圳）有限公司 | Audio signal processing method, model training method and related device |
| CN114333749A (en) * | 2020-09-30 | 2022-04-12 | 腾讯科技（深圳）有限公司 | Howling suppression method, howling suppression device, computer equipment and storage medium |
| CN112349295B (en) * | 2020-10-20 | 2023-03-31 | 浙江大华技术股份有限公司 | Howling detection method and device |
| CN113299304B (en) * | 2021-05-11 | 2023-09-12 | 泰凌微电子(上海)股份有限公司 | Method and device for suppressing microphone howling and microphone |
| CN115835092B (en) * | 2023-02-15 | 2023-05-09 | 南昌航天广信科技有限责任公司 | Audio amplification feedback suppression method, system, computer and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1398054A (en) * | 2001-07-16 | 2003-02-19 | 松下电器产业株式会社 | Whistler detection and suppresser thereof, its method and computer program products |
| CN2590317Y (en) * | 2002-11-08 | 2003-12-03 | 深圳市和宏实业有限公司 | Microphone whistle eliminator |
| CN102165792A (en) * | 2008-09-24 | 2011-08-24 | 雅马哈株式会社 | Loop gain estimating apparatus and howling preventing apparatus |
| CN105812993A (en) * | 2014-12-29 | 2016-07-27 | 联芯科技有限公司 | Howling detection and suppression method and device |
| CN106657507A (en) * | 2015-11-03 | 2017-05-10 | 中移（杭州）信息技术有限公司 | Acoustic echo cancellation method and device |
| CN106782586A (en) * | 2016-11-14 | 2017-05-31 | 阔地教育科技有限公司 | A kind of acoustic signal processing method and device |
| CN108449503A (en) * | 2018-03-12 | 2018-08-24 | 广东欧珀移动通信有限公司 | Voice communication data processing method, device, storage medium and mobile terminal |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5347794B2 (en) * | 2009-07-21 | 2013-11-20 | ヤマハ株式会社 | Echo suppression method and apparatus |
-
2018
- 2018-11-30 CN CN201811455923.0A patent/CN109461455B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1398054A (en) * | 2001-07-16 | 2003-02-19 | 松下电器产业株式会社 | Whistler detection and suppresser thereof, its method and computer program products |
| CN2590317Y (en) * | 2002-11-08 | 2003-12-03 | 深圳市和宏实业有限公司 | Microphone whistle eliminator |
| CN102165792A (en) * | 2008-09-24 | 2011-08-24 | 雅马哈株式会社 | Loop gain estimating apparatus and howling preventing apparatus |
| CN105812993A (en) * | 2014-12-29 | 2016-07-27 | 联芯科技有限公司 | Howling detection and suppression method and device |
| CN106657507A (en) * | 2015-11-03 | 2017-05-10 | 中移（杭州）信息技术有限公司 | Acoustic echo cancellation method and device |
| CN106782586A (en) * | 2016-11-14 | 2017-05-31 | 阔地教育科技有限公司 | A kind of acoustic signal processing method and device |
| CN108449503A (en) * | 2018-03-12 | 2018-08-24 | 广东欧珀移动通信有限公司 | Voice communication data processing method, device, storage medium and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109461455A (en) | 2019-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109461455B (en) | System and method for eliminating howling | |
| CN107995360B (en) | Call processing method and related product | |
| CN111149370B (en) | Howling detection in a conferencing system | |
| EP2896126B1 (en) | Long term monitoring of transmission and voice activity patterns for regulating gain control | |
| CN111048119A (en) | Call audio mixing processing method and device, storage medium and computer equipment | |
| CN112004177B (en) | Howling detection method, microphone volume adjustment method and storage medium | |
| US7519347B2 (en) | Method and device for noise detection | |
| US10269371B2 (en) | Techniques for decreasing echo and transmission periods for audio communication sessions | |
| CN110956976B (en) | Echo cancellation method, device and equipment and readable storage medium | |
| CN108133712B (en) | Method and device for processing audio data | |
| CN112466319A (en) | Audio processing method and device, computer equipment and storage medium | |
| JP4894368B2 (en) | Echo canceller | |
| CN111199751B (en) | Microphone shielding method and device and electronic equipment | |
| CN110265038B (en) | Processing method and electronic equipment | |
| EP3240303B1 (en) | Sound feedback detection method and device | |
| KR101173980B1 (en) | System and method for suppressing noise in voice telecommunication | |
| EP3821429B1 (en) | Transmission control for audio device using auxiliary signals | |
| CN109218917B (en) | Automatic acoustic feedback monitoring and eliminating method in real-time communication system | |
| EP2501162A1 (en) | Method, device and system for processing downlink signal | |
| US9031245B2 (en) | Method and device for detecting acoustic shocks | |
| CN113923395A (en) | Method, equipment and storage medium for improving conference quality | |
| CN112735455A (en) | Method and device for processing sound information | |
| JP2007151047A (en) | Voice switch method, voice switch apparatus, voice switch program and recording medium recorded with the program | |
| CN114550748A (en) | Audio signal mixing processing method, device, equipment and storage medium | |
| CN115810361A (en) | Echo cancellation method, terminal device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |