EP1343352B1 - Microphone-speaker apparatus - Google Patents
Microphone-speaker apparatus Download PDFInfo
- Publication number
- EP1343352B1 EP1343352B1 EP03004360A EP03004360A EP1343352B1 EP 1343352 B1 EP1343352 B1 EP 1343352B1 EP 03004360 A EP03004360 A EP 03004360A EP 03004360 A EP03004360 A EP 03004360A EP 1343352 B1 EP1343352 B1 EP 1343352B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- power value
- component signals
- unit
- raw
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback
Definitions
- the present invention relates to a microphone-speaker apparatus, and more particularly to a microphone-speaker apparatus comprising howling sound judging means for judging whether or not a howling sound is produced while a microphone unit is receiving an audio sound outputted by a speaker unit without being affected by an amplitude of the audio sound received by the microphone unit.
- FIG. 14 The conventional microphone-speaker apparatus of this type is disclosed in pages 112-115 of the preprinted version of the Tokyo convention '95 of the Audio Engineering Society, titled "Automatic Finding and Eliminating Feedback System with DSP".
- the conventional microphone-speaker apparatus 20 is shown in FIG. 14 as comprising a microphone unit 40 for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the audio sound being constituted by a plurality of sub-band audio sounds each having an amplitude, the sub-band audio sounds respectively having frequency ranges divided along a frequency axis; audio signal dividing means 50 for dividing the audio signal received from the microphone unit 40 through an input terminal 30 into a plurality of sub-band audio signals respectively indicative of the sub-band audio sounds, each of the sub-band audio signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a current frame and a preceding frame prior to the current frame; maximum value obtaining means 60 for obtaining the maximum value from among the amplitudes of the sub-band audio signals in each of the sequential frames; and howling sound judging means 70 for judging whether or not the howling sound is produced while the microphone unit 40 is receiving the audio sound outputted
- the howling sound judging means 70 is operative to judge whether or not the howling sound is produced while the microphone unit 40 is receiving the audio sound outputted by the speaker unit 80 through steps of judging whether or not the maximum value of the amplitudes of the sub-band audio signals in each of the sequential frames exceeds a predetermined threshold value, judging whether or not the frequency range in which the maximum value of the amplitudes of the sub-band audio signals is obtained by the maximum value obtaining means 60 in the current frame is the same as the frequency range in which the maximum value of the amplitudes of the sub-band audio signals is obtained by the maximum value obtaining means 60 in the preceding frame under the condition that each of the maximum value of the amplitudes of the sub-band audio signals obtained by the maximum value obtaining means 60 in the current frame and the maximum value of the amplitudes of the sub-band audio signals obtained by the maximum value obtaining means 60 in the preceding frame exceeds a predetermined threshold value, counting a number of the sequential frame in which the judgment is made that the frequency range in which the
- the conventional microphone-speaker apparatus encounters such a problem that the judgment tends to be mistakenly made by the howling sound judging means 70 that the howling sound is produced while the microphone unit 40 is receiving the audio sound outputted by the speaker unit 80 with being remarkably affected by the amplitude of the audio sound received by the microphone unit under the condition that the microphone unit 40 is continuously receiving the audio sound represented by the raw sound wave having a relatively high amplitude at a relatively long interval.
- the microphone unit 40 When the microphone unit 40 is also receiving a background noise having a relatively high level, the judgment tends to be mistakenly made by the howling sound judging means 70 that the howling sound is produced while the microphone unit 40 is receiving the audio sound outputted by the speaker unit 80 under the condition that the microphone unit 40 is continuously receiving the audio sound represented by the raw sound wave having a relatively high amplitude during a relatively long interval.
- an object of the present invention to provide a microphone-speaker apparatus which can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- a microphone-speaker apparatus comprising: a microphone unit for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the raw sound wave being constituted by a plurality of raw wave components each having an audio frequency, and the coherent sound wave being constituted by a plurality of coherent wave components each having the audio frequency; a speaker unit for outputting the audio sound to the microphone unit, the audio sound including a howling sound represented by the coherent sound wave, and the howling sound being produced while the microphone unit is receiving the audio sound outputted by the speaker unit; audio signal dividing means for dividing the audio signal converted by the microphone unit into a plurality of raw component signals each indicative of the raw wave components, each of the raw component signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a current frame and a previous frame prior to the current frame;
- the coherent component signal extracting means may include a previous frame obtaining unit for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame divided by the audio signal dividing means, a coherent component signal extracting unit for extracting the coherent component signals, a signal difference obtaining unit for obtaining a signal difference between the raw component signals divided by the audio signal dividing means and the coherent component signals extracted by the coherent component signal extracting unit, and a signal coefficient producing unit for producing a plurality of signal coefficients in response to both the raw component signals of the previous frame obtained by the previous frame obtaining unit and the signal difference between the raw component signals of the current frame and the coherent component signals of the current frame calculated by the signal difference obtaining unit.
- the coherent component signal extracting unit may be operative to extract the coherent component signals in response to both the raw component signals of the previous frame obtained by the previous frame obtaining unit and the signal coefficients produced by the signal coefficient producing unit.
- the power value adjusting means may be operative to adjust the raw power value of each of the coherent component signals calculated by the power value calculating means to obtain an adjusted power value of each of the coherent component signals through steps of adding a first product "A" to a second product "B", the first product "A” being indicative of a predetermined coefficient value multiplied by the raw power value of each of the coherent component signals in the current frame calculated by the power value calculating means, and the second product "B" being indicative of the adjusted power value of each of the coherent component signals in the preceding frame adjusted by the power value adjusting means multiplied by a value obtained by subtracting the predetermined coefficient value from a numerical value "1".
- the power value judging means may include a previous frame obtaining unit for obtaining the coherent component signals of the previous frame in response to the coherent component signals of the current frame adjusted by the power value adjusting means, a power value judging unit for judging whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit, and a first counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit;
- the power value ratio judging means includes a power value ratio judging unit for judging whether or not the power value ratio of the adjusted power value of each of the coherent component signals to the average value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating means exceeds the predetermined first threshold value, and a second
- the microphone-speaker apparatus may further comprise raw component power calculating means for calculating the power value of each of the raw component signals divided by the audio signal dividing means; raw component power adjusting means for adjusting the power value of each of the raw component signals calculated by the raw component power calculating means to produce an adjusted power value of each of the raw component signals; and raw component power judging means for judging whether or not the power value of each of the raw component signals of the current frame exceeds the power value of each of the raw component signals of the preceding frame.
- the howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit based on each of results judged by the power value judging means, results judged by the raw component power judging means, and results judged by the power value ratio judging means.
- the raw component power judging means may include a previous frame obtaining unit for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame adjusted by the raw component power adjusting means, a power value judging unit for judging whether or not the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the adjusted power value of the raw component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit.
- the howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit during periodic intervals through steps of judging whether or not the number of the sequential frame counted by the first counter unit exceeds a predetermined second predetermined value, judging whether or not the number of the sequential frame counted by the second counter unit exceeds a predetermined third predetermined value, and judging whether or not the number of the sequential frame counted by the third counter unit exceeds a predetermined fourth predetermined value.
- the microphone-speaker apparatus may further comprise component signal estimating means for estimating and producing an estimated component signals of the current frames in response to both the raw component signals of the sequential frames divided by the audio signal dividing means and the signal coefficients produced by the signal coefficient producing unit; raw component power calculating means for calculating the power value of each of the estimated component signals estimated by the component signal estimating means; raw component power adjusting means for adjusting the power value of each of the estimated component signals calculated by the raw component power calculating means to produce an adjusted power value of each of the estimated component signals; and raw component power judging means for judging whether or not the power value of each of the estimated component signals of the current frame adjusted by the raw component power adjusting means exceeds the power value of each of the estimated component signals of the preceding frame adjusted by the raw component power adjusting means.
- the howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit based on each of results judged by the power value judging means, results judged by the raw component power judging means, and results judged by the power value ratio judging means.
- the raw component power judging means may include a previous frame obtaining unit for obtaining the estimated component signals of the previous frame in response to the estimated component signals of the current frame adjusted by the raw component power adjusting means, a power value judging unit for judging whether or not the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the adjusted power value of the estimated component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit.
- the howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit during periodic intervals through steps of judging whether or not the number of the sequential frame counted by the first counter unit exceeds a predetermined second predetermined value, judging whether or not the number of the sequential frame counted by the second counter unit exceeds a predetermined third predetermined value, and judging whether or not the number of the sequential frame counted by the third counter unit exceeds a predetermined fourth predetermined value.
- the power value judging means may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the maximum power value of the coherent component signals of the previous frame in response to the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit for judging whether or not the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit.
- the power value judging means may includes a minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the minimum power value of the coherent component signals of the previous frame in response to the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit for judging whether or not the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit.
- the raw component power judging means may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the raw component signals adjusted by the raw component power adjusting means; a previous frame obtaining unit for obtaining the maximum power value of the raw component signals of the previous frame in response to the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit for judging whether or not the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit.
- the raw component power judging means may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the raw component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the minimum power value of the raw component signals of the previous frame in response to the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit for judging whether or not the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit.
- the raw component power judging means may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the estimated component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the maximum power value of the estimated component signals of the previous frame in response to the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit for judging whether or not the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit.
- the raw component power judging means may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the estimated component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the minimum power value of the estimated component signals of the previous frame in response to the minimum power value of the raw estimated component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit for judging whether or not the minimum power value of the estimated component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the minimum power value of the estimated component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit.
- the power value calculating means may be operative to calculate each of the raw sub-band power values from the coherent component signals extracted by the coherent component signal extracting means
- the power value adjusting means may be operative to respectively adjust the raw sub-band power values calculated by the power value calculating means to produce an adjusted sub-band power values.
- the power value judging means may be operative to judging whether or not the adjusted each of the adjusted sub-band power values of the current frame exceeds each of the adjusted sub-band power values of the previous frame in each of the frequency ranges.
- the power value ratio calculating means may be operative to calculate a power value ratio of each of the adjusted sub-band power values to an average value of the adjusted sub-band power values.
- the power value ratio judging means may be operative to judge whether or not the power value ratio of each of the adjusted sub-band power values to the average value of the adjusted sub-band power values exceeds a predetermined threshold value.
- the raw component power calculating means may be operative to calculate each of the raw sub-band power values from the raw component signals divided by the audio signal dividing means.
- the raw component power adjusting means may be operative to respectively adjust the raw sub-band power values calculated by the raw component power calculating means to produce an adjusted sub-band power values.
- the raw component power judging means may be operative to judge whether or not the adjusted sub-band power values of the current frame exceeds the adjusted sub-band power value of the previous frame in each of the frequency ranges.
- the raw component power calculating means may be operative to calculate each of the raw sub-band power values from the estimated component signals estimated by the component signal estimating means, the raw sound wave being constituted by a plurality of sub-band sound wave components each having a frequency range and a raw sub-band power value.
- the raw component power adjusting means may be operative to respectively adjust the sub-band power values calculated by the raw component power calculating means to produce adjusted sub-band power values.
- the raw component power judging means may be operative to judging whether or not the each of the sub-band power values of the current frame exceeds each of the sub-band power value of the previous frame in each of the frequency ranges.
- a microphone-speaker apparatus comprising: a microphone unit for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the raw sound wave being constituted by a plurality of raw sub-band wave components each having a frequency range, and the coherent sound wave being constituted by a plurality of coherent wave components each having an audio frequency; a speaker unit for outputting the audio sound to the microphone unit, the audio sound including a howling sound represented by the coherent sound wave, and the howling sound being produced while the microphone unit is receiving the audio sound outputted by the speaker unit; audio signal dividing means for dividing the audio signal converted by the microphone unit into a plurality of raw sub-band component signals each indicative of the raw sub-band wave components, each of the raw sub-band component signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a
- the construction of the microphone-speaker apparatus 100 according to the first embodiment of the present invention will firstly be described.
- a microphone-speaker apparatus 100 comprising: a microphone unit 101 for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an analog audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the coherent sound wave including a normal sound wave and an abnormal sound wave, the raw sound wave being constituted by a plurality of raw wave components each having an audio frequency, and the coherent sound wave being constituted by a plurality of coherent wave components each having an audio frequency; an analog to digital converter (simply referred to as "A/D converter") 103 for converting the analog audio signal converted by the microphone unit 101 into a digital audio signal (simply referred to as "audio signal"); a speaker unit 102 for outputting the audio sound to the microphone unit 101, the audio sound including a howling sound represented by the abnormal sound wave, and the howling sound being produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102; audio
- A/D converter analog to digital converter
- coherent component wave herein described is intended to indicate a sine wave.
- the coherent component signal extracting means 120 includes a previous frame obtaining unit 121 for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame divided by the audio signal dividing means 110 in each of the sequential frames, a coherent component signal extracting unit 122 for extracting the coherent component signals in each of the sequential frames, a signal difference obtaining unit 123 for obtaining a signal difference between the raw component signals divided by the audio signal dividing means 110 and the coherent component signals extracted by the coherent component signal extracting unit 122 in each of the sequential frames, and a signal coefficient producing unit 124 for producing a plurality of signal coefficients in response to both the raw component signals of the previous frame obtained by the previous frame obtaining unit 121 and the signal difference between the raw component signals of the current frame and the coherent component signals of the current frame calculated by the signal difference obtaining unit 123; and the coherent component signal extracting unit 122 is operative to extract the coherent component signals in each of the sequential frames in response to both the raw component signals of the previous frame obtained by the previous frame obtaining unit 121
- the component signals divided by the audio signal dividing means 110 are adaptively filtered by the coherent component signal extracting unit 122 with reference to the component signals delayed by the previous frame obtaining unit 121 having a predetermined delay time which is previously adjusted by an operator.
- the component signals forming part of the component signals divided by the audio signal dividing means 110 hardly correlates with the coherent component of the component signals delayed by the previous frame obtaining unit 121 under the condition that the component signals are respectively delayed by the previous frame obtaining unit 121 in response to the predetermined delay time, however, the coherent components of the component signals divided by the audio signal dividing means 110, such as the howling sound, securely correlate with the coherent component of the component signals delayed by the previous frame obtaining unit 121.
- the component signals delayed by the previous frame obtaining unit 121 in response to the thus adjusted delay time are respectively inputted to the coherent component signal extracting unit 122 as a reference signals.
- the component signals delayed by the previous frame obtaining unit 121 are adaptively filtered by the coherent component signal extracting unit 122 through a step of multiplying the component signals by the signal coefficients while the signal coefficient producing unit 124 is receiving a minimum value of the mean squared error of the signal difference between the component signals divided by the audio signal dividing means 110 and the component signals filtered by the coherent component signal extracting unit 122.
- the inclined arrow of the coherent component signal extracting unit 122 shown in FIG. 1 indicates the fact that the filter coefficients are respectively updated by the signal coefficient producing unit 124 during periodic intervals. This leads to the fact the coherent components can be extracted by the coherent component signal extracting unit 122 from the component signals by using the filter coefficients updated by the filter coefficient producing unit 124 during periodic intervals.
- the signal coefficient producing unit 124 is operative to produce and update the signal coefficients in each of the sequential frames in response to both the raw component signals of the previous frame obtained by the previous frame obtaining unit 121 and the signal difference between the raw component signals of the current frame and the coherent component signals of the current frame calculated by the signal difference obtaining unit 123 based on the complex least mean square algorithm depending on a following equation (1).
- W ( k + 1 ) W ( k ) + ⁇ E ( k ) ⁇ + X ( k ) T X ( k ) ⁇ X ( k ) ⁇
- the legends "X(k)", "E(k)", and "W(k)" respectively represent the component signals, the difference signal, and the signal coefficients.
- the legends " k “, “ ⁇ “, and “ ⁇ “ further respectively represent a sequential number indicative of each of the sequential frame, a predetermined first value, and a predetermined second value.
- the legends X(k) T and X(k)* still further respectively represent a transposition of the component signals "X(k)” and a conjugation of the component signals "X(k)”.
- the complex normalized least mean square algorithm is performed by the signal coefficient producing unit 124 based on the equation (1)
- any one of the algorithms such as for example a complex least mean square algorithm, a recursive complex least squares algorithm, and a complex fast recursive least squares algorithm may be performed by the signal coefficient producing unit 124.
- the minimum value of the mean square of the signal difference is obtained by the signal coefficient producing unit 124 through step of updating the signal coefficients to be received by the coherent component signal extracting unit 122 based on the equation (1).
- the power value adjusting means 140 is operative to adjust the raw power value of each of the coherent component signals calculated by the power value calculating means 130 in each of the sequential frames to obtain an adjusted power value "P(k)" of each of the coherent component signals through steps of adding a first product "FF ⁇ P_pre(k)” to a second product "(1.0-FF) ⁇ P(k-1)", the first product "FF ⁇ P_pre(k)” being indicative of a predetermined coefficient value "FF” multiplied by the raw power value "P_pre(k)” of each of the coherent component signals in the current frame "k” calculated by the power value calculating means 130, and the second product "FF ⁇ P_pre(k)” being indicative of the adjusted power value "P(k-1)” of each of the coherent component signals in the preceding frame "k-1” adjusted by the power value adjusting means 140 multiplied by a value "1.0 - FF” obtained by subtracting the predetermined coefficient "FF” value from a numerical value "1.0".
- P ( k )
- the power value judging means 150 includes a previous frame obtaining unit 151 for obtaining the coherent component signals of the previous frame in response to the coherent component signals of the current frame adjusted by the power value adjusting means 140 in each of the sequential frames, a power value judging unit 152 for judging whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, and a first counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by a power value judging unit 152 that the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151,; the power value ratio judging means 170 includes a power value ratio judging unit 171 for judging whether or not the power value ratio of the adjusted power value of each of the
- the audio sound is firstly received by the microphone unit 101 to convert the audio sound to an analog audio signal.
- the audio signal received from the microphone unit 101 through the A/D converter 103 is then divided by the audio signal dividing means 110 in the step S101.
- the coherent component signals are respectively extracted by the coherent component signal extracting means 120 from the raw component signals divided by the audio signal dividing means 110 in each of the sequential frames in the step S102.
- the raw power value of each of the coherent component signals extracted by the coherent component signal extracting means 120 is then calculated by the power value calculating means 130 in each of the sequential frames in the step S103.
- the raw power value of each of the coherent component signals calculated by the power value calculating means 130 is then adjusted by the power value adjusting means 140 to produce an adjusted power value of each of the coherent component signals in each of the sequential frame in the step S 104.
- the coherent component signals of the previous frame is then obtained by the previous frame obtaining unit 151 forming part of the power value judging means 150 in response to the coherent component signals of the current frame adjusted by the power value adjusting means 140 in each of the sequential frames in the step S105.
- the judgment is then made by the power value judging unit 152 forming part of the power value judging means 150 whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151 in each of the sequential frames in the step S106.
- the first counter unit 153 is controlled by the power value judging unit 152 to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 152 that the adjusted power value of the coherent component signals of the current frame exceeds the adjusted power value of the coherent component signals of the previous frame in the step S107.
- the first counter unit 153 is, on the other hand, controlled by the power value judging unit 152 to allow the value to be replaced by a numeral "0" when the judgment is made by the power value judging unit 152 that the adjusted power value of the coherent component signals of the current frame does not exceed the adjusted power value of the coherent component signals of the previous frame.
- the power value ratio of the adjusted power value of each of the coherent component signals to an average value of the adjusted power values of the coherent component signals is then calculated by the power value ratio calculating means 160 in each of the sequential frames in the step S108.
- the judgment is then made by the power value ratio judging unit 171 forming part of the power value ratio judging means 170 on whether or not the power value ratio of the adjusted power value of each of the coherent component signals to the average value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating means 160 exceeds the predetermined first threshold value in each of the sequential frames in the step S 109.
- the number of the sequential frame in which the judgment is made that the power value ratio of the adjusted power value of each of the coherent component signals to the mean value of the adjusted power values of the coherent component signals is then counted by the second counter unit 172 forming part of the power value ratio judging means 170 in the step S 110.
- the howling sound is finally suppressed by the howling sound suppressing means 190 based on results judged by the howling sound judging means 180.
- the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- the power value judging means 150 includes a previous frame obtaining unit 151 for obtaining the coherent component signals of the previous frame in response to the coherent component signals of the current frame adjusted by the power value adjusting means 140, a power value judging unit 152 for judging whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, and a first counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 152 that the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, the power value judging means 150, as shown in FIG.
- a maximum power value obtaining unit 154 for obtaining a maximum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means 140; a previous frame obtaining unit 151 for obtaining the maximum power value of the coherent component signals of the previous frame in response to the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit 154, a power value judging unit 152 for judging whether or not the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit 154 exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, and a first counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 152 that the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit 154 exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151,
- the power value judging means 150 may include a minimum power value obtaining unit 155 for obtaining a minimum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means 140; a previous frame obtaining unit 151 for obtaining the minimum power value of the coherent component signals of the previous frame in response to the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit 155, a power value judging unit 152 for judging whether or not the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit 155 exceeds the minimum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, and a first counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 152 that the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit 155 exceeds the minimum power value
- this embodiment may be replaced by the microphone-speaker apparatus according to the second to sixth embodiments of the present invention in order to attain the object of the present invention.
- the second to sixth embodiments of the microphone-speaker apparatus will then be described hereinafter.
- FIGS. 2 to 6 of the drawings there are shown block diagrams of the second to sixth embodiments of the microphone-speaker apparatus according to the present invention.
- the constitutional elements and the steps of the second to sixth embodiments of the microphone-speaker apparatus according to the present invention as shown in FIGS. 2 to 6 are entirely the same as those of the first embodiment of the microphone-speaker apparatus according to the present invention as shown in FIG. 1 except for the constitutional elements and the steps appearing in the following description. Therefore, only the constitutional elements and the steps of the second to sixth embodiments of the microphone-speaker apparatus different from those of the first embodiment of the microphone-speaker apparatus will be described in detail hereinafter.
- the microphone-speaker apparatus 200 is shown in FIG. 2 as comprising a microphone unit 101, an A/D converter 103, a speaker unit 102, audio signal dividing means 110, coherent component signal extracting means 120, power value calculating means 130, power value adjusting means 140, power value judging means 150, power value ratio calculating means 160, power value ratio judging means 170, howling sound judging means 180, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 100 shown in FIG. 1 and thus its construction will not be described hereinafter.
- the microphone-speaker apparatus 200 further comprises raw component power calculating means 230 for calculating the power value of each of the raw component signals divided by the audio signal dividing means 110; raw component power adjusting means 240 for adjusting the power value of each of the raw component signals calculated by the raw component power calculating means 230 to produce an adjusted power value of each of the raw component signals; and raw component power judging means 250 for judging whether or not the power value of each of the raw component signals of the current frame exceeds the power value of each of the raw component signals of the preceding frame.
- the howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 based on each of results judged by the power value judging means 150, the raw component power judging means 250, and the power value ratio judging means 170.
- the raw component power judging means 250 includes a previous frame obtaining unit 251 for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame adjusted by the raw component power adjusting means 240, a power value judging unit 252 for judging whether or not the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251.
- the howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals through steps of judging whether or not the value counted by the first counter unit 153 exceeds a predetermined second predetermined value, judging whether or not the value counted by the second counter unit 172 exceeds a predetermined third predetermined value, and judging whether or not the value counted by the third counter unit 253 exceeds a predetermined fourth predetermined value.
- the power value of each of the raw component signals divided by the audio signal dividing means 110 is firstly calculated by the raw component power calculating means 230.
- the power value of each of the raw component signals calculated by the raw component power calculating means 230 is then adjusted by the raw component power adjusting means 240 to produce an adjusted power value of each of the raw component signals.
- the judgment is then made by the raw component power judging means 250 whether or not the power value of each of the raw component signals of the current frame exceeds the power value of each of the raw component signals of the preceding frame.
- the third counter unit 253 is controlled by the power value judging unit 252 to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251.
- the third counter unit 253 is, on the other hand, controlled by the power value judging unit 252 to allow the value to be replaced by a numeral "0" when the judgment is made by the power value judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 does not exceed the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251.
- the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- the raw component power judging means 250 includes a previous frame obtaining unit 251 for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame adjusted by the raw component power adjusting means 240, a power value judging unit 252 for judging whether or not the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251.
- the howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals through steps of judging whether or not the value counted by the first counter unit 153 exceeds a predetermined second predetermined value, judging whether or not the value counted by the second counter unit 172 exceeds a predetermined third predetermined value, and judging whether or not the value counted by the third counter unit 253 exceeds a predetermined fourth predetermined value
- the raw component power judging means 250 may include maximum power value obtaining unit 254 for obtaining a maximum power value from among the adjusted power values of the raw component signals adjusted by the raw component power adjusting means 240; a previous frame obtaining unit 251 for obtaining the maximum power value of the raw component signals of the previous frame in response to the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit 254, a power value judging unit 252 for judging whether or not the maximum power value of
- the raw component power judging means 250 may include minimum power value obtaining unit 255 for obtaining a minimum power value from among the adjusted power values of the raw component signals adjusted by the raw component power adjusting means 240; a previous frame obtaining unit 251 for obtaining the minimum power value of the raw component signals of the previous frame in response to the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit 255, a power value judging unit 252 for judging whether or not the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit 255 exceeds the minimum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit 255 exceeds the minimum power value of the raw component signals of
- the raw sound wave is constituted by a plurality of sub-band sound wave components each having a frequency range and a raw sub-band power value.
- the raw component power calculating means 230 is operative to calculate the power value of each of the raw component signals divided by the audio signal dividing means 110, however, the raw component power calculating means 230, may be operative to calculate each of the raw sub-band power values from the raw component signals divided by the audio signal dividing means 110 in each of the frequency ranges, the raw component power adjusting means 240 being operative to respectively adjust the raw sub-band power values calculated by the raw component power calculating means 230 to produce an adjusted sub-band power values in each of the frequency ranges, and the raw component power judging means 250 being operative to judge whether or not the adjusted sub-band power values of the current frame exceeds the adjusted sub-band power value of the previous frame in each of the frequency ranges in each of the frequency ranges.
- the microphone-speaker apparatus 300 is shown in FIG. 3 as comprising a microphone unit 101, an A/D converter 103, a speaker unit 102, audio signal dividing means 110, coherent component signal extracting means 120, power value calculating means 130, power value adjusting means 140, power value judging means 150, power value ratio calculating means 160, power value ratio judging means 170, howling sound judging means 180, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 100 shown in FIG. 1 and thus its construction will not be described hereinafter.
- the microphone-speaker apparatus 300 further comprises component signal estimating means 320 for estimating and producing an estimated component signals of the current frames in response to both the raw component signals of the sequential frames divided by the audio signal dividing means 110 and the signal coefficients produced by the signal coefficient producing unit 124; raw component power calculating means 230 for calculating the power value of each of the estimated component signals estimated by the component signal estimating means 320; raw component power adjusting means 240 for adjusting the power value of each of the estimated component signals calculated by the raw component power calculating means 230 to produce an adjusted power value of each of the estimated component signals; and raw component power judging means 250 for judging whether or not the power value of each of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the power value of each of the estimated component signals of the preceding frame adjusted by the raw component power adjusting means 240.
- the howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals based on each of results judged by the power value judging means 150, results judged by the raw component power judging means 250, and results judged by the power value ratio judging means 170.
- the raw component power judging means 250 includes a previous frame obtaining unit 251 for obtaining the estimated component signals of the previous frame in response to the estimated component signals of the current frame adjusted by the raw component power adjusting means 240, a power value judging unit 252 for judging whether or not the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251; and the howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102
- the estimated component signals of the current frames are firstly estimated and produced by the component signal estimating means 320 in response to both the raw component signals of the sequential frames divided by the audio signal dividing means 110 and the signal coefficients produced by the signal coefficient producing unit 124.
- the power value of each of the estimated component signals estimated by the component signal estimating means 320 is then calculated by the raw component power calculating means 230.
- the power value of each of the estimated component signals calculated by the raw component power calculating means 230 is then adjusted by the raw component power adjusting means 240 to produce an adjusted power value of each of the estimated component signals.
- the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- the raw component power judging means 250 includes a previous frame obtaining unit 251 for obtaining the estimated component signals of the previous frame in response to the estimated component signals of the current frame adjusted by the raw component power adjusting means 240, a power value judging unit 252 for judging whether or not the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, the raw component power judging means 250 may include a maximum power value obtaining unit 254 for obtaining a maximum power
- the raw component power judging means 250 may include a minimum power value obtaining unit 255 for obtaining a minimum power value from among the adjusted power values of the estimated component signals adjusted by the raw component power adjusting means 240; a previous frame obtaining unit 251 for obtaining the minimum power value of the estimated component signals of the previous frame in response to the minimum power value of the raw estimated component signals of the current frame obtained by the minimum power value obtaining unit 255, a power value judging unit 252 for judging whether or not the minimum power value of the estimated component signals of the current frame obtained by the minimum power value obtaining unit 255 exceeds the minimum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the minimum power value of the estimated component signals of the current frame obtained by the minimum power value obtaining unit 255 exceeds the minimum power value of the estimated component
- the raw sound wave is constituted by a plurality of sub-band sound wave components each having a frequency range and a raw sub-band power value.
- the raw component power calculating means 230 is operative to calculate the power value of each of the estimated component signals estimated by the component signal estimating means 320 in each of the frequency ranges, however, the raw component power calculating means 230 may be operative to calculate each of the raw sub-band power values from the estimated component signals estimated by the component signal estimating means 320 in each of the frequency ranges, the raw component power adjusting means 240 being operative to respectively adjust the sub-band power values calculated by the raw component power calculating means 230 to produce adjusted sub-band power values in each of the frequency ranges; and the raw component power judging means 250 being operative to judging whether or not the each of the sub-band power values of the current frame exceeds each of the sub-band power value of the previous frame in each of the frequency ranges.
- the microphone-speaker apparatus 400 is shown in FIG. 4 as comprising: a microphone unit 101 for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the raw sound wave being constituted by a plurality of raw sub-band wave components each having a frequency range, and the coherent sound wave being constituted by a plurality of coherent wave components each having the audio frequency; a speaker unit 102 for outputting the audio sound to the microphone unit 101, the audio sound including a howling sound represented by the coherent sound wave, and the howling sound being produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102; audio signal dividing means 410 for dividing the audio signal indicative of the audio sound received by the microphone unit 101 into a plurality of raw sub-band component signals each indicative of the raw sub-band wave components, each of the raw sub-band component signals having a plurality of sequential frames
- the audio signal dividing means 110 is operative to divide the audio signal received from the microphone unit 101 into a plurality of raw component signals based on the frequency components analyzing method such as for example Fast Fourier Transformation
- the audio signal dividing means 410 forming part of the microphone-speaker apparatus 400 according to the fourth embodiment of the present invention is constituted by a plurality of band-pass filters.
- the band-bass filter may be constituted by any one of Finite Impulse Response filter, Infinite Impulse Response filter, and other digital signal processor which can divide the audio signal into the sub-band component signals each having a frequency range.
- the coherent component signal extracting means 420 includes a previous frame obtaining unit 421 for obtaining the raw sub-band component signals of the previous frame in response to the raw sub-band component signals of the current frame divided by the audio signal dividing means 410, a coherent component signal extracting unit 422 for extracting the sub-band coherent component signals, a signal difference obtaining unit 423 for obtaining a signal difference between the raw sub-band component signals divided by the audio signal dividing means 410 and the sub-band coherent component signals extracted by the coherent component signal extracting unit 422, and a signal coefficient producing unit 424 for producing a plurality of signal coefficients in response to both the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 421 and the signal difference between the raw sub-band component signals of the current frame and the sub-band coherent component signals of the current frame calculated by the signal difference obtaining unit 423.
- the coherent component signal extracting unit 422 is operative to extract the sub-band coherent component signals in response to both the raw sub-band component signals of the previous frame obtained
- the power value adjusting means 440 is operative to adjust the sub-band raw power value of each of the sub-band coherent component signals calculated by the power value calculating means 430 to obtain a sub-band adjusted power value "P(k)" of each of the sub-band coherent component signals through steps of adding a first product "FF ⁇ P_pre(k)” to a second product "(1.0 - FF) ⁇ P(k-1)", the first product "FF ⁇ P_pre(k)” being indicative of a predetermined coefficient value "FF” multiplied by the raw power value "P_pre(k)” of each of the sub-band coherent component signals in the current frame "k” calculated by the power value calculating means 430, and the second product "(1.0 ⁇ FF) ⁇ P(k-1)” being indicative of the adjusted power value "P(k-1)” of each of the sub-band coherent component
- the power value judging means 450 includes a previous frame obtaining unit 451 for obtaining the sub-band coherent component signals of the previous frame in response to the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440, a power value judging unit 452 for judging whether or not the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451, and a first counter unit 453 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 452 that the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451.
- the power value ratio judging means 470 includes a power value ratio judging unit 471 for judging whether or not the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the average value of the adjusted sub-band power values of the sub-band coherent component signals calculated by the power value ratio calculating means 460 exceeds the predetermined first threshold value, and a second counter unit 472 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value ratio judging unit 471 that the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the mean value of the adjusted sub-band power values of the sub-band coherent component signals calculated by the power value ratio calculating means 460, and the howling sound judging means 480 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals through steps of judging whether or not the value counted by the first counter unit
- the audio sound is firstly received by the microphone unit 101 to convert the audio sound to an analog audio signal.
- the audio signal received from the microphone unit 101 through the A/D converter 103 is then divided by the audio signal dividing means 410 in the step S401.
- the sub-band coherent component signals respectively indicative of the sub-band coherent wave components is then extracted by the coherent component signal extracting means 420 in response to the raw sub-band component signals divided by the audio signal dividing means 410 in each of the sequential frames in the step S402.
- the raw sub-band power value of each of the sub-band coherent component signals extracted by the coherent component signal extracting means 420 is then calculated by the power value calculating means 430 in each of the sequential frames in the step S403.
- the raw sub-band power value of each of the sub-band coherent component signals calculated by the power value calculating means 430 is then adjusted by the power value adjusting means 440 to produce an adjusted sub-band power value of each of the sub-band coherent component signals in each of the sequential frame in the step S404.
- the sub-band coherent component signals of the previous frame is then obtained by the previous frame obtaining unit 451 forming part of the power value judging means 450 in response to the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 in each of the sequential frames in the step S405.
- the judgment is then made by the power value judging unit 452 forming part of the power value judging means 450 on whether or not the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451 in each of the sequential frames in the step S406.
- the first counter unit 453 is controlled by the power value judging unit 452 to allow the value to be incremented by a numeral "1" when the judgment is made that the adjusted sub-band power value of the sub-band coherent component signals of the current frame exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame in the step S407.
- the first counter unit 453 is, on the other hand, controlled by the power value judging unit 452 to allow the value to be replaced by a numeral "0" when the judgment is made that the adjusted sub-band power value of the sub-band coherent component signals of the current frame does not exceed the adjusted sub-band power value of the sub-band coherent component signals of the previous frame.
- the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to an average value of the adjusted sub-band power values of the sub-band coherent component signals is then calculated by the power value ratio calculating means 460 in each of the sequential frames in the step S408.
- the number of the sequential frame in which the judgment is made that the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the mean value of the adjusted sub-band power values of the sub-band coherent component signals is then counted by the second counter unit 472 forming part of the power value ratio judging means 470 in the step S410.
- the howling sound is finally suppressed by the howling sound suppressing means 190 based on results judged by the howling sound judging means 480 in the step S412.
- the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- the power value judging means 450 includes a previous frame obtaining unit 451 for obtaining the sub-band coherent component signals of the previous frame in response to the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440, a power value judging unit 452 for judging whether or not the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451, and a first counter unit 453 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 452 that the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451,
- the power value judging means 450 may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the sub-band coherent component signals adjusted by the power value adjusting means 440; a previous frame obtaining unit 451 for obtaining the minimum power value of the sub-band coherent component signals of the previous frame in response to the minimum power value of the sub-band coherent component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit 452 for judging whether or not the minimum power value of the sub-band coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451, and a third counter unit 453 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 452 that the minimum power value of the sub-band coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the
- the microphone-speaker apparatus 500 is shown in FIG. 5 as comprising a microphone unit 101, an A/D converter 103, a speaker unit 102, audio signal dividing means 410, coherent component signal extracting means 420, power value calculating means 430, power value adjusting means 440, power value judging means 450, power value ratio calculating means 460, power value ratio judging means 470, howling sound judging means 480, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 400 shown in FIG. 4 and thus its construction will not be described hereinafter.
- the microphone-speaker apparatus 500 further comprises raw component power calculating means 530 for calculating the power value of each of the raw sub-band component signals divided by the audio signal dividing means 410; raw component power adjusting means 540 for adjusting the power value of each of the raw sub-band component signals calculated by the raw component power calculating means 530 to produce an adjusted power value of each of the raw sub-band component signals; and raw component power judging means 550 for judging whether or not the power value of each of the raw sub-band component signals of the current frame exceeds the power value of each of the raw sub-band component signals of the preceding frame.
- the howling sound judging means 480 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals based on each of results judged by the power value judging means 450, results judged by the raw component power judging means 550, and results judged by the power value ratio judging means 470.
- the raw component power judging means 550 includes a previous frame obtaining unit 551 for obtaining the raw sub-band component signals of the previous frame in response to the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a power value judging unit 552 for judging whether or not the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw power value adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551.
- the howling sound judging means 480 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals through steps of judging whether or not the value counted by the first counter unit 453 exceeds a predetermined second predetermined value, judging whether or not the value counted by the second counter unit 472 exceeds a predetermined third predetermined value, and judging whether or not the value counted by the third counter unit 553 exceeds a predetermined fourth predetermined value.
- the power value of each of the raw sub-band component signals divided by the audio signal dividing means 410 is firstly calculated by the raw component power calculating means 530.
- the power value of each of the raw sub-band component signals calculated by the raw component power calculating means 530 is then adjusted by the raw component power adjusting means 540 to produce an adjusted power value of each of the raw sub-band component signals.
- the raw sub-band component signals of the previous frame are respectively obtained by the previous frame obtaining unit 551 in response to the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540.
- the judgment is then made by the power value judging unit 552 on whether or not the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551.
- the third counter unit 553 is controlled by the power value judging unit 552 to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw power value adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551.
- the third counter unit 553 is, on the other hand, controlled by the power value judging unit 552 to allow the value to be replaced by a numeral "0" when the judgment is made by the power value judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw power value adjusting means 540 does not exceed the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551.
- the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- the raw component power judging means 550 includes a previous frame obtaining unit 551 for obtaining the raw sub-band component signals of the previous frame in response to the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a power value judging unit 552 for judging whether or not the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, the raw component power judging means determining whether or not the adjusted power value of the raw sub-band component
- the raw component power judging means 550 may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the raw sub-band component signals adjusted by the raw component power adjusting means 540; a previous frame obtaining unit 551 for obtaining the minimum power value of the raw sub-band component signals of the previous frame in response to the minimum power value of the raw sub-band component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit 552 for judging whether or not the minimum power value of the raw sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the minimum power value of the raw sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceed
- the microphone-speaker apparatus 600 is shown in FIG. 6 as comprising a microphone unit 101, an A/D converter 103, a speaker unit 102, audio signal dividing means 410, coherent component signal extracting means 420, power value calculating means 430, power value adjusting means 440, power value judging means 450, power value ratio calculating means 460, power value ratio judging means 470, howling sound judging means 480, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 400 shown in FIG. 4 and thus its construction will not be described hereinafter.
- the microphone-speaker apparatus 600 further comprises component signal estimating means 620 for estimating and producing an estimated sub-band component signals of the current frames in response to both the raw sub-band component signals of the sequential frames divided by the audio signal dividing means 410 and the signal coefficients produced by the signal coefficient producing unit 424; raw component power calculating means 530 for calculating the power value of each of the estimated sub-band component signals estimated by the component signal estimating means 620; raw component power adjusting means 540 for adjusting the power value of each of the estimated sub-band component signals calculated by the raw component power calculating means 530 to produce an adjusted power value of each of the estimated sub-band component signals; and raw component power judging means 550 for judging whether or not the power value of each of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the power value of each of the estimated sub-band component signals of the preceding frame adjusted by the raw component power adjusting means 540.
- the howling sound judging means 480 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals based on each of results judged by the power value judging means 450, results judged by the raw component power judging means 550, and results judged by the power value ratio judging means 470.
- the raw component power judging means 550 includes a previous frame obtaining unit 551 for obtaining the estimated sub-band component signals of the previous frame in response to the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a power value judging unit 552 for judging whether or not the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551.
- the howling sound judging means 480 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals through steps of judging whether or not the value counted by the first counter unit 453 exceeds a predetermined second predetermined value, judging whether or not the value counted by the second counter unit 472 exceeds a predetermined third predetermined value, and judging whether or not the value counted by the third counter unit 553 exceeds a predetermined fourth predetermined value.
- the estimated sub-band component signals of the current frames are firstly estimated and produced by the component signal estimating means 620 in response to both the raw sub-band component signals of the sequential frames divided by the audio signal dividing means 410 and the signal coefficients produced by the signal coefficient producing unit 424.
- the power value of each of the estimated sub-band component signals estimated by the component signal estimating means 620 is then calculated by the raw component power calculating means 530.
- the power value of each of the estimated sub-band component signals calculated by the raw component power calculating means 530 is then adjusted by the raw component power adjusting means 540 to produce an adjusted power value of each of the estimated sub-band component signals.
- the raw component power judging means 550 judges whether or not the power value of each of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the power value of each of the estimated sub-band component signals of the preceding frame adjusted by the raw component power adjusting means 540.
- the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- the raw component power judging means 550 includes a previous frame obtaining unit 551 for obtaining the estimated sub-band component signals of the previous frame in response to the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a power value judging unit 552 for judging whether or not the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, the raw component power judging means determining whether or not the adjusted power value of the estimated sub-band component
- the raw component power judging means 550 may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the estimated sub-band component signals adjusted by the raw component power adjusting means 540; a previous frame obtaining unit 551 for obtaining the minimum power value of the estimated sub-band component signals of the previous frame in response to the minimum power value of the estimated sub-band component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit 552 for judging whether or not the minimum power value of the estimated sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the minimum power value of the estimated sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceed
- the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
- Golf Clubs (AREA)
- Diaphragms For Electromechanical Transducers (AREA)
Abstract
Description
- The present invention relates to a microphone-speaker apparatus, and more particularly to a microphone-speaker apparatus comprising howling sound judging means for judging whether or not a howling sound is produced while a microphone unit is receiving an audio sound outputted by a speaker unit without being affected by an amplitude of the audio sound received by the microphone unit.
- Up until now, there have been provided a wide variety of microphone-speaker apparatus of this type one typical example of which is shown in FIG. 14. The conventional microphone-speaker apparatus of this type is disclosed in pages 112-115 of the preprinted version of the Tokyo convention '95 of the Audio Engineering Society, titled "Automatic Finding and Eliminating Feedback System with DSP".
- The conventional microphone-
speaker apparatus 20 is shown in FIG. 14 as comprising amicrophone unit 40 for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the audio sound being constituted by a plurality of sub-band audio sounds each having an amplitude, the sub-band audio sounds respectively having frequency ranges divided along a frequency axis; audiosignal dividing means 50 for dividing the audio signal received from themicrophone unit 40 through aninput terminal 30 into a plurality of sub-band audio signals respectively indicative of the sub-band audio sounds, each of the sub-band audio signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a current frame and a preceding frame prior to the current frame; maximumvalue obtaining means 60 for obtaining the maximum value from among the amplitudes of the sub-band audio signals in each of the sequential frames; and howling sound judging means 70 for judging whether or not the howling sound is produced while themicrophone unit 40 is receiving the audio sound outputted by thespeaker unit 80. - The howling sound judging means 70 is operative to judge whether or not the howling sound is produced while the
microphone unit 40 is receiving the audio sound outputted by thespeaker unit 80 through steps of judging whether or not the maximum value of the amplitudes of the sub-band audio signals in each of the sequential frames exceeds a predetermined threshold value, judging whether or not the frequency range in which the maximum value of the amplitudes of the sub-band audio signals is obtained by the maximumvalue obtaining means 60 in the current frame is the same as the frequency range in which the maximum value of the amplitudes of the sub-band audio signals is obtained by the maximumvalue obtaining means 60 in the preceding frame under the condition that each of the maximum value of the amplitudes of the sub-band audio signals obtained by the maximumvalue obtaining means 60 in the current frame and the maximum value of the amplitudes of the sub-band audio signals obtained by the maximumvalue obtaining means 60 in the preceding frame exceeds a predetermined threshold value, counting a number of the sequential frame in which the judgment is made that the frequency range in which the maximum value of the amplitudes of the sub-band audio signals is obtained by the maximumvalue obtaining means 60 in the current frame is the same as the frequency range in which the maximum value of the amplitudes of the sub-band audio signals is obtained by the maximumvalue obtaining means 60 in the preceding frame under the condition that each of the maximum value of the amplitudes of the sub-band audio signals obtained by the maximumvalue obtaining means 60 in the current frame and the maximum value of the amplitudes of the sub-band audio signals obtained by the maximumvalue obtaining means 60 in the preceding frame exceeds a predetermined threshold value, judging whether or not the number of the sequential frame counted in the third step exceeds a predetermined number. - The conventional microphone-speaker apparatus, however, encounters such a problem that the judgment tends to be mistakenly made by the howling sound judging means 70 that the howling sound is produced while the
microphone unit 40 is receiving the audio sound outputted by thespeaker unit 80 with being remarkably affected by the amplitude of the audio sound received by the microphone unit under the condition that themicrophone unit 40 is continuously receiving the audio sound represented by the raw sound wave having a relatively high amplitude at a relatively long interval. - When the
microphone unit 40 is also receiving a background noise having a relatively high level, the judgment tends to be mistakenly made by the howling sound judging means 70 that the howling sound is produced while themicrophone unit 40 is receiving the audio sound outputted by thespeaker unit 80 under the condition that themicrophone unit 40 is continuously receiving the audio sound represented by the raw sound wave having a relatively high amplitude during a relatively long interval. - It is, therefore, an object of the present invention to provide a microphone-speaker apparatus which can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- According to the first aspect of the present invention, there is provided a microphone-speaker apparatus, comprising: a microphone unit for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the raw sound wave being constituted by a plurality of raw wave components each having an audio frequency, and the coherent sound wave being constituted by a plurality of coherent wave components each having the audio frequency; a speaker unit for outputting the audio sound to the microphone unit, the audio sound including a howling sound represented by the coherent sound wave, and the howling sound being produced while the microphone unit is receiving the audio sound outputted by the speaker unit; audio signal dividing means for dividing the audio signal converted by the microphone unit into a plurality of raw component signals each indicative of the raw wave components, each of the raw component signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a current frame and a previous frame prior to the current frame; coherent component signal extracting means for extracting a plurality of coherent component signals respectively indicative of the coherent wave components from the raw component signals divided by the audio signal dividing means, each of the coherent component signals in each of the sequential frames having a raw power value; power value calculating means for calculating the raw power value of each of the coherent component signals extracted by the coherent component signal extracting means; power value adjusting means for adjusting the raw power value of each of the coherent component signals calculated by the power value calculating means to produce an adjusted power value of each of the coherent component signals; power value judging means for judging whether or not the adjusted power value of each of the coherent component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of each of the coherent component signals of the previous frame adjusted by the power value adjusting means; power value ratio calculating means for calculating a power value ratio of the adjusted power value of each of the coherent component signals to an average value of the adjusted power values of the coherent component signals adjusted by the power value adjusting means; power value ratio judging means for judging whether or not the power value ratio of the adjusted power value of each of the coherent component signals to the average value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating mean exceeds a predetermined threshold value; howling sound judging means for judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit based on results judged by the power value judging means and results judged by the power value ratio judging means; and howling sound suppressing means for suppressing the howling sound based on results judged by the howling sound judging means.
- The coherent component signal extracting means may include a previous frame obtaining unit for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame divided by the audio signal dividing means, a coherent component signal extracting unit for extracting the coherent component signals, a signal difference obtaining unit for obtaining a signal difference between the raw component signals divided by the audio signal dividing means and the coherent component signals extracted by the coherent component signal extracting unit, and a signal coefficient producing unit for producing a plurality of signal coefficients in response to both the raw component signals of the previous frame obtained by the previous frame obtaining unit and the signal difference between the raw component signals of the current frame and the coherent component signals of the current frame calculated by the signal difference obtaining unit. The coherent component signal extracting unit may be operative to extract the coherent component signals in response to both the raw component signals of the previous frame obtained by the previous frame obtaining unit and the signal coefficients produced by the signal coefficient producing unit.
- The power value adjusting means may be operative to adjust the raw power value of each of the coherent component signals calculated by the power value calculating means to obtain an adjusted power value of each of the coherent component signals through steps of adding a first product "A" to a second product "B", the first product "A" being indicative of a predetermined coefficient value multiplied by the raw power value of each of the coherent component signals in the current frame calculated by the power value calculating means, and the second product "B" being indicative of the adjusted power value of each of the coherent component signals in the preceding frame adjusted by the power value adjusting means multiplied by a value obtained by subtracting the predetermined coefficient value from a numerical value "1".
- The power value judging means may include a previous frame obtaining unit for obtaining the coherent component signals of the previous frame in response to the coherent component signals of the current frame adjusted by the power value adjusting means, a power value judging unit for judging whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit, and a first counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit; the power value ratio judging means includes a power value ratio judging unit for judging whether or not the power value ratio of the adjusted power value of each of the coherent component signals to the average value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating means exceeds the predetermined first threshold value, and a second counter unit for counting a number of the sequential frame in which the judgment is made by the power value ratio judging unit that the power value ratio of the adjusted power value of each of the coherent component signals to the mean value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating means, and the howling sound judging means is operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit through steps of judging whether or not the number of the sequential frame counted by the first counter unit exceeds a predetermined second predetermined value, and judging whether or not the number of the sequential frame counted by the second counter unit exceeds a predetermined third predetermined value.
- The microphone-speaker apparatus may further comprise raw component power calculating means for calculating the power value of each of the raw component signals divided by the audio signal dividing means; raw component power adjusting means for adjusting the power value of each of the raw component signals calculated by the raw component power calculating means to produce an adjusted power value of each of the raw component signals; and raw component power judging means for judging whether or not the power value of each of the raw component signals of the current frame exceeds the power value of each of the raw component signals of the preceding frame. The howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit based on each of results judged by the power value judging means, results judged by the raw component power judging means, and results judged by the power value ratio judging means.
- The raw component power judging means may include a previous frame obtaining unit for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame adjusted by the raw component power adjusting means, a power value judging unit for judging whether or not the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the adjusted power value of the raw component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit. The howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit during periodic intervals through steps of judging whether or not the number of the sequential frame counted by the first counter unit exceeds a predetermined second predetermined value, judging whether or not the number of the sequential frame counted by the second counter unit exceeds a predetermined third predetermined value, and judging whether or not the number of the sequential frame counted by the third counter unit exceeds a predetermined fourth predetermined value.
- The microphone-speaker apparatus may further comprise component signal estimating means for estimating and producing an estimated component signals of the current frames in response to both the raw component signals of the sequential frames divided by the audio signal dividing means and the signal coefficients produced by the signal coefficient producing unit; raw component power calculating means for calculating the power value of each of the estimated component signals estimated by the component signal estimating means; raw component power adjusting means for adjusting the power value of each of the estimated component signals calculated by the raw component power calculating means to produce an adjusted power value of each of the estimated component signals; and raw component power judging means for judging whether or not the power value of each of the estimated component signals of the current frame adjusted by the raw component power adjusting means exceeds the power value of each of the estimated component signals of the preceding frame adjusted by the raw component power adjusting means. The howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit based on each of results judged by the power value judging means, results judged by the raw component power judging means, and results judged by the power value ratio judging means.
- The raw component power judging means may include a previous frame obtaining unit for obtaining the estimated component signals of the previous frame in response to the estimated component signals of the current frame adjusted by the raw component power adjusting means, a power value judging unit for judging whether or not the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the adjusted power value of the estimated component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit. The howling sound judging means may be operative to judge whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit during periodic intervals through steps of judging whether or not the number of the sequential frame counted by the first counter unit exceeds a predetermined second predetermined value, judging whether or not the number of the sequential frame counted by the second counter unit exceeds a predetermined third predetermined value, and judging whether or not the number of the sequential frame counted by the third counter unit exceeds a predetermined fourth predetermined value.
- The power value judging means may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the maximum power value of the coherent component signals of the previous frame in response to the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit for judging whether or not the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit.
- The power value judging means may includes a minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the minimum power value of the coherent component signals of the previous frame in response to the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit for judging whether or not the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the minimum power value of the coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit.
- The raw component power judging means may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the raw component signals adjusted by the raw component power adjusting means; a previous frame obtaining unit for obtaining the maximum power value of the raw component signals of the previous frame in response to the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit for judging whether or not the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit.
- The raw component power judging means may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the raw component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the minimum power value of the raw component signals of the previous frame in response to the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit for judging whether or not the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the minimum power value of the raw component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit.
- The raw component power judging means may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the estimated component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the maximum power value of the estimated component signals of the previous frame in response to the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit for judging whether or not the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit.
- The raw component power judging means may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the estimated component signals adjusted by the power value adjusting means; a previous frame obtaining unit for obtaining the minimum power value of the estimated component signals of the previous frame in response to the minimum power value of the raw estimated component signals of the current frame obtained by the minimum power value obtaining unit, a power value judging unit for judging whether or not the minimum power value of the estimated component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit, and a third counter unit for counting a number of the sequential frame in which the judgment is made by the power value judging unit that the minimum power value of the estimated component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit.
- The power value calculating means may be operative to calculate each of the raw sub-band power values from the coherent component signals extracted by the coherent component signal extracting means The power value adjusting means may be operative to respectively adjust the raw sub-band power values calculated by the power value calculating means to produce an adjusted sub-band power values. The power value judging means may be operative to judging whether or not the adjusted each of the adjusted sub-band power values of the current frame exceeds each of the adjusted sub-band power values of the previous frame in each of the frequency ranges. The power value ratio calculating means may be operative to calculate a power value ratio of each of the adjusted sub-band power values to an average value of the adjusted sub-band power values. The power value ratio judging means may be operative to judge whether or not the power value ratio of each of the adjusted sub-band power values to the average value of the adjusted sub-band power values exceeds a predetermined threshold value.
- The raw component power calculating means may be operative to calculate each of the raw sub-band power values from the raw component signals divided by the audio signal dividing means. The raw component power adjusting means may be operative to respectively adjust the raw sub-band power values calculated by the raw component power calculating means to produce an adjusted sub-band power values. The raw component power judging means may be operative to judge whether or not the adjusted sub-band power values of the current frame exceeds the adjusted sub-band power value of the previous frame in each of the frequency ranges.
- The raw component power calculating means may be operative to calculate each of the raw sub-band power values from the estimated component signals estimated by the component signal estimating means, the raw sound wave being constituted by a plurality of sub-band sound wave components each having a frequency range and a raw sub-band power value. The raw component power adjusting means may be operative to respectively adjust the sub-band power values calculated by the raw component power calculating means to produce adjusted sub-band power values. The raw component power judging means may be operative to judging whether or not the each of the sub-band power values of the current frame exceeds each of the sub-band power value of the previous frame in each of the frequency ranges.
- According to the second aspect of the present invention, there is provided a microphone-speaker apparatus, comprising: a microphone unit for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the raw sound wave being constituted by a plurality of raw sub-band wave components each having a frequency range, and the coherent sound wave being constituted by a plurality of coherent wave components each having an audio frequency; a speaker unit for outputting the audio sound to the microphone unit, the audio sound including a howling sound represented by the coherent sound wave, and the howling sound being produced while the microphone unit is receiving the audio sound outputted by the speaker unit; audio signal dividing means for dividing the audio signal converted by the microphone unit into a plurality of raw sub-band component signals each indicative of the raw sub-band wave components, each of the raw sub-band component signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a current frame and a previous frame prior to the current frame; coherent component signal extracting means for extracting a plurality of sub-band coherent component signals respectively indicative of the coherent wave components from the raw sub-band component signals divided by the audio signal dividing means, and each of the sub-band coherent component signals in each of the sequential frames having a raw sub-band power value; power value calculating means for calculating the raw sub-band power value of each of the sub-band coherent component signals extracted by the sub-band coherent component signal extracting means; power value adjusting means for adjusting the raw sub-band power value of each of the sub-band coherent component signals calculated by the power value calculating means to produce an adjusted sub-band power value of each of the sub-band coherent component signals; power value judging means for judging whether or not the adjusted sub-band power value of each of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means exceeds the adjusted sub-band power value of each of the sub-band coherent component signals of the previous frame adjusted by the power value adjusting means; power value ratio calculating means for calculating a power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to an average value of the adjusted sub-band power values of the sub-band coherent component signals adjusted by the power value adjusting means; power value ratio judging means for judging whether or not the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the average value of the adjusted sub-band power values of the sub-band coherent component signals calculated by the power value ratio calculating means exceeds a predetermined threshold value; howling sound judging means for judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit based on results judged by the power value judging means and results judged by the power value ratio judging means; and howling sound suppressing means for suppressing the howling sound based on results judged by the howling sound judging means.
- The present invention and many of the attendant advantages thereof will be better understood from the following detailed description when considered in connection with the accompanying drawings, wherein:
- FIG. 1 is a block diagram of the microphone-speaker apparatus according to the first embodiment of the present invention,
- FIG. 2 is a block diagram of the microphone-speaker apparatus according to the second embodiment of the present invention,
- FIG. 3 is a block diagram of the microphone-speaker apparatus according to the third embodiment of the present invention,
- FIG. 4 is a block diagram of the microphone-speaker apparatus according to the fourth embodiment of the present invention,
- FIG. 5 is a block diagram of the microphone-speaker apparatus according to the fifth embodiment of the present invention,
- FIG. 6 is a block diagram of the microphone-speaker apparatus according to the sixth embodiment of the present invention,
- FIG. 7 is a block diagram of the power value judging means forming part of the microphone-speaker apparatus according to the first embodiment of the present invention,
- FIG. 8 is a block diagram of the power value judging means forming part of the microphone-speaker apparatus according to the first embodiment of the present invention,
- FIG. 9 is a block diagram of the power value judging means forming part of the microphone-speaker apparatus according to the first embodiment of the present invention,
- FIG. 10 is a block diagram of the power value judging means forming part of the microphone-speaker apparatus according to the first embodiment of the present invention,
- FIG. 11 is a block diagram of the microphone-speaker apparatus according to the first to sixth embodiments of the present invention,
- FIG. 12 is a flowchart of the microphone-speaker apparatus according to the first embodiment of the present invention,
- FIG. 13 is a flowchart of the microphone-speaker apparatus according to the fourth embodiment of the present invention, and
- FIG. 14 is a block diagram of the conventional microphone-speaker apparatus.
- The following description will be directed to preferred embodiments of the microphone-speaker apparatus according to the present invention with reference to FIGS. 1 to 13.
- The first embodiments of the microphone-
speaker apparatus 100 according to the present invention will now be described in detail hereinafter with reference to FIG. 1. - The construction of the microphone-
speaker apparatus 100 according to the first embodiment of the present invention will firstly be described. - Referring to FIG. 1 of the drawings, there is shown a microphone-
speaker apparatus 100 comprising: amicrophone unit 101 for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an analog audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the coherent sound wave including a normal sound wave and an abnormal sound wave, the raw sound wave being constituted by a plurality of raw wave components each having an audio frequency, and the coherent sound wave being constituted by a plurality of coherent wave components each having an audio frequency; an analog to digital converter (simply referred to as "A/D converter") 103 for converting the analog audio signal converted by themicrophone unit 101 into a digital audio signal (simply referred to as "audio signal"); aspeaker unit 102 for outputting the audio sound to themicrophone unit 101, the audio sound including a howling sound represented by the abnormal sound wave, and the howling sound being produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102; audiosignal dividing means 110 for dividing the audio signal received from themicrophone unit 101 through the A/D converter 103 into a plurality of raw component signals each indicative of the raw wave components based on frequency components analyzing methods such as for example a Fast Fourier Transformation, each of the raw component signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a current frame and a previous frame prior to the current frame; coherent component signal extracting means 120 for extracting a plurality of coherent component signals respectively indicative of the coherent wave components in response to the raw component signals divided by the audiosignal dividing means 110 in each of the sequential frames, and each of the coherent component signals in each of the sequential frames having a raw power value; power value calculating means 130 for calculating the raw power value of each of the coherent component signals extracted by the coherent componentsignal extracting means 120 in each of the sequential frame; power value adjusting means 140 for adjusting the raw power value of each of the coherent component signals calculated by the power value calculating means 130 to produce an adjusted power value of each of the coherent component signals in each of the sequential frame; power value judging means 150 for judging whether or not the adjusted power value of each of the coherent component signals in the current frame adjusted by the power value adjusting means 140 is increased along the time axis in each of the frequencies; power valueratio calculating means 160 for calculating a power value ratio of the adjusted power value of each of the coherent component signals to an average value of the adjusted power values of the coherent component signals adjusted by the power value adjusting means 140 in each of the sequential frames; power value ratio judging means 170 for judging whether or not the power value ratio of the adjusted power value of each of the coherent component signals to the average value of the adjusted power values of the coherent component signals calculated by the power valueratio calculating means 160 exceeds a predetermined threshold value in each of the sequential frames; howling sound judging means 180 for judging whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 based on each of results judged by the power value judging means 150 and results judged by the power value ratio judging means 170. - The audio signal dividing means 110, the coherent component signal extracting means 120, the power value calculating means 130, the power value adjusting means 140, the power value judging means 150, the power value ratio calculating
means 160, and the power value ratio judging means 170, as shown in FIG. 11, collectively constitutes a howlingsound judging section 104. - The term "coherent component wave" herein described is intended to indicate a sine wave.
- The coherent component signal extracting means 120 includes a previous
frame obtaining unit 121 for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame divided by the audio signal dividing means 110 in each of the sequential frames, a coherent componentsignal extracting unit 122 for extracting the coherent component signals in each of the sequential frames, a signaldifference obtaining unit 123 for obtaining a signal difference between the raw component signals divided by the audio signal dividing means 110 and the coherent component signals extracted by the coherent componentsignal extracting unit 122 in each of the sequential frames, and a signalcoefficient producing unit 124 for producing a plurality of signal coefficients in response to both the raw component signals of the previous frame obtained by the previousframe obtaining unit 121 and the signal difference between the raw component signals of the current frame and the coherent component signals of the current frame calculated by the signaldifference obtaining unit 123; and the coherent componentsignal extracting unit 122 is operative to extract the coherent component signals in each of the sequential frames in response to both the raw component signals of the previous frame obtained by the previousframe obtaining unit 121 and the signal coefficients produced by the signalcoefficient producing unit 124. The previousframe obtaining unit 121, the coherent componentsignal extracting unit 122, and the signaldifference obtaining unit 123 are respectively constituted by a delay device, an adaptive filter, and a subtracter. - In the microphone-
speaker apparatus 100 according to the first embodiment of the present invention thus constructed as previously mentioned, the component signals divided by the audio signal dividing means 110 are adaptively filtered by the coherent componentsignal extracting unit 122 with reference to the component signals delayed by the previousframe obtaining unit 121 having a predetermined delay time which is previously adjusted by an operator. - The component signals forming part of the component signals divided by the audio signal dividing means 110 hardly correlates with the coherent component of the component signals delayed by the previous
frame obtaining unit 121 under the condition that the component signals are respectively delayed by the previousframe obtaining unit 121 in response to the predetermined delay time, however, the coherent components of the component signals divided by the audio signal dividing means 110, such as the howling sound, securely correlate with the coherent component of the component signals delayed by the previousframe obtaining unit 121. The component signals delayed by the previousframe obtaining unit 121 in response to the thus adjusted delay time are respectively inputted to the coherent componentsignal extracting unit 122 as a reference signals. - The component signals delayed by the previous
frame obtaining unit 121 are adaptively filtered by the coherent componentsignal extracting unit 122 through a step of multiplying the component signals by the signal coefficients while the signalcoefficient producing unit 124 is receiving a minimum value of the mean squared error of the signal difference between the component signals divided by the audio signal dividing means 110 and the component signals filtered by the coherent componentsignal extracting unit 122. Here, the inclined arrow of the coherent componentsignal extracting unit 122 shown in FIG. 1 indicates the fact that the filter coefficients are respectively updated by the signalcoefficient producing unit 124 during periodic intervals. This leads to the fact the coherent components can be extracted by the coherent componentsignal extracting unit 122 from the component signals by using the filter coefficients updated by the filtercoefficient producing unit 124 during periodic intervals. - The following description will now be directed to the algorithm to be performed by the signal
coefficient producing unit 124. - The signal
coefficient producing unit 124 is operative to produce and update the signal coefficients in each of the sequential frames in response to both the raw component signals of the previous frame obtained by the previousframe obtaining unit 121 and the signal difference between the raw component signals of the current frame and the coherent component signals of the current frame calculated by the signaldifference obtaining unit 123 based on the complex least mean square algorithm depending on a following equation (1).
Where, the legends "X(k)", "E(k)", and "W(k)" respectively represent the component signals, the difference signal, and the signal coefficients. The legends " k ", " α ", and " δ " further respectively represent a sequential number indicative of each of the sequential frame, a predetermined first value, and a predetermined second value. The legends X(k)T and X(k)* still further respectively represent a transposition of the component signals "X(k)" and a conjugation of the component signals "X(k)". - Although the complex normalized least mean square algorithm is performed by the signal
coefficient producing unit 124 based on the equation (1), any one of the algorithms such as for example a complex least mean square algorithm, a recursive complex least squares algorithm, and a complex fast recursive least squares algorithm may be performed by the signalcoefficient producing unit 124. The minimum value of the mean square of the signal difference is obtained by the signalcoefficient producing unit 124 through step of updating the signal coefficients to be received by the coherent componentsignal extracting unit 122 based on the equation (1). - The power value adjusting means 140 is operative to adjust the raw power value of each of the coherent component signals calculated by the power value calculating means 130 in each of the sequential frames to obtain an adjusted power value "P(k)" of each of the coherent component signals through steps of adding a first product "FF×P_pre(k)" to a second product "(1.0-FF)×P(k-1)", the first product "FF × P_pre(k)" being indicative of a predetermined coefficient value "FF" multiplied by the raw power value "P_pre(k)" of each of the coherent component signals in the current frame "k" calculated by the power value calculating means 130, and the second product "FF×P_pre(k)" being indicative of the adjusted power value "P(k-1)" of each of the coherent component signals in the preceding frame "k-1" adjusted by the power value adjusting means 140 multiplied by a value "1.0 - FF" obtained by subtracting the predetermined coefficient "FF" value from a numerical value "1.0".
- The power value judging means 150 includes a previous frame obtaining unit 151 for obtaining the coherent component signals of the previous frame in response to the coherent component signals of the current frame adjusted by the power value adjusting means 140 in each of the sequential frames, a power value judging unit 152 for judging whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, and a first counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by a power value judging unit 152 that the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151,; the power value ratio judging means 170 includes a power value ratio judging unit 171 for judging whether or not the power value ratio of the adjusted power value of each of the coherent component signals to the average value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating means 160 exceeds the predetermined first threshold value in each of the sequential frames, and a second counter unit 172 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value ratio judging unit 171 that the power value ratio of the adjusted power value of each of the coherent component signals to the mean value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating means 160 in each of the sequential frames, and the howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 through steps of judging whether or not the value counted by the first counter unit 153 exceeds a predetermined second predetermined value, and judging whether or not the value counted by the second counter unit 172 exceeds a predetermined third predetermined value.
- The following description will now be directed to the process of the first embodiment of the microphone-
speaker apparatus 100 according to the present invention with reference to FIG. 12. - The audio sound is firstly received by the
microphone unit 101 to convert the audio sound to an analog audio signal. The audio signal received from themicrophone unit 101 through the A/D converter 103 is then divided by the audio signal dividing means 110 in the step S101. - The coherent component signals are respectively extracted by the coherent component signal extracting means 120 from the raw component signals divided by the audio signal dividing means 110 in each of the sequential frames in the step S102.
- The raw power value of each of the coherent component signals extracted by the coherent component signal extracting means 120 is then calculated by the power value calculating means 130 in each of the sequential frames in the step S103.
- The raw power value of each of the coherent component signals calculated by the power value calculating means 130 is then adjusted by the power value adjusting means 140 to produce an adjusted power value of each of the coherent component signals in each of the sequential frame in the
step S 104. - The coherent component signals of the previous frame is then obtained by the previous
frame obtaining unit 151 forming part of the power value judging means 150 in response to the coherent component signals of the current frame adjusted by the power value adjusting means 140 in each of the sequential frames in the step S105. - The judgment is then made by the power
value judging unit 152 forming part of the power value judging means 150 whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previousframe obtaining unit 151 in each of the sequential frames in the step S106. - The
first counter unit 153 is controlled by the powervalue judging unit 152 to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 152 that the adjusted power value of the coherent component signals of the current frame exceeds the adjusted power value of the coherent component signals of the previous frame in the step S107. Thefirst counter unit 153 is, on the other hand, controlled by the powervalue judging unit 152 to allow the value to be replaced by a numeral "0" when the judgment is made by the powervalue judging unit 152 that the adjusted power value of the coherent component signals of the current frame does not exceed the adjusted power value of the coherent component signals of the previous frame. - The power value ratio of the adjusted power value of each of the coherent component signals to an average value of the adjusted power values of the coherent component signals is then calculated by the power value ratio calculating means 160 in each of the sequential frames in the step S108.
- The judgment is then made by the power value
ratio judging unit 171 forming part of the power value ratio judging means 170 on whether or not the power value ratio of the adjusted power value of each of the coherent component signals to the average value of the adjusted power values of the coherent component signals calculated by the power value ratio calculating means 160 exceeds the predetermined first threshold value in each of the sequential frames in thestep S 109. - The number of the sequential frame in which the judgment is made that the power value ratio of the adjusted power value of each of the coherent component signals to the mean value of the adjusted power values of the coherent component signals is then counted by the
second counter unit 172 forming part of the power value ratio judging means 170 in thestep S 110. - The judgment is then made by the howling sound judging means 180 on whether or not the howling sound is produced while the
microphone unit 101 is receiving the audio sound outputted by thespeaker unit 102 through steps of judging whether or not the value counted by thefirst counter unit 153 exceeds a predetermined second predetermined value, and judging whether or not the value counted by thesecond counter unit 172 exceeds a predetermined third predetermined value in the step S111. - The howling sound is finally suppressed by the howling sound suppressing means 190 based on results judged by the howling sound judging means 180.
- From the above detailed description, it will be understood that the microphone-speaker apparatus according to the first embodiment of the present invention can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- While there has been described in the foregoing first embodiment about the fact that the power value judging means 150 includes a previous frame obtaining unit 151 for obtaining the coherent component signals of the previous frame in response to the coherent component signals of the current frame adjusted by the power value adjusting means 140, a power value judging unit 152 for judging whether or not the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, and a first counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 152 that the adjusted power value of the coherent component signals of the current frame adjusted by the power value adjusting means 140 exceeds the adjusted power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, the power value judging means 150, as shown in FIG. 7, may include a maximum power value obtaining unit 154 for obtaining a maximum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means 140; a previous frame obtaining unit 151 for obtaining the maximum power value of the coherent component signals of the previous frame in response to the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit 154, a power value judging unit 152 for judging whether or not the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit 154 exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151, and a first counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 152 that the maximum power value of the coherent component signals of the current frame obtained by the maximum power value obtaining unit 154 exceeds the maximum power value of the coherent component signals of the previous frame obtained by the previous frame obtaining unit 151.
- On the other hand, the power value judging means 150, as shown in FIG. 8, may include a minimum power
value obtaining unit 155 for obtaining a minimum power value from among the adjusted power values of the coherent component signals adjusted by the power value adjusting means 140; a previousframe obtaining unit 151 for obtaining the minimum power value of the coherent component signals of the previous frame in response to the minimum power value of the coherent component signals of the current frame obtained by the minimum powervalue obtaining unit 155, a powervalue judging unit 152 for judging whether or not the minimum power value of the coherent component signals of the current frame obtained by the minimum powervalue obtaining unit 155 exceeds the minimum power value of the coherent component signals of the previous frame obtained by the previousframe obtaining unit 151, and afirst counter unit 153 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 152 that the minimum power value of the coherent component signals of the current frame obtained by the minimum powervalue obtaining unit 155 exceeds the minimum power value of the coherent component signals of the previous frame obtained by the previousframe obtaining unit 151. - Although there has been described in the above about the first embodiment of the microphone-speaker apparatus according to the present invention, this embodiment may be replaced by the microphone-speaker apparatus according to the second to sixth embodiments of the present invention in order to attain the object of the present invention. The second to sixth embodiments of the microphone-speaker apparatus will then be described hereinafter.
- Referring then to FIGS. 2 to 6 of the drawings, there are shown block diagrams of the second to sixth embodiments of the microphone-speaker apparatus according to the present invention. The constitutional elements and the steps of the second to sixth embodiments of the microphone-speaker apparatus according to the present invention as shown in FIGS. 2 to 6 are entirely the same as those of the first embodiment of the microphone-speaker apparatus according to the present invention as shown in FIG. 1 except for the constitutional elements and the steps appearing in the following description. Therefore, only the constitutional elements and the steps of the second to sixth embodiments of the microphone-speaker apparatus different from those of the first embodiment of the microphone-speaker apparatus will be described in detail hereinafter. The constitutional elements and the steps of the second to sixth embodiments of the microphone-speaker apparatus entirely the same as those of the first embodiment of the microphone-speaker apparatus will not be described but bear the same reference numerals and legends as those of the first embodiment of the microphone-speaker apparatus in FIG. 1 to avoid tedious repetition.
- The following description will be directed to the constitutional elements and the steps of the second embodiment of the microphone-speaker apparatus different from those of the microphone-speaker apparatus of the first embodiment.
- The microphone-
speaker apparatus 200 according to the second embodiment of the present invention is shown in FIG. 2 as comprising amicrophone unit 101, an A/D converter 103, aspeaker unit 102, audio signal dividing means 110, coherent component signal extracting means 120, power value calculating means 130, power value adjusting means 140, power value judging means 150, power value ratio calculating means 160, power value ratio judging means 170, howling sound judging means 180, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 100 shown in FIG. 1 and thus its construction will not be described hereinafter. - The microphone-
speaker apparatus 200 according the second embodiment of the present invention further comprises raw component power calculating means 230 for calculating the power value of each of the raw component signals divided by the audio signal dividing means 110; raw component power adjusting means 240 for adjusting the power value of each of the raw component signals calculated by the raw component power calculating means 230 to produce an adjusted power value of each of the raw component signals; and raw component power judging means 250 for judging whether or not the power value of each of the raw component signals of the current frame exceeds the power value of each of the raw component signals of the preceding frame. The howling sound judging means 180 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 based on each of results judged by the power value judging means 150, the raw component power judging means 250, and the power value ratio judging means 170. - The raw component power judging means 250 includes a previous
frame obtaining unit 251 for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame adjusted by the raw component power adjusting means 240, a powervalue judging unit 252 for judging whether or not the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251, and athird counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251. The howling sound judging means 180 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals through steps of judging whether or not the value counted by thefirst counter unit 153 exceeds a predetermined second predetermined value, judging whether or not the value counted by thesecond counter unit 172 exceeds a predetermined third predetermined value, and judging whether or not the value counted by thethird counter unit 253 exceeds a predetermined fourth predetermined value. - The following description will now be directed to the process of the second embodiment of the microphone-
speaker apparatus 200 according to the present invention with no flowchart. - The power value of each of the raw component signals divided by the audio signal dividing means 110 is firstly calculated by the raw component power calculating means 230. The power value of each of the raw component signals calculated by the raw component power calculating means 230 is then adjusted by the raw component power adjusting means 240 to produce an adjusted power value of each of the raw component signals. The judgment is then made by the raw component power judging means 250 whether or not the power value of each of the raw component signals of the current frame exceeds the power value of each of the raw component signals of the preceding frame.
- The
third counter unit 253 is controlled by the powervalue judging unit 252 to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251. Thethird counter unit 253 is, on the other hand, controlled by the powervalue judging unit 252 to allow the value to be replaced by a numeral "0" when the judgment is made by the powervalue judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 does not exceed the adjusted power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251. - The judgment is finally made by the howling sound judging means 180 on whether or not the howling sound is produced while the
microphone unit 101 is receiving the audio sound outputted by thespeaker unit 102 based on results judged by each of the power value judging means 150, the raw component power judging means 250, and the power value ratio judging means 170. - From the above detailed description, it will be understood that the microphone-speaker apparatus according to the first embodiment of the present invention can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- While there has been described in the foregoing second embodiment about the fact that the raw component power judging means 250 includes a previous
frame obtaining unit 251 for obtaining the raw component signals of the previous frame in response to the raw component signals of the current frame adjusted by the raw component power adjusting means 240, a powervalue judging unit 252 for judging whether or not the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251, and athird counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 252 that the adjusted power value of the raw component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251. The howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals through steps of judging whether or not the value counted by the first counter unit 153 exceeds a predetermined second predetermined value, judging whether or not the value counted by the second counter unit 172 exceeds a predetermined third predetermined value, and judging whether or not the value counted by the third counter unit 253 exceeds a predetermined fourth predetermined value, the raw component power judging means 250 may include maximum power value obtaining unit 254 for obtaining a maximum power value from among the adjusted power values of the raw component signals adjusted by the raw component power adjusting means 240; a previous frame obtaining unit 251 for obtaining the maximum power value of the raw component signals of the previous frame in response to the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit 254, a power value judging unit 252 for judging whether or not the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit 254 exceeds the maximum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the maximum power value of the raw component signals of the current frame obtained by the maximum power value obtaining unit 254 exceeds the maximum power value of the raw component signals of the previous frame obtained by the previous frame obtaining unit 251. - On the other hand, the raw component power judging means 250, may include minimum power
value obtaining unit 255 for obtaining a minimum power value from among the adjusted power values of the raw component signals adjusted by the raw component power adjusting means 240; a previousframe obtaining unit 251 for obtaining the minimum power value of the raw component signals of the previous frame in response to the minimum power value of the raw component signals of the current frame obtained by the minimum powervalue obtaining unit 255, a powervalue judging unit 252 for judging whether or not the minimum power value of the raw component signals of the current frame obtained by the minimum powervalue obtaining unit 255 exceeds the minimum power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251, and athird counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 252 that the minimum power value of the raw component signals of the current frame obtained by the minimum powervalue obtaining unit 255 exceeds the minimum power value of the raw component signals of the previous frame obtained by the previousframe obtaining unit 251. - The raw sound wave is constituted by a plurality of sub-band sound wave components each having a frequency range and a raw sub-band power value.
- In the second embodiment, the raw component power calculating means 230 is operative to calculate the power value of each of the raw component signals divided by the audio signal dividing means 110, however, the raw component power calculating means 230, may be operative to calculate each of the raw sub-band power values from the raw component signals divided by the audio signal dividing means 110 in each of the frequency ranges, the raw component power adjusting means 240 being operative to respectively adjust the raw sub-band power values calculated by the raw component power calculating means 230 to produce an adjusted sub-band power values in each of the frequency ranges, and the raw component power judging means 250 being operative to judge whether or not the adjusted sub-band power values of the current frame exceeds the adjusted sub-band power value of the previous frame in each of the frequency ranges in each of the frequency ranges.
- The following description will be directed to the constitutional elements and the steps of the third embodiment of the microphone-speaker apparatus different from those of the microphone-speaker apparatus of the first and second embodiments.
- The microphone-
speaker apparatus 300 according the third embodiment of the present invention is shown in FIG. 3 as comprising amicrophone unit 101, an A/D converter 103, aspeaker unit 102, audio signal dividing means 110, coherent component signal extracting means 120, power value calculating means 130, power value adjusting means 140, power value judging means 150, power value ratio calculating means 160, power value ratio judging means 170, howling sound judging means 180, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 100 shown in FIG. 1 and thus its construction will not be described hereinafter. - The microphone-
speaker apparatus 300 according the third embodiment of the present invention further comprises component signal estimating means 320 for estimating and producing an estimated component signals of the current frames in response to both the raw component signals of the sequential frames divided by the audio signal dividing means 110 and the signal coefficients produced by the signalcoefficient producing unit 124; raw component power calculating means 230 for calculating the power value of each of the estimated component signals estimated by the component signal estimating means 320; raw component power adjusting means 240 for adjusting the power value of each of the estimated component signals calculated by the raw component power calculating means 230 to produce an adjusted power value of each of the estimated component signals; and raw component power judging means 250 for judging whether or not the power value of each of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the power value of each of the estimated component signals of the preceding frame adjusted by the raw component power adjusting means 240. The howling sound judging means 180 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals based on each of results judged by the power value judging means 150, results judged by the raw component power judging means 250, and results judged by the power value ratio judging means 170. - The raw component power judging means 250 includes a previous frame obtaining unit 251 for obtaining the estimated component signals of the previous frame in response to the estimated component signals of the current frame adjusted by the raw component power adjusting means 240, a power value judging unit 252 for judging whether or not the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251; and the howling sound judging means 180 is operative to judge whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 during periodic intervals through steps of judging whether or not the value counted by the first counter unit 153 exceeds a predetermined second predetermined value, judging whether or not the value counted by the second counter unit 172 exceeds a predetermined third predetermined value, and judging whether or not the value counted by the third counter unit 253 exceeds a predetermined fourth predetermined value.
- The following description will now be directed to the process of the third embodiment of the microphone-
speaker apparatus 300 according to the present invention with no flowchart. - The estimated component signals of the current frames are firstly estimated and produced by the component signal estimating means 320 in response to both the raw component signals of the sequential frames divided by the audio signal dividing means 110 and the signal coefficients produced by the signal
coefficient producing unit 124. The power value of each of the estimated component signals estimated by the component signal estimating means 320 is then calculated by the raw component power calculating means 230. The power value of each of the estimated component signals calculated by the raw component power calculating means 230 is then adjusted by the raw component power adjusting means 240 to produce an adjusted power value of each of the estimated component signals. The judgment is then made by the raw component power judging means 250 on whether or not the power value of each of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the power value of each of the estimated component signals of the preceding frame adjusted by the raw component power adjusting means 240. The judgment is then made by the howling sound judging means 180 on whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals based on each of results judged by the power value judging means 150, results judged by the raw component power judging means 250, and results judged by the power value ratio judging means 170. - From the above detailed description, it will be understood that the microphone-speaker apparatus according to the third embodiment of the present invention can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- While there has been described in the foregoing third embodiment about the fact that the raw component power judging means 250 includes a previous frame obtaining unit 251 for obtaining the estimated component signals of the previous frame in response to the estimated component signals of the current frame adjusted by the raw component power adjusting means 240, a power value judging unit 252 for judging whether or not the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the adjusted power value of the estimated component signals of the current frame adjusted by the raw component power adjusting means 240 exceeds the adjusted power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, the raw component power judging means 250 may include a maximum power value obtaining unit 254 for obtaining a maximum power value from among the adjusted power values of the estimated component signals adjusted by the power value adjusting means 140; a previous frame obtaining unit 251 for obtaining the maximum power value of the estimated component signals of the previous frame in response to the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit 254, a power value judging unit 252 for judging whether or not the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit 254 exceeds the maximum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251, and a third counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 252 that the maximum power value of the estimated component signals of the current frame obtained by the maximum power value obtaining unit 254 exceeds the maximum power value of the estimated component signals of the previous frame obtained by the previous frame obtaining unit 251.
- On the other hand, the raw component power judging means 250 may include a minimum power
value obtaining unit 255 for obtaining a minimum power value from among the adjusted power values of the estimated component signals adjusted by the raw component power adjusting means 240; a previousframe obtaining unit 251 for obtaining the minimum power value of the estimated component signals of the previous frame in response to the minimum power value of the raw estimated component signals of the current frame obtained by the minimum powervalue obtaining unit 255, a powervalue judging unit 252 for judging whether or not the minimum power value of the estimated component signals of the current frame obtained by the minimum powervalue obtaining unit 255 exceeds the minimum power value of the estimated component signals of the previous frame obtained by the previousframe obtaining unit 251, and athird counter unit 253 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 252 that the minimum power value of the estimated component signals of the current frame obtained by the minimum powervalue obtaining unit 255 exceeds the minimum power value of the estimated component signals of the previous frame obtained by the previousframe obtaining unit 251. - The raw sound wave is constituted by a plurality of sub-band sound wave components each having a frequency range and a raw sub-band power value.
- In the third embodiment, the raw component power calculating means 230 is operative to calculate the power value of each of the estimated component signals estimated by the component signal estimating means 320 in each of the frequency ranges, however, the raw component power calculating means 230 may be operative to calculate each of the raw sub-band power values from the estimated component signals estimated by the component signal estimating means 320 in each of the frequency ranges, the raw component power adjusting means 240 being operative to respectively adjust the sub-band power values calculated by the raw component power calculating means 230 to produce adjusted sub-band power values in each of the frequency ranges; and the raw component power judging means 250 being operative to judging whether or not the each of the sub-band power values of the current frame exceeds each of the sub-band power value of the previous frame in each of the frequency ranges.
- The following description will be directed to fourth embodiments of the microphone-speaker apparatus according to the present invention with reference to FIG. 4.
- The microphone-speaker apparatus 400 according the fourth embodiment of the present invention is shown in FIG. 4 as comprising: a microphone unit 101 for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert the audio sound to an audio signal, the raw sound wave including a coherent sound wave and an incoherent sound wave, the raw sound wave being constituted by a plurality of raw sub-band wave components each having a frequency range, and the coherent sound wave being constituted by a plurality of coherent wave components each having the audio frequency; a speaker unit 102 for outputting the audio sound to the microphone unit 101, the audio sound including a howling sound represented by the coherent sound wave, and the howling sound being produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102; audio signal dividing means 410 for dividing the audio signal indicative of the audio sound received by the microphone unit 101 into a plurality of raw sub-band component signals each indicative of the raw sub-band wave components, each of the raw sub-band component signals having a plurality of sequential frames divided along the time axis, and the sequential frames each having a current frame and a previous frame prior to the current frame; coherent component signal extracting means 420 for extracting a plurality of sub-band coherent component signals respectively indicative of the coherent wave components from the raw sub-band component signals divided by the audio signal dividing means 410 in each of the frequency ranges in each of sequential frames, and each of the sub-band coherent component signals in each of the sequential frames having a raw sub-band power value; power value calculating means 430 for calculating the raw sub-band power value of each of the sub-band coherent component signals extracted by the sub-band coherent component signal extracting means 420 in each of frequency ranges in each of sequential frames; power value adjusting means 440 for adjusting the raw sub-band power value of each of the sub-band coherent component signals calculated by the power value calculating means 430 to produce an adjusted sub-band power value of each of the sub-band coherent component signals in each of frequency ranges in each of sequential frames; power value judging means 450 for judging whether or not the adjusted sub-band power value of each of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of each of the sub-band coherent component signals of the previous frame adjusted by the power value adjusting means 440 in each of frequency ranges in each of sequential frames; power value ratio calculating means 460 for calculating a power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to an average value of the adjusted sub-band power values of the sub-band coherent component signals adjusted by the power value adjusting means 440 in each of frequency ranges in each of sequential frames; power value ratio judging means 470 for judging whether or not the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the average value of the adjusted sub-band power values of the sub-band coherent component signals calculated by the power value ratio calculating means 460 exceeds a predetermined threshold value in each of frequency ranges in each of sequential frames; howling sound judging means 480 for judging whether or not the howling sound is produced while the microphone unit 101 is receiving the audio sound outputted by the speaker unit 102 based on each of results judged by the power value judging means 450 and results judged by the power value ratio judging means 470 during periodic intervals; and howling sound suppressing means 190 for suppressing the howling sound based on results judged by the howling sound judging means 480.
- Although there have been descried in the first to third embodiments about the fact that the audio signal dividing means 110 is operative to divide the audio signal received from the
microphone unit 101 into a plurality of raw component signals based on the frequency components analyzing method such as for example Fast Fourier Transformation, the audio signal dividing means 410 forming part of the microphone-speaker apparatus 400 according to the fourth embodiment of the present invention is constituted by a plurality of band-pass filters. The band-bass filter may be constituted by any one of Finite Impulse Response filter, Infinite Impulse Response filter, and other digital signal processor which can divide the audio signal into the sub-band component signals each having a frequency range. - The coherent component signal extracting means 420 includes a previous
frame obtaining unit 421 for obtaining the raw sub-band component signals of the previous frame in response to the raw sub-band component signals of the current frame divided by the audio signal dividing means 410, a coherent componentsignal extracting unit 422 for extracting the sub-band coherent component signals, a signaldifference obtaining unit 423 for obtaining a signal difference between the raw sub-band component signals divided by the audio signal dividing means 410 and the sub-band coherent component signals extracted by the coherent componentsignal extracting unit 422, and a signalcoefficient producing unit 424 for producing a plurality of signal coefficients in response to both the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 421 and the signal difference between the raw sub-band component signals of the current frame and the sub-band coherent component signals of the current frame calculated by the signaldifference obtaining unit 423. The coherent componentsignal extracting unit 422 is operative to extract the sub-band coherent component signals in response to both the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 421 and the signal coefficients produced by the signalcoefficient producing unit 424. - Similarly to the calculation of the adjusted power value of the component signals performed by the first power value adjusting means 140 as has been described with reference to the first embodiment of the present invention, the power value adjusting means 440 is operative to adjust the sub-band raw power value of each of the sub-band coherent component signals calculated by the power value calculating means 430 to obtain a sub-band adjusted power value "P(k)" of each of the sub-band coherent component signals through steps of adding a first product "FF× P_pre(k)" to a second product "(1.0 - FF) × P(k-1)", the first product "FF × P_pre(k)" being indicative of a predetermined coefficient value "FF" multiplied by the raw power value "P_pre(k)" of each of the sub-band coherent component signals in the current frame "k" calculated by the power value calculating means 430, and the second product "(1.0―FF) × P(k-1)" being indicative of the adjusted power value "P(k-1)" of each of the sub-band coherent component signals in the preceding frame "k-1" adjusted by the power value adjusting means 440 multiplied by a value "1.0-FF" obtained by subtracting the predetermined coefficient value "FF" from a numerical value "1.0".
- The power value judging means 450 includes a previous
frame obtaining unit 451 for obtaining the sub-band coherent component signals of the previous frame in response to the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440, a powervalue judging unit 452 for judging whether or not the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previousframe obtaining unit 451, and afirst counter unit 453 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 452 that the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previousframe obtaining unit 451. - The power value ratio judging means 470 includes a power value
ratio judging unit 471 for judging whether or not the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the average value of the adjusted sub-band power values of the sub-band coherent component signals calculated by the power value ratio calculating means 460 exceeds the predetermined first threshold value, and asecond counter unit 472 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power valueratio judging unit 471 that the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the mean value of the adjusted sub-band power values of the sub-band coherent component signals calculated by the power value ratio calculating means 460, and the howling sound judging means 480 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals through steps of judging whether or not the value counted by thefirst counter unit 453 exceeds a predetermined second predetermined value, and judging whether or not the value counted by thesecond counter unit 472 exceeds a predetermined third predetermined value. - The following description will be directed to the process of the fourth embodiment of the microphone-
speaker apparatus 400 according to the present invention with reference to FIG. 13. - The audio sound is firstly received by the
microphone unit 101 to convert the audio sound to an analog audio signal. The audio signal received from themicrophone unit 101 through the A/D converter 103 is then divided by the audio signal dividing means 410 in the step S401. - The sub-band coherent component signals respectively indicative of the sub-band coherent wave components is then extracted by the coherent component signal extracting means 420 in response to the raw sub-band component signals divided by the audio signal dividing means 410 in each of the sequential frames in the step S402.
- The raw sub-band power value of each of the sub-band coherent component signals extracted by the coherent component signal extracting means 420 is then calculated by the power value calculating means 430 in each of the sequential frames in the step S403.
- The raw sub-band power value of each of the sub-band coherent component signals calculated by the power value calculating means 430 is then adjusted by the power value adjusting means 440 to produce an adjusted sub-band power value of each of the sub-band coherent component signals in each of the sequential frame in the step S404.
- The sub-band coherent component signals of the previous frame is then obtained by the previous
frame obtaining unit 451 forming part of the power value judging means 450 in response to the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 in each of the sequential frames in the step S405. - The judgment is then made by the power
value judging unit 452 forming part of the power value judging means 450 on whether or not the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previousframe obtaining unit 451 in each of the sequential frames in the step S406. - The
first counter unit 453 is controlled by the powervalue judging unit 452 to allow the value to be incremented by a numeral "1" when the judgment is made that the adjusted sub-band power value of the sub-band coherent component signals of the current frame exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame in the step S407. Thefirst counter unit 453 is, on the other hand, controlled by the powervalue judging unit 452 to allow the value to be replaced by a numeral "0" when the judgment is made that the adjusted sub-band power value of the sub-band coherent component signals of the current frame does not exceed the adjusted sub-band power value of the sub-band coherent component signals of the previous frame. - The power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to an average value of the adjusted sub-band power values of the sub-band coherent component signals is then calculated by the power value ratio calculating means 460 in each of the sequential frames in the step S408.
- The judgment is then made by the power value
ratio judging unit 471 forming part of the power value ratio judging means 470 on whether or not the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the average value of the adjusted sub-band power values of the sub-band coherent component signals calculated by the power value ratio calculating means 460 exceeds the predetermined first threshold value in each of the sequential frames in the step S409. - The number of the sequential frame in which the judgment is made that the power value ratio of the adjusted sub-band power value of each of the sub-band coherent component signals to the mean value of the adjusted sub-band power values of the sub-band coherent component signals is then counted by the
second counter unit 472 forming part of the power value ratio judging means 470 in the step S410. - The judgment is then made by the howling sound judging means 480 on whether or not the howling sound is produced while the
microphone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals through steps of judging whether or not the value counted by thefirst counter unit 453 exceeds a predetermined second predetermined value, and judging whether or not the value counted by thesecond counter unit 472 exceeds a predetermined third predetermined value during predetermined periodic intervals in the step S411. - The howling sound is finally suppressed by the howling sound suppressing means 190 based on results judged by the howling sound judging means 480 in the step S412.
- From the above detailed description, it will be understood that the microphone-speaker apparatus according to the fourth embodiment of the present invention can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- While there has been described in the foregoing fourth embodiment about the fact that the power value judging means 450 includes a previous frame obtaining unit 451 for obtaining the sub-band coherent component signals of the previous frame in response to the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440, a power value judging unit 452 for judging whether or not the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451, and a first counter unit 453 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 452 that the adjusted sub-band power value of the sub-band coherent component signals of the current frame adjusted by the power value adjusting means 440 exceeds the adjusted sub-band power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451, the power value judging means 450 may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the sub-band coherent component signals adjusted by the power value adjusting means 440; a previous frame obtaining unit 451 for obtaining the maximum power value of the sub-band coherent component signals of the previous frame in response to the maximum power value of the sub-band coherent component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit 452 for judging whether or not the maximum power value of the sub-band coherent component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451, and a third counter unit 453 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 452 that the maximum power value of the sub-band coherent component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the sub-band coherent component signals of the previous frame obtained by the previous frame obtaining unit 451.
- The power value judging means 450, on the other hand, may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the sub-band coherent component signals adjusted by the power value adjusting means 440; a previous
frame obtaining unit 451 for obtaining the minimum power value of the sub-band coherent component signals of the previous frame in response to the minimum power value of the sub-band coherent component signals of the current frame obtained by the minimum power value obtaining unit, a powervalue judging unit 452 for judging whether or not the minimum power value of the sub-band coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the sub-band coherent component signals of the previous frame obtained by the previousframe obtaining unit 451, and athird counter unit 453 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 452 that the minimum power value of the sub-band coherent component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the sub-band coherent component signals of the previous frame obtained by the previousframe obtaining unit 451. - The following description will be directed to the constitutional elements and the steps of the fifth embodiment of the microphone-speaker apparatus different from those of the microphone-speaker apparatus of the fourth embodiment.
- The microphone-
speaker apparatus 500 according the fifth embodiment of the present invention is shown in FIG. 5 as comprising amicrophone unit 101, an A/D converter 103, aspeaker unit 102, audio signal dividing means 410, coherent component signal extracting means 420, power value calculating means 430, power value adjusting means 440, power value judging means 450, power value ratio calculating means 460, power value ratio judging means 470, howling sound judging means 480, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 400 shown in FIG. 4 and thus its construction will not be described hereinafter. - The microphone-
speaker apparatus 500 according to the fifth embodiment of the present invention further comprises raw component power calculating means 530 for calculating the power value of each of the raw sub-band component signals divided by the audio signal dividing means 410; raw component power adjusting means 540 for adjusting the power value of each of the raw sub-band component signals calculated by the raw component power calculating means 530 to produce an adjusted power value of each of the raw sub-band component signals; and raw component power judging means 550 for judging whether or not the power value of each of the raw sub-band component signals of the current frame exceeds the power value of each of the raw sub-band component signals of the preceding frame. The howling sound judging means 480 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals based on each of results judged by the power value judging means 450, results judged by the raw component power judging means 550, and results judged by the power value ratio judging means 470. - The raw component power judging means 550 includes a previous
frame obtaining unit 551 for obtaining the raw sub-band component signals of the previous frame in response to the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a powervalue judging unit 552 for judging whether or not the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551, and athird counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw power value adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551. The howling sound judging means 480 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals through steps of judging whether or not the value counted by thefirst counter unit 453 exceeds a predetermined second predetermined value, judging whether or not the value counted by thesecond counter unit 472 exceeds a predetermined third predetermined value, and judging whether or not the value counted by thethird counter unit 553 exceeds a predetermined fourth predetermined value. - The following description will now be directed to the process of the second embodiment of the microphone-
speaker apparatus 500 according to the present invention with no flowchart. - The power value of each of the raw sub-band component signals divided by the audio signal dividing means 410 is firstly calculated by the raw component power calculating means 530. The power value of each of the raw sub-band component signals calculated by the raw component power calculating means 530 is then adjusted by the raw component power adjusting means 540 to produce an adjusted power value of each of the raw sub-band component signals. The raw sub-band component signals of the previous frame are respectively obtained by the previous
frame obtaining unit 551 in response to the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540. The judgment is then made by the powervalue judging unit 552 on whether or not the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551. - The
third counter unit 553 is controlled by the powervalue judging unit 552 to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw power value adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551. Thethird counter unit 553 is, on the other hand, controlled by the powervalue judging unit 552 to allow the value to be replaced by a numeral "0" when the judgment is made by the powervalue judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw power value adjusting means 540 does not exceed the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551. - The judgment is then made by the raw component power judging means 550 on whether or not the power value of each of the raw sub-band component signals of the sequential frames is increased along the time axis based on the value counted by the
third counter unit 553. The judgment is then made by the howling sound judging means 480 on whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals based on each of results judged by the power value judging means 450, results judged by the raw component power judging means 550, and results judged by the power value ratio judging means 470. - From the above detailed description, it will be understood that the microphone-speaker apparatus according to the fifth embodiment of the present invention can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- While there has been described in the foregoing fifth embodiment about the fact that the raw component power judging means 550 includes a previous frame obtaining unit 551 for obtaining the raw sub-band component signals of the previous frame in response to the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a power value judging unit 552 for judging whether or not the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the adjusted power value of the raw sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, the raw component power judging means 550 may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the raw sub-band component signals adjusted by the raw component power adjusting means 540; a previous frame obtaining unit 551 for obtaining the maximum power value of the raw sub-band component signals of the previous frame in response to the maximum power value of the raw sub-band component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit 552 for judging whether or not the maximum power value of the raw sub-band component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the maximum power value of the raw sub-band component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the raw sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551.
- The raw component power judging means 550, on the other hand, may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the raw sub-band component signals adjusted by the raw component power adjusting means 540; a previous
frame obtaining unit 551 for obtaining the minimum power value of the raw sub-band component signals of the previous frame in response to the minimum power value of the raw sub-band component signals of the current frame obtained by the minimum power value obtaining unit, a powervalue judging unit 552 for judging whether or not the minimum power value of the raw sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551, and athird counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 552 that the minimum power value of the raw sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the raw sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551. - The following description will be directed to the constitutional elements and the steps of the sixth embodiment of the microphone-speaker apparatus different from those of the microphone-speaker apparatus of the fourth and fifth embodiments.
- The microphone-
speaker apparatus 600 according the sixth embodiment of the present invention is shown in FIG. 6 as comprising amicrophone unit 101, an A/D converter 103, aspeaker unit 102, audio signal dividing means 410, coherent component signal extracting means 420, power value calculating means 430, power value adjusting means 440, power value judging means 450, power value ratio calculating means 460, power value ratio judging means 470, howling sound judging means 480, and howling sound suppressing means 190, all of which are the same in construction as the microphone-speaker apparatus 400 shown in FIG. 4 and thus its construction will not be described hereinafter. - The microphone-
speaker apparatus 600 further comprises component signal estimating means 620 for estimating and producing an estimated sub-band component signals of the current frames in response to both the raw sub-band component signals of the sequential frames divided by the audio signal dividing means 410 and the signal coefficients produced by the signalcoefficient producing unit 424; raw component power calculating means 530 for calculating the power value of each of the estimated sub-band component signals estimated by the component signal estimating means 620; raw component power adjusting means 540 for adjusting the power value of each of the estimated sub-band component signals calculated by the raw component power calculating means 530 to produce an adjusted power value of each of the estimated sub-band component signals; and raw component power judging means 550 for judging whether or not the power value of each of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the power value of each of the estimated sub-band component signals of the preceding frame adjusted by the raw component power adjusting means 540. The howling sound judging means 480 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals based on each of results judged by the power value judging means 450, results judged by the raw component power judging means 550, and results judged by the power value ratio judging means 470. - The raw component power judging means 550 includes a previous
frame obtaining unit 551 for obtaining the estimated sub-band component signals of the previous frame in response to the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a powervalue judging unit 552 for judging whether or not the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551, and athird counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 552 that the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551. The howling sound judging means 480 is operative to judge whether or not the howling sound is produced while themicrophone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals through steps of judging whether or not the value counted by thefirst counter unit 453 exceeds a predetermined second predetermined value, judging whether or not the value counted by thesecond counter unit 472 exceeds a predetermined third predetermined value, and judging whether or not the value counted by thethird counter unit 553 exceeds a predetermined fourth predetermined value. - The following description will now be directed to the process of the sixth embodiment of the microphone-
speaker apparatus 600 according to the present invention with no flowchart. - The estimated sub-band component signals of the current frames are firstly estimated and produced by the component signal estimating means 620 in response to both the raw sub-band component signals of the sequential frames divided by the audio signal dividing means 410 and the signal coefficients produced by the signal
coefficient producing unit 424. - The power value of each of the estimated sub-band component signals estimated by the component signal estimating means 620 is then calculated by the raw component power calculating means 530.
- The power value of each of the estimated sub-band component signals calculated by the raw component power calculating means 530 is then adjusted by the raw component power adjusting means 540 to produce an adjusted power value of each of the estimated sub-band component signals.
- Then judgment is then made by the raw component power judging means 550 on whether or not the power value of each of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the power value of each of the estimated sub-band component signals of the preceding frame adjusted by the raw component power adjusting means 540.
- The judgment is finally made by the howling sound judging means 480 on whether or not the howling sound is produced while the
microphone unit 101 is receiving the audio sound outputted by thespeaker unit 102 during periodic intervals based on each of results judged by the power value judging means 450, results judged by the raw component power judging means 550, and results judged by the power value ratio judging means 470. - From the above detailed description, it will be understood that the microphone-speaker apparatus according to the sixth embodiment of the present invention can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- While there has been described in the foregoing sixth embodiment about the fact that the raw component power judging means 550 includes a previous frame obtaining unit 551 for obtaining the estimated sub-band component signals of the previous frame in response to the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540, a power value judging unit 552 for judging whether or not the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the adjusted power value of the estimated sub-band component signals of the current frame adjusted by the raw component power adjusting means 540 exceeds the adjusted power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, the raw component power judging means 550 may include maximum power value obtaining unit for obtaining a maximum power value from among the adjusted power values of the estimated sub-band component signals adjusted by the raw component power adjusting means 540; a previous frame obtaining unit 551 for obtaining the maximum power value of the estimated sub-band component signals of the previous frame in response to the maximum power value of the estimated sub-band component signals of the current frame obtained by the maximum power value obtaining unit, a power value judging unit 552 for judging whether or not the maximum power value of the estimated sub-band component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551, and a third counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the power value judging unit 552 that the maximum power value of the estimated sub-band component signals of the current frame obtained by the maximum power value obtaining unit exceeds the maximum power value of the estimated sub-band component signals of the previous frame obtained by the previous frame obtaining unit 551.
- The raw component power judging means 550, on the other hand, may include minimum power value obtaining unit for obtaining a minimum power value from among the adjusted power values of the estimated sub-band component signals adjusted by the raw component power adjusting means 540; a previous
frame obtaining unit 551 for obtaining the minimum power value of the estimated sub-band component signals of the previous frame in response to the minimum power value of the estimated sub-band component signals of the current frame obtained by the minimum power value obtaining unit, a powervalue judging unit 552 for judging whether or not the minimum power value of the estimated sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the estimated sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551, and athird counter unit 553 having a value and operative to allow the value to be incremented by a numeral "1" when the judgment is made by the powervalue judging unit 552 that the minimum power value of the estimated sub-band component signals of the current frame obtained by the minimum power value obtaining unit exceeds the minimum power value of the estimated sub-band component signals of the previous frame obtained by the previousframe obtaining unit 551. - As will be see from the forgoing description, the microphone-speaker apparatus can enhance the quality of the audio sound to be outputted by the speaker unit by judging whether or not the howling sound is produced while the microphone unit is receiving the audio sound outputted by the speaker unit without being affected by the amplitude of the audio sound received by the microphone unit.
- While the subject invention has been described with relation to the preferred embodiments, various modifications and adaptations thereof will now be apparent to those skilled in the art as far as such modifications and adaptations fall within the scope of the appended claims intended to be covered thereby.
Claims (28)
- A microphone-speaker apparatus (100, 200, 300), comprising: a microphone unit (101) for receiving an audio sound represented by a raw sound wave varied in response to a time axis, said raw sound wave being constituted by a plurality of raw wave components each having an audio frequency, said raw sound wave including a coherent sound wave being constituted by a plurality of coherent wave components; a speaker unit (102) for outputting said audio sound to said microphone unit (101), said audio sound including a howling sound represented by at least one coherent sound wave, and said howling sound being produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102), said microphone-speaker apparatus (100, 200, 300) is characterized by further comprising: audio signal dividing means (110) for dividing an audio signal indicative of said audio sound received by said microphone unit (101) into a plurality of raw component signals respectively indicative of said raw wave components, each of said raw component signals having a plurality of sequential frames divided along said time axis, and said sequential frames each having a current frame and a previous frame prior to said current frame; coherent component signal extracting means (120) for extracting a plurality of coherent component signals respectively indicative of said coherent wave components from said raw component signals divided by said audio signal dividing means (110), each of said coherent component signals in each of said sequential frames having a raw power value; power value calculating means (130) for calculating said raw power value of each of said coherent component signals extracted by said coherent component signal extracting means (120); power value adjusting means (140) for adjusting said raw power value of each of said coherent component signals calculated by said power value calculating means (130) to produce an adjusted power value of each of said coherent component signals; power value judging means (150) for judging whether or not said adjusted power value of each of said coherent component signals is increased along said time axis; power value ratio calculating means (160) for calculating a power value ratio of said adjusted power value of each of said coherent component signals to an average value of said adjusted power values of said coherent component signals; power value ratio judging means (170) for judging whether or not said power value ratio of said adjusted power value of each of said coherent component signals to said average value of said adjusted power values of said coherent component signals exceeds a predetermined threshold value; howling sound judging means (180) for judging whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals based on each of results judged by said power value judging means (150) and results judged by said power value ratio judging means (170); and howling sound suppressing means (190) for suppressing said howling sound based on results judged by said howling sound judging means (180).
- A microphone-speaker apparatus (100, 200, 300) as set forth in claim 1, in which said coherent component signal extracting means (120) includes a previous frame obtaining unit (121) for obtaining said raw component signals of said previous frame in response to said raw component signals of said current frame divided by said audio signal dividing means (110), a coherent component signal extracting unit (122) for extracting said coherent component signals, a signal difference obtaining unit (123) for obtaining a signal difference between said raw component signals divided by said audio signal dividing means (110) and said coherent component signals extracted by said coherent component signal extracting unit (122), and a signal coefficient producing unit (124) for producing a plurality of signal coefficients in response to both said raw component signals of said previous frame obtained by said previous frame obtaining unit (121) and said signal difference between said raw component signals of said current frame and said coherent component signals of said current frame calculated by said signal difference obtaining unit (123); and said coherent component signal extracting unit (122) is operative to extract said coherent component signals in response to both said raw component signals of said previous frame obtained by said previous frame obtaining unit (121) and said signal coefficients produced by said signal coefficient producing unit (124).
- A microphone-speaker apparatus (100, 200, 300) as set forth in claim 2, in which said power value adjusting means (140) is operative to adjust said raw power value of each of said coherent component signals calculated by said power value calculating means (130) to obtain an adjusted power value of each of said coherent component signals through steps of adding a first product A to a second product B, said first product A being indicative of a predetermined coefficient value multiplied by said raw power value of each of said coherent component signals in said current frame calculated by said power value calculating means (130), and said second product B being indicative of said adjusted power value of each of said coherent component signals in said preceding frame adjusted by said power value adjusting means (140) multiplied by a value obtained by subtracting said predetermined coefficient value from a numerical value "1".
- A microphone-speaker apparatus (100, 200, 300) as set forth in claim 3, in which said power value judging means (150) includes a previous frame obtaining unit (151) for obtaining said adjusted power value of said previous frame in response to said adjusted power value of said current frame adjusted by said power value adjusting means (140) in each of said coherent component signals, a power value judging unit (152) for judging whether or not said adjusted power value of said current frame adjusted by said power value adjusting means (140) exceeds said adjusted power value of said previous frame obtained by said previous frame obtaining unit (151) in each of said coherent component signals, and a first counter unit (153) for counting the number of said sequential frames on the basis of the judgment of said power value judging unit (152), in which said power value ratio judging means (170) includes a power value ratio judging unit (171) for judging whether or not said power value ratio of said adjusted power value of each of said coherent component signals to said average value of said adjusted power values of said coherent component signals calculated by said power value ratio calculating means (160) exceeds a predetermined first threshold value, and a second counter unit (172) for counting the number of said sequential frames in each of said coherent component signals on the basis of the judgment of said power value ratio judging unit (171), and in which said howling sound judging means (180) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals through steps of judging whether or not said number of said sequential frames counted by said first counter unit (153) exceeds a predetermined second value, and judging whether or not said number of said sequential frames counted by said second counter unit (172) exceeds a predetermined third value.
- A microphone-speaker apparatus (200) as set forth in claim 4, which further comprises raw component power calculating means (230) for calculating said power values of said sequential frames in each of said raw component signals divided by said audio signal dividing means (110); raw component power adjusting means (240) for adjusting said power values of said sequential frames in each of said raw component signals calculated by said raw component power calculating means (230) to produce adjusted power values of said sequential frames in each of said raw component signals; and raw component power judging means (250) for judging whether or not said adjusted power value of said current frame exceeds said power value of said preceding frame in each of said raw component signals, and in which said howling sound judging means (180) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals based on each of results judged by said power value judging means (150), results judged by said raw component power judging means (250), and results judged by said power value ratio judging means (170).
- A microphone-speaker apparatus (200) as set forth in claim 5, in which said raw component power judging means (250) includes a previous frame obtaining unit (251) for obtaining said adjusted power value of said previous frame in response to said adjusted power value of said current frame adjusted by said raw component power adjusting means (240) in each of said raw component signals, a power value judging unit (252) for judging whether or not said adjusted power value of said current frame adjusted by said raw component power adjusting means (240) exceeds said adjusted power value of said previous frame obtained by said previous frame obtaining unit (251)in each of said raw component signals, and a third counter unit (253) for counting the number of said sequential frames in each of said raw component signals on the basis of the judgment of said power value judging unit (252); and in which said howling sound judging means (180) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals through steps of judging whether or not said number of said sequential frames counted by said first counter unit (153) exceeds a predetermined second value, judging whether or not said number of said sequential frames counted by said second counter unit (172) exceeds a predetermined third value, and judging whether or not said number of said sequential frames counted by said third counter unit (253) exceeds a predetermined fourth value.
- A microphone-speaker apparatus (300) as set forth in claim, 4, which further, comprises component signal estimating means (320) for estimating and producing estimated component signals of said current frame in response to both said raw component signals of said sequential frames divided by said audio signal dividing means (110) and said signal coefficients produced by said signal coefficient producing unit (124); raw component power calculating means (230) for calculating said power values of said sequential frames in each of said estimated component signals estimated by said component signal estimating means (320); raw component power adjusting means (240) for adjusting said power values of said sequential frames in each of said estimated component signals calculated by said raw component power calculating means (230) to produce adjusted power values of said sequential frames in each of said estimated component signals; and raw component power judging means (250) for judging whether or not said adjusted power value of said current frame adjusted by said raw component power adjusting means (240) exceeds said power value of said preceding frame adjusted by said raw component power adjusting means (240) in each of said estimated component signals, and in which said howling sound judging means (180) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals based on each of results judged by said power value judging means (150), results judged by said raw component power judging means (250), and results judged by said power value ratio judging means (170).
- A microphone-speaker apparatus (300) as set forth in claim 7, in which said raw component power judging means (250) includes a previous frame obtaining unit (251) for obtaining said adjusted power value of said previous frame in response to said adjusted power value of said current frame adjusted by said raw component power adjusting means (240) in each of said estimated component signals, a power value judging unit (252) for judging whether or not said adjusted power value of said current frame adjusted by said raw component power adjusting means (240) exceeds said adjusted power value of said previous frame obtained by said previous frame obtaining unit (251) in each of said estimated component signals, and a third counter unit (253) for counting the number of said sequential frames on the basis of the judgment of said power value judging unit (252) in each of said estimated component signals; and in which said howling sound judging means (180) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals through steps of judging whether or not said number of said sequential frames counted by said first counter unit (153) exceeds a predetermined second value, judging whether or not said number of said sequential frames counted by said second counter unit (172) exceeds a predetermined third value, and judging whether or not said number of said sequential frames counted by said third counter unit (253) exceeds a predetermined fourth value.
- A microphone-speaker apparatus (100) as set forth in claim 1, in which said power value judging means (150) includes maximum power value obtaining unit (154) for obtaining a maximum power value from among said adjusted power values of said coherent component signals adjusted by said power value adjusting means (140); a previous frame obtaining unit (151) for obtaining said maximum power value of said coherent component signals of said previous frame in response to said maximum power value of said coherent component signals of said current frame obtained by said maximum power value obtaining unit (154), a power value judging unit (152) for judging whether or not said maximum power value of said coherent component signals of said current frame obtained by said maximum power value obtaining unit (154) exceeds said maximum power value of said coherent component signals of said previous frame obtained by said previous frame obtaining unit (151), and a first counter unit (153) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (152) that said maximum power value of said coherent component signals of said current frame obtained by said maximum power value obtaining unit (154) exceeds said maximum power value of said coherent component signals of said previous frame obtained by said previous frame obtaining unit (151).
- A microphone-speaker apparatus (100) as set forth in claim 1, in which said power value judging means (150) includes minimum power value obtaining unit (155) for obtaining a minimum power value from among said adjusted power values of said coherent component signals adjusted by said power value adjusting means (140); a previous frame obtaining unit (151) for obtaining said minimum power value of said coherent component signals of said previous frame in response to said minimum power value of said coherent component signals of said current frame obtained by said minimum power value obtaining unit (155), a power value judging unit (152) for judging whether or not said minimum power value of said coherent component signals of said current frame obtained by said minimum power value obtaining unit (155) exceeds said minimum power value of said coherent component signals of said previous frame obtained by said previous frame obtaining unit (151), and a first counter unit (153) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (152) that said minimum power value of said coherent component signals of said current frame obtained by said minimum power value obtaining unit (155) exceeds said minimum power value of said coherent component signals of said previous frame obtained by said previous frame obtaining unit (151).
- A microphone-speaker apparatus (200) as set forth in claim 5, in which said raw component power judging means (250) includes maximum power value obtaining unit (254) for obtaining a maximum power value from among said adjusted power values of said raw component signals adjusted by said raw component power adjusting means (240); a previous frame obtaining unit (251) for obtaining said maximum power value of said raw component signals of said previous frame in response to said maximum power value of said raw component signals of said current frame obtained by said maximum power value obtaining unit (254), a power value judging unit (252) for judging whether or not said maximum power value of said raw component signals of said current frame obtained by said maximum power value obtaining unit (254) exceeds said maximum power value of said raw component signals of said previous frame obtained by said previous frame obtaining unit (251), and a third counter unit (253) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (252) that said maximum power value of said raw component signals of said current frame obtained by said maximum power value obtaining unit (254) exceeds said maximum power value of said raw component signals of said previous frame obtained by said previous frame obtaining unit (251).
- A microphone-speaker apparatus (200) as set forth in claim 5, in which said raw component power judging means (250) includes minimum power value obtaining unit (255) for obtaining a minimum power value from among said adjusted power values of said raw component signals adjusted by said raw component power adjusting means (240); a previous frame obtaining unit (251) for obtaining said minimum power value of said raw component signals of said previous frame in response to said minimum power value of said raw component signals of said current frame obtained by said minimum power value obtaining unit (255), a power value judging unit (252) for judging whether or not said minimum power value of said raw component signals of said current frame obtained by said minimum power value obtaining unit (255) exceeds said minimum power value of said raw component signals of said previous frame obtained by said previous frame obtaining unit (251), and a third counter unit (253) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (252) that said minimum power value of said raw component signals of said current frame obtained by said minimum power value obtaining unit (255) exceeds said minimum power value of said raw component signals of said previous frame obtained by said previous frame obtaining unit (251).
- A microphone-speaker apparatus (300) as set forth in claim 7, in which said raw component power judging means (250) includes maximum power value obtaining unit (254) for obtaining a maximum power value from among said adjusted power values of said estimated component signals adjusted by said raw component power adjusting means (240); a previous frame obtaining unit (251) for obtaining said maximum power value of said estimated component signals of said previous frame in response to said maximum power value of said estimated component signals of said current frame obtained by said maximum power value obtaining unit (254), a power value judging unit (252) for judging whether or not said maximum power value of said estimated component signals of said current frame obtained by said maximum power value obtaining unit (254) exceeds said maximum power value of said estimated component signals of said previous frame obtained by said previous frame obtaining unit (251), and a third counter unit (253) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (252) that said maximum power value of said estimated component signals of said current frame obtained by said maximum power value obtaining unit (254) exceeds said maximum power value of said estimated component signals of said previous frame obtained by said previous frame obtaining unit (251).
- A microphone-speaker apparatus (300) as set forth in claim 7, in which said raw component power judging means (250) includes minimum power value obtaining unit (255) for obtaining a minimum power value from among said adjusted power values of said estimated component signals adjusted by said raw component power adjusting means (240); a previous frame obtaining unit (251) for obtaining said minimum power value of said estimated component signals of said previous frame in response to said minimum power value of said estimated component signals of said current frame obtained by said minimum power value obtaining unit (255), a power value judging unit (252) for judging whether or not said minimum power value of said estimated component signals of said current frame obtained by said minimum power value obtaining unit (255) exceeds said minimum power value of said estimated component signals of said previous frame obtained by said previous frame obtaining unit (251), and a third counter unit (253) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (252) that said minimum power value of said estimated component signals of said current frame obtained by said minimum power value obtaining unit (255) exceeds said minimum power value of said estimated component signals of said previous frame obtained by said previous frame obtaining unit (251).
- A microphone-speaker apparatus (400, 500, 600), comprising: a microphone unit (101) for receiving an audio sound represented by a raw sound wave varied in response to a time axis to convert said audio sound to an audio signal, said raw sound wave including a coherent sound wave and an incoherent sound wave, said raw sound wave being constituted by a plurality of raw sub-band wave components each having a frequency range, and said coherent sound wave being constituted by a plurality of coherent wave components each having an audio frequency; and a speaker unit (102) for outputting said audio sound to said microphone unit (101), said audio sound including a howling sound represented by said coherent sound wave, and said howling sound being produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102); said microphone-speaker apparatus being characterized by further comprising audio signal dividing means (410) for dividing said audio signal converted by said microphone unit (101) into a plurality of raw sub-band component signals respectively indicative of said raw sub-band wave components, each of said raw sub-band component signals having a plurality of sequential frames divided along said time axis, and said sequential frames each having a current frame and a previous frame prior to said current frame; coherent component signal extracting means (420) for extracting a plurality of sub-band coherent component signals respectively indicative of said coherent wave components from said raw sub-band component signals divided by said audio signal dividing means (410), and each of said sub-band coherent component signals in each of said sequential frames having a raw sub-band power value; power value calculating means (430) for calculating said raw sub-band power value of each of said sub-band coherent component signals extracted by said sub-band coherent component signal extracting means (420); power value adjusting means (440) for adjusting said raw sub-band power value of each of said sub-band coherent component signals calculated by said power value calculating means (430) to produce an adjusted sub-band power value of each of said sub-band coherent component signals; power value judging means (450) for judging whether or not said adjusted sub-band power value of each of said sub-band coherent component signals of said current frame adjusted by said power value adjusting means (440) exceeds said adjusted sub-band power value of each of said sub-band coherent component signals of said previous frame adjusted by said power value adjusting means (440); power value ratio calculating means (460) for calculating a power value ratio of said adjusted sub-band power value of each of said sub-band coherent component signals to an average value of said adjusted sub-band power values of said sub-band coherent component signals adjusted by said power value adjusting means (440); power value ratio judging means (470) for judging whether or not said power value ratio of said adjusted sub-band power value of each of said sub-band coherent component signals to said average value of said adjusted sub-band power values of said sub-band coherent component signals calculated by said power value ratio calculating means (460) exceeds a predetermined threshold value; howling sound judging means (480) for judging whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals based on results judged by said power value juding means (450) and results judged by said power value ratio judging means (470); and howling sound suppressing means (190) for suppressing said howling sound based on results judged by said howling sound judging means (480).
- A microphone-speaker apparatus (400, 500, 600) as set forth in claim 15, in which said coherent component signal extracting means (420) includes a previous frame obtaining unit (421) for obtaining said raw sub-band component signals of said previous frame in response to said raw sub-band component signals of said current frame divided by said audio signal dividing means (410), a coherent component signal extracting unit (422) for extracting said sub-band coherent component signals, a signal difference obtaining unit (423) for obtaining a signal difference between said raw sub-band component signals divided by said audio signal dividing means (410) and said sub-band coherent component signals extracted by said coherent component signal extracting unit (422), and a signal coefficient producing unit (424) for producing a plurality of signal coefficients in response to both said raw sub-band component signals of said previous frame obtained by said previous frame obtaining unit (421) and said signal difference between said raw sub-band component signals of said current frame and said sub-band coherent component signals of said current frame calculated by said signal difference obtaining unit (423); and said coherent component signal extracting unit (422) is operative to extract said sub-band coherent component signals in response to both said raw sub-band component signals of said previous frame obtained by said previous frame obtaining unit (421) and said signal coefficients produced by said signal coefficient producing unit (424).
- A microphone-speaker apparatus (400, 500, 600) as set forth in claim 16, in which said power value adjusting means (440) is operative to adjust said sub-band raw power value of each of said sub-band coherent component signals calculated by said power value calculating means (430) to obtain a sub-band adjusted power value of each of said sub-band coherent component signals through steps of adding a first product A to a second product B, said first product A being indicative of a predetermined coefficient value multiplied by said raw power value of each of said sub-band coherent component signals in said current frame calculated by said power value calculating means (430), and said second product B being indicative of said adjusted power value of each of said sub-band coherent component signals in said preceding frame adjusted by said power value adjusting means (440) multiplied by a value obtained by subtracting said predetermined coefficient value from a numerical value "1".
- A microphone-speaker apparatus (400, 500, 600) as set forth in claim 17, in which said power value judging means (450) includes a previous frame obtaining unit (451) for obtaining said adjusted sub-band power value of said previous frame in response to said adjusted sub-band power value of said current frame adjusted by said power value adjusting means (440) in each of said sub-band coherent component signals, a power value judging unit (452) for judging whether or not said adjusted sub-band power value of said current frame adjusted by said power value adjusting means (440) exceeds said adjusted sub-band power value of said previous frame obtained by said previous frame obtaining unit (451) in each of said sub-band coherent component signals, and a first counter unit (453) for counting the number of said sequential frames on the basis of the judgment of said power value judging unit (452); in which said power value ratio judging means (470) includes a power value ratio judging unit (471) for judging whether or not said power value ratio of said adjusted sub-band power value of each of said sub-band coherent component signals to said average value of said adjusted sub-band power values of said sub-band coherent component signals calculated by said power value ratio calculating means (460) exceeds said predetermined first threshold value, and a second counter unit (472) for counting the number of said sequential frames on the basis of the judgment of said power value ratio judging unit (471); and in which said howling sound judging means (480) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals through steps of judging whether or not said number of said sequential frames counted by said first counter unit (453) exceeds a predetermined second value, and judging whether or not said number of said sequential frames counted by said second counter unit (472) exceeds a predetermined third value.
- A microphone-speaker apparatus (500) as set forth in claim 18, which further comprises raw component power calculating means (530) for calculating said power values of said sequential frames in each of said raw sub-band component signals divided by said audio signal dividing means (410); raw component power adjusting means (540) for adjusting said power values of said sequential frames in each of said raw sub-band component signals calculated by said raw component power calculating means (530) to produce adjusted power values of said sequential frames in each of said raw sub-band component signals; and raw component power judging means (550) for judging whether or not said adjusted power value of said current frame exceeds said adjusted power value of said preceding frame in each of said raw sub-band component signals, and in which said howling sound judging means (480) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals based on each of results judged by said power value judging means (450), results judged by said raw component power judging means (550), and results judged by said power value ratio judging means (470).
- A microphone-speaker apparatus (500) as set forth in claim 19, in which said raw component power judging means (550) includes a previous frame obtaining unit (551) for obtaining said adjusted power value of said previous frame in response to said adjusted power value of said current frame adjusted by said raw component power adjusting means (540) in each of said raw sub-band component signals, a power value judging unit (552) for judging whether or not said adjusted power value of said current frame adjusted by said raw component power adjusting means (540) exceeds said adjusted power value of said previous frame obtained by said previous frame obtaining unit (551) in each of said raw sub-band component signals, and a third counter unit (553) for counting the number of said sequential frames on the basis of the judgment of said power value judging unit (552); and in which said howling sound judging means (480) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals through steps of judging whether or not said number of said sequential frames counted by said first counter unit (453) exceeds a predetermined second value, judging whether or not said number of said sequential frames counted by said second counter unit (472) exceeds a predetermined third value, and judging whether or not said number of said sequential frames counted by said third counter unit (553) exceeds a predetermined fourth value.
- A microphone-speaker apparatus (600) as set forth in claim 18, which further comprises component signal estimating means (620) for estimating and producing estimated sub-band component signals of said current frame in response to both said raw sub-band component signals of said sequential frames divided by said audio signal dividing means (410) and said signal coefficients produced by said signal coefficient producing unit (424); raw component power calculating means (530) for calculating said power values of said sequential frames in each of said estimated sub-band component signals estimated by said component signal estimating means (620); raw component power adjusting means (540) for adjusting said power values of said sequential frames in each of said estimated sub-band component signals calculated by said raw component power calculating means (530) to produce adjusted power values of said sequential frames in each of said estimated sub-band component signals; and raw component power judging means (550) for judging whether or not said power value of each of said estimated sub-band component signals of said current frame adjusted by said raw component power adjusting means (540) exceeds said adjusted power value of said preceding frame adjusted by said raw component power adjusting means (540) in each of said estimated sub-band component signals, and in which said howling sound judging means (480) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals based on each of results judged by said power value judging means (450), results judged by said raw component power judging means (550), and results judged by said power value ratio judging means (470).
- A microphone-speaker apparatus (600) as set forth in claim 21, in which said raw component power judging means (550) includes a previous frame obtaining unit (551) for obtaining said adjusted power value of said previous frame in response to said adjusted power value of said current frame adjusted by said raw component power adjusting means (540) in each of said estimated sub-band component signals, a power value judging unit (552) for judging whether or not said adjusted power value of said current frame adjusted by said raw component power adjusting means (540) exceeds said adjusted power value of said previous frame obtained by said previous frame obtaining unit (551) in each of said estimated sub-band component signals, and a third counter unit (553) for counting the number of said sequential frames on the basis of the judgment of said power value judging unit (552); and in which said howling sound judging means (480) is operative to judge whether or not said howling sound is produced while said microphone unit (101) is receiving said audio sound outputted by said speaker unit (102) during periodic intervals through steps of judging whether or not said number of said sequential frames counted by said first counter unit (453) exceeds a predetermined second value, judging whether or not said number of said sequential frames counted by said second counter unit (472) exceeds a predetermined third value, and judging whether or not said number of said sequential frames counted by said third counter unit (553) exceeds a predetermined fourth value.
- A microphone-speaker apparatus (400) as set forth in claim 15, in which said power value judging means (450) includes maximum power value obtaining unit (454) for obtaining a maximum power value from among said adjusted power values of said sub-band coherent component signals adjusted by said power value adjusting means (440); a previous frame obtaining unit (451) for obtaining said maximum power value of said sub-band coherent component signals of said previous frame in response to said maximum power value of said sub-band coherent component signals of said current frame obtained by said maximum power value obtaining unit (454), a power value judging unit (452) for judging whether or not said maximum power value of said sub-band coherent component signals of said current frame obtained by said maximum power value obtaining unit (454) exceeds said maximum power value of said sub-band coherent component signals of said previous frame obtained by said previous frame obtaining unit (451), and a first counter unit (453) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (452) that said maximum power value of said sub-band coherent component signals of said current frame obtained by said maximum power value obtaining unit (454) exceeds said maximum power value of said sub-band coherent component signals of said previous frame obtained by said previous frame obtaining unit (451).
- A microphone-speaker apparatus (400) as set forth in claim 15, in which said power value judging means (450) includes minimum power value obtaining unit (455) for obtaining a minimum power value from among said adjusted power values of said sub-band coherent component signals adjusted by said power value adjusting means (440); a previous frame obtaining unit (451) for obtaining said minimum power value of said sub-band coherent component signals of said previous frame in response to said minimum power value of said sub-band coherent component signals of said current frame obtained by said minimum power value obtaining unit (455), a power value judging unit (452) for judging whether or not said minimum power value of said sub-band coherent component signals of said current frame obtained by said minimum power value obtaining unit (455) exceeds said minimum power value of said sub-band coherent component signals of said previous frame obtained by said previous frame obtaining unit (451), and a first counter unit (453) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (452) that said minimum power value of said sub-band coherent component signals of said current frame obtained by said minimum power value obtaining unit (455) exceeds said minimum power value of said sub-band coherent component signals of said previous frame obtained by said previous frame obtaining unit (451).
- A microphone-speaker apparatus (500) as set forth in claim 19, in which said raw component power judging means (550) includes maximum power value obtaining unit for obtaining a maximum power value from among said adjusted power values of said raw sub-band component signals adjusted by said raw component power adjusting means (540); a previous frame obtaining unit (551) for obtaining said maximum power value of said raw sub-band component signals of said previous frame in response to said maximum power value of said raw sub-band component signals of said current frame obtained by said maximum power value obtaining unit, a power value judging unit (552) for judging whether or not said maximum power value of said raw sub-band component signals of said current frame obtained by said maximum power value obtaining unit exceeds said maximum power value of said raw sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551), and a third counter unit (553) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (552) that said maximum power value of said raw sub-band component signals of said current frame obtained by said maximum power value obtaining unit exceeds said maximum power value of said raw sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551).
- A microphone-speaker apparatus (500) as set forth in claim 19, in which said raw component power judging means (550) includes minimum power value obtaining unit for obtaining a minimum power value from among said adjusted power values of said raw sub-band component signals adjusted by said raw component power adjusting means (540); a previous frame obtaining unit (551) for obtaining said minimum power value of said raw sub-band component signals of said previous frame in response to said minimum power value of said raw sub-band component signals of said current frame obtained by said minimum power value obtaining unit, a power value judging unit (552) for judging whether or not said minimum power value of said raw sub-band component signals of said current frame obtained by said minimum power value obtaining unit exceeds said minimum power value of said raw sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551), and a third counter unit (553) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (552) that said minimum power value of said raw sub-band component signals of said current frame obtained by said minimum power value obtaining unit exceeds said minimum power value of said raw sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551).
- A microphone-speaker apparatus (600) as set forth in claim 21, in which said raw component power judging means (550) includes maximum power value obtaining unit for obtaining a maximum power value from among said adjusted power values of said estimated sub-band component signals adjusted by said raw component power adjusting means (540); a previous frame obtaining unit (551) for obtaining said maximum power value of said estimated sub-band component signals of said previous frame in response to said maximum power value of said estimated sub-band component signals of said current frame obtained by said maximum power value obtaining unit, a power value judging unit (552) for judging whether or not said maximum power value of said estimated sub-band component signals of said current frame obtained by said maximum power value obtaining unit exceeds said maximum power value of said estimated sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551), and a third counter unit (553) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (552) that said maximum power value of said estimated sub-band component signals of said current frame obtained by said maximum power value obtaining unit exceeds said maximum power value of said estimated sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551).
- A microphone-speaker apparatus (600) as set forth in claim 21, in which said raw component power judging means (550) includes minimum power value obtaining unit for obtaining a minimum power value from among said adjusted power values of said estimated sub-band component signals adjusted by said raw component power adjusting means (540); a previous frame obtaining unit (551) for obtaining said minimum power value of said estimated sub-band component signals of said previous frame in response to said minimum power value of said estimated sub-band component signals of said current frame obtained by said minimum power value obtaining unit, a power value judging unit (552) for judging whether or not said minimum power value of said estimated sub-band component signals of said current frame obtained by said minimum power value obtaining unit exceeds said minimum power value of said estimated sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551), and a third counter unit (553) for counting a number of said sequential frame in which said judgment is made by said power value judging unit (552) that said minimum power value of said estimated sub-band component signals of said current frame obtained by said minimum power value obtaining unit exceeds said minimum power value of said estimated sub-band component signals of said previous frame obtained by said previous frame obtaining unit (551).
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2002058891 | 2002-03-05 | ||
JP2002058891A JP3973929B2 (en) | 2002-03-05 | 2002-03-05 | Howling detection device |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1343352A1 EP1343352A1 (en) | 2003-09-10 |
EP1343352B1 true EP1343352B1 (en) | 2006-07-05 |
Family
ID=27751078
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP03004360A Expired - Lifetime EP1343352B1 (en) | 2002-03-05 | 2003-03-03 | Microphone-speaker apparatus |
Country Status (7)
Country | Link |
---|---|
US (1) | US6674863B2 (en) |
EP (1) | EP1343352B1 (en) |
JP (1) | JP3973929B2 (en) |
CN (1) | CN100338969C (en) |
AT (1) | ATE332619T1 (en) |
DE (1) | DE60306562D1 (en) |
DK (1) | DK1343352T3 (en) |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4287762B2 (en) * | 2004-02-20 | 2009-07-01 | パナソニック株式会社 | Howling detection method and apparatus, and acoustic apparatus including the same |
JP2006121188A (en) * | 2004-10-19 | 2006-05-11 | Matsushita Electric Ind Co Ltd | Howling suppressing apparatus |
US8144895B2 (en) | 2005-05-18 | 2012-03-27 | Panasonic Corporation | Howling control apparatus and acoustic apparatus |
JP4890050B2 (en) * | 2006-02-27 | 2012-03-07 | 株式会社ディーアンドエムホールディングス | Audio signal amplifier |
US8081766B2 (en) * | 2006-03-06 | 2011-12-20 | Loud Technologies Inc. | Creating digital signal processing (DSP) filters to improve loudspeaker transient response |
EP2385711A1 (en) * | 2009-01-30 | 2011-11-09 | Panasonic Corporation | Howling suppressing apparatus, howling suppressing method, program, and integrated circuit |
DK200970303A (en) * | 2009-12-29 | 2011-06-30 | Gn Resound As | A method for the detection of whistling in an audio system and a hearing aid executing the method |
CN103222209B (en) * | 2010-11-18 | 2014-11-26 | 希尔Ip有限公司 | Systems and methods for reducing unwanted sounds in signals received from an arrangement of microphones |
CN102547526B (en) * | 2012-01-13 | 2014-12-24 | 广东启明科技发展有限公司 | Real-time monitoring method and system of microphone working state |
US9351072B2 (en) | 2013-11-05 | 2016-05-24 | Bose Corporation | Multi-band harmonic discrimination for feedback suppression |
CN105095232B (en) * | 2014-04-29 | 2019-06-25 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
US9549621B2 (en) * | 2015-06-15 | 2017-01-24 | Roseline Michael Neveling | Crib mountable noise suppressor |
US10257620B2 (en) * | 2016-07-01 | 2019-04-09 | Sonova Ag | Method for detecting tonal signals, a method for operating a hearing device based on detecting tonal signals and a hearing device with a feedback canceller using a tonal signal detector |
CN108093356B (en) * | 2016-11-23 | 2020-10-23 | 杭州萤石网络有限公司 | Howling detection method and device |
CN111052767B (en) * | 2017-08-28 | 2022-04-15 | 索尼公司 | Audio processing device, audio processing method, and information processing device |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3235925B2 (en) * | 1993-11-19 | 2001-12-04 | 松下電器産業株式会社 | Howling suppression device |
JP2760373B2 (en) * | 1995-03-03 | 1998-05-28 | 日本電気株式会社 | Noise canceller |
US5717772A (en) | 1995-08-07 | 1998-02-10 | Motorola, Inc. | Method and apparatus for suppressing acoustic feedback in an audio system |
US5999631A (en) * | 1996-07-26 | 1999-12-07 | Shure Brothers Incorporated | Acoustic feedback elimination using adaptive notch filter algorithm |
JP3152160B2 (en) * | 1996-11-13 | 2001-04-03 | ヤマハ株式会社 | Howling detection prevention circuit and loudspeaker using the same |
JP3240947B2 (en) * | 1997-01-28 | 2001-12-25 | ヤマハ株式会社 | Howling detector and howling cancel device |
JPH11127496A (en) * | 1997-10-20 | 1999-05-11 | Sony Corp | Howling removing device |
DE19802568C2 (en) * | 1998-01-23 | 2003-05-28 | Cochlear Ltd | Hearing aid with compensation of acoustic and / or mechanical feedback |
JP4568439B2 (en) * | 2001-01-22 | 2010-10-27 | パナソニック株式会社 | Echo suppression device |
-
2002
- 2002-03-05 JP JP2002058891A patent/JP3973929B2/en not_active Expired - Lifetime
-
2003
- 2003-03-03 US US10/378,442 patent/US6674863B2/en not_active Expired - Lifetime
- 2003-03-03 DE DE60306562T patent/DE60306562D1/en not_active Expired - Lifetime
- 2003-03-03 AT AT03004360T patent/ATE332619T1/en not_active IP Right Cessation
- 2003-03-03 EP EP03004360A patent/EP1343352B1/en not_active Expired - Lifetime
- 2003-03-03 DK DK03004360T patent/DK1343352T3/en active
- 2003-03-05 CN CNB031597343A patent/CN100338969C/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
DE60306562D1 (en) | 2006-08-17 |
JP3973929B2 (en) | 2007-09-12 |
US6674863B2 (en) | 2004-01-06 |
EP1343352A1 (en) | 2003-09-10 |
JP2003259480A (en) | 2003-09-12 |
DK1343352T3 (en) | 2006-10-30 |
CN1489417A (en) | 2004-04-14 |
CN100338969C (en) | 2007-09-19 |
US20030169892A1 (en) | 2003-09-11 |
ATE332619T1 (en) | 2006-07-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1343352B1 (en) | Microphone-speaker apparatus | |
JP3235925B2 (en) | Howling suppression device | |
US7796767B2 (en) | Howling detection method, device, and acoustic device using the same | |
JP3795070B2 (en) | Mobile radio device with hands-free call device | |
JP4681163B2 (en) | Howling detection and suppression device, acoustic device including the same, and howling detection and suppression method | |
EP0556992B1 (en) | Noise attenuation system | |
US6611601B2 (en) | Echo sound signal suppressing apparatus | |
US7190800B2 (en) | Howling control device and howling control method | |
EP0843502A1 (en) | Howling detection and prevention circuit and a loudspeaker system employing the same | |
US20030097257A1 (en) | Sound signal process method, sound signal processing apparatus and speech recognizer | |
KR0139176B1 (en) | Multi-resolution linear distortion compensation method and apparatus | |
Joson et al. | Adaptive feedback cancellation with frequency compression for hearing aids | |
EP1814107B1 (en) | Method for extending the spectral bandwidth of a speech signal and system thereof | |
AU2017208909A1 (en) | Subband spatial and crosstalk cancellation for audio reproduction | |
CN110248300B (en) | Howling suppression method based on autonomous learning and sound amplification system | |
CN112037816A (en) | Voice signal frequency domain frequency correction, howling detection and suppression method and device | |
CN111798864B (en) | Echo cancellation method and device, electronic equipment and storage medium | |
CN111182431A (en) | Howling suppression method for conference sound reinforcement system | |
EP2230664B1 (en) | Method and apparatus for attenuating noise in an input signal | |
US20040242157A1 (en) | Device and method for supressing periodic interference signals | |
JP3451022B2 (en) | Method and apparatus for improving clarity of loud sound | |
CN114286253B (en) | Audio processing method and device and audio playing equipment | |
JP2000105599A (en) | Noise level time variation coefficient calculating method, device thereof, and noise reducing method | |
US7010556B1 (en) | Antenna treatment method and system | |
US6580798B1 (en) | Hearing aid |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK |
|
17P | Request for examination filed |
Effective date: 20031209 |
|
17Q | First examination report despatched |
Effective date: 20040116 |
|
AKX | Designation fees paid |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED. Effective date: 20060705 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: LI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: CH Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 60306562 Country of ref document: DE Date of ref document: 20060817 Kind code of ref document: P |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20061005 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20061005 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20061006 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20061016 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: T3 |
|
NLV1 | Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20061205 |
|
EN | Fr: translation not filed | ||
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20070410 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20070303 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070305 Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070303 Ref country code: FR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20070511 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20061006 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20070303 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20070106 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20060705 |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: WD Ref document number: 1056662 Country of ref document: HK |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DK Payment date: 20130312 Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: DK Ref legal event code: EBP Effective date: 20140331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140331 |