WO2007049644A1 - エコー抑圧方法及び装置 - Google Patents
エコー抑圧方法及び装置 Download PDFInfo
- Publication number
- WO2007049644A1 WO2007049644A1 PCT/JP2006/321268 JP2006321268W WO2007049644A1 WO 2007049644 A1 WO2007049644 A1 WO 2007049644A1 JP 2006321268 W JP2006321268 W JP 2006321268W WO 2007049644 A1 WO2007049644 A1 WO 2007049644A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- echo
- output
- leakage
- value
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback
Definitions
- the present invention relates to an echo suppression method and apparatus for suppressing echo generated when loudspeaker sound and sound collection by a microphone are performed simultaneously.
- FIG. 1 is a block diagram showing a configuration of an echo suppressor of a first conventional example.
- FIG. 1 shows an example of the configuration of an echo suppressor for suppressing echo generated in a hands-free telephone.
- a voice signal (hereinafter referred to as a far end signal) of a call partner inputted from the input terminal 10 is amplified as far end voice from the speaker 2.
- a voice of a speaker hereinafter referred to as a near-end voice
- the sound input from the speaker 2 to the microphone 1 is called “eco-ichi”.
- the sound transmission system up to the output signal of the far-end signal force microphone 1 is called an echo path.
- the sound transmission system includes a speaker 2 and a microphone 1.
- Non-Patent Document 1 the paper by Eberhard HANSLER: rhe hands-free telephone problem: an annotated Dibliography upaatej, annais of telecommunications ", 1994, p360-367).
- the linear echo canceller 3 estimates the transfer function of the echo path (echo path estimation), and based on this estimated transfer function, the echo signal input to the microphone 1 from the input signal (far end signal) of the speaker 2 Generate a simulated signal (echo replica signal).
- the echo replica signal generated by the linear echo canceller unit 3 is input to the subtractor 4,
- the subtracter 4 subtracts the echo replica signal from the output signal force of the microphone 1 and outputs a near-end signal.
- the voice detection unit 5 receives the output signal of the microphone 1, the output signal of the linear echo canceller 3, the output signal of the subtractor 4, and the far-end signal, and these signal strengths Is detected, and the detection result is output to the linear echo canceller 3.
- the voice detection unit 5 In order to control the operation of the linear echo canceller 3, the voice detection unit 5 outputs “0” as the voice detection result when the output signal power of the microphone 1 also detects the near-end voice, and outputs an extremely small value. When a near-end voice is not detected, a large value is output.
- FIG. 2 is a block diagram showing a configuration example of the linear echo canceller shown in FIG.
- the linear echo canceller 3 includes an adaptive filter 30 that is a linear filter and a multiplier 35.
- the adaptive filter 30 various filters such as FIR type, IIR type, and lattice type are used.
- the adaptive filter 30 filters the far-end signal input from the terminal 31 and outputs the processing result from the terminal 32 to the subtracter 4.
- the adaptive filter 30 updates the filter coefficient using a predetermined correlation operation so that the output signal of the subtractor 4 input from the terminal 33 is minimized. Therefore, the adaptive filter 30 operates so that a component having a correlation power S with the far-end signal in the output signal of the subtractor 4 is minimized. That is, the output signal force echo (far end speech) of the subtractor 4 is removed.
- the adaptive filter 30 updates the filter coefficient in a state where the output signal of the microphone 1 includes near-end speech, the ability to remove echo may be reduced due to fluctuations in the filter coefficient.
- the multiplier 35 is provided for controlling the update of the filter coefficient by the adaptive filter 30, multiplies the output signal of the subtractor 4 and the output signal of the sound detection unit 5, and the result of the operation is applied to the adaptive filter. Output to 30.
- the output signal of the microphone 1 includes near-end speech
- the output signal of the speech detection unit 5 is 0 or an extremely small value as described above, so that the update of the filter coefficient by the adaptive filter 30 is suppressed, The fluctuation of the filter coefficient is reduced. As a result, a decrease in echo removal capability is suppressed.
- the echo suppression device of the first conventional example removes the echo of the far-end signal by using the adaptive filter.
- the echo suppressor of the second conventional example is configured to correct a pseudo-echo (echo replica signal) used for echo suppression according to the angle of the hinge portion in the folding cellular phone device.
- a pseudo-echo echo replica signal
- Such a configuration is described in, for example, JP-A-8-9005.
- the echo suppressor of the second conventional example detects the angle of the hinge portion, outputs a control signal corresponding to the angle, and suppresses the echo based on the control signal! And an echo control unit.
- the echo control unit holds a plurality of preset echo path tracking coefficients in order to generate a pseudo echo corresponding to an echo path that varies depending on the angle of the hinge unit, and a control signal generation unit
- a coefficient selection circuit that selects the echo path tracking coefficient using the control signal output from the address signal and a pseudo echo correction signal for correcting the pseudo echo based on the echo path tracking coefficient selected by the coefficient selection circuit.
- An adaptive control circuit for outputting, a pseudo echo generating circuit for generating a pseudo echo based on the pseudo echo correction signal, and a subtracting circuit for reducing the output signal power of the voice input unit (microphone) from the generated pseudo echo are provided.
- the echo suppressing device of the third conventional example has a configuration described in, for example, Japanese Patent Laid-Open No. 9-116469.
- the gain coefficient is determined based on the estimated values of the far-end signal power and the ambient noise power, and the output signal power of the microphone is also a signal obtained by subtracting the echo replica signal.
- the echo suppressor of the fourth conventional example is a technique described in, for example, Japanese Patent Application Laid-Open No. 2004-056453.
- either the output signal of the microphone (sound collector) or the output signal power of the sound collector is not reduced. If one of these is the first signal and the output signal of the echo canceller is the second signal, the second signal (far end signal, echo) leaks into the first signal (near end signal). The quantity is estimated, and the first signal is corrected based on the estimation result.
- the estimated value of the amount of echo leakage includes an amount corresponding to the amplitude or power of the second signal during a period in which near-end speech is not detected, and an amount corresponding to the amplitude or power of the first signal.
- the ratio is used.
- an estimated value of the amount of echo leakage is calculated from the first signal and the second signal for each frequency component of the first signal and the second signal. The first signal is corrected based on the calculated estimated value.
- the input speech spectrum force noise spectrum is estimated for each predetermined frequency region, and the estimated value of the input speech spectrum force noise spectrum is subtracted.
- a well-known flooring coefficient ⁇ is set so that the subtraction amount does not become too large, and the subtraction result is limited to “ ⁇ X input speech spectrum” or less.
- the echo can be sufficiently suppressed when nonlinear elements such as distortions in the echo path are small.
- nonlinear elements such as distortions in the echo path are small.
- a speaker or the like has a large nonlinear element.
- the transfer function of the echo path including distortion is nonlinear, and the accurate transfer function of the echo path cannot be simulated by the linear echo canceller 3.
- the echo is suppressed only by about 20 dB. In this case, the echo is transmitted as a near-end signal and can be heard by the other party's speaker, making it difficult to talk.
- the echo is sufficiently suppressed even if the distortion of the echo path is large.
- the echo suppression device of the fourth conventional example cannot correctly estimate the amount of echo leakage due to the effects of near-end noise, etc.
- the corrected signal of the first signal corrected based on it cannot be obtained. to degrade. That is, the echo is not suppressed sufficiently, or the near-end signal (near-end speech + near-end noise) is greatly distorted.
- Jiru When distortion occurs, the sound of the near-end signal becomes a sound that is modulated by the far-end signal. Specifically, the sound becomes a muffled sound only when the far-end signal is large.
- the near-end signal is a steady “Za” noise, it will sound like “Zo, Zo” modulated by the far-end speech.
- the near-end signal is voice, it will sound like a muffled sound only when the far-end signal is large.
- the sound modulated by the far-end signal (unpleasant sound) is buried in the near-end sound and does not feel much.
- the noise that is constantly generated becomes a sound modulated by the far-end signal, it is felt as an unpleasant sound.
- the present invention provides an echo suppression method that can sufficiently suppress echo even when distortion caused by an echo path is large, and reduce the modulation sound of a near-end signal due to an uncomfortable far-end signal. And an apparatus.
- either the output signal of the sound collector or the output signal power of the sound collector is a first signal obtained by subtracting the output signal of the echo canceller.
- the first signal is corrected using the leakage estimated value indicating the estimated amount of leakage of the second signal, which is an echo leaking into the first signal,
- the corrected signal is limited so as not to be smaller than the estimated near-end noise value.
- the echo canceller When the echo canceller is a linear echo canceller, the harmonic component included in the far-end signal appears almost as it is in the output of the echo canceller. Further, even if this echo canceller is a nonlinear echo canceller, the output of the echo canceller includes not only a few harmonic components contained in the far-end signal.
- the output signal of the sound collector includes harmonic components generated by near-end noise, echo of the far-end signal due to acoustic coupling between the sound collector and the loudspeaker, and distortion of the acoustic system. included.
- Estimate the ratio of these harmonic components that is, the estimated value of echo leakage due to nonlinear components and the second signal force.
- the amount of echo contained in the first signal is estimated.
- the leakage estimate, the first signal, and the second signal force The ratio of the near-end signal contained in the first signal is estimated, and the estimated ratio is multiplied by the first signal.
- a signal power of 1 can also remove the nonlinear component of echo.
- the corrected signal obtained by correcting the first signal using the leak estimate is limited so that it does not become smaller than the estimated near-end noise, the nonlinear component of the echo is eliminated by the incorrect leak estimate. As a result, the modulation sound of the near-end signal due to the uncomfortable far-end signal can be reduced.
- the echo by correcting the first signal using the leakage estimation value, the echo can be sufficiently suppressed even when the distortion generated due to the echo path is large, and the first signal is suppressed.
- the corrected signal By restricting the corrected signal so that it does not become smaller than the estimated value of near-end noise, the modulation sound of the near-end signal due to an unpleasant far-end signal can be reduced.
- FIG. 1 is a block diagram showing a configuration of an echo suppressor of a first conventional example.
- FIG. 2 is a block diagram showing a configuration example of the linear echo canceller shown in FIG.
- FIG. 3 is a block diagram showing an example of the configuration of an echo suppressor of the present invention.
- FIG. 4 is a block diagram showing an example of the configuration of the conversion unit shown in FIG.
- FIG. 5 is a graph showing the experimental results of examining the correlation between the echo replica signal and the spectrum of the residual echo.
- FIG. 6 is a schematic diagram showing a configuration example of a mobile phone device including a plurality of speakers and microphones.
- FIG. 7 is a graph showing the relationship between the leakage coefficient that can sufficiently suppress the echo and the power of the output signal of the linear echo canceller.
- FIG. 8 is a block diagram showing a configuration of the first embodiment of the echo suppressor of the present invention.
- FIG. 9 is a block diagram showing an example of the configuration of the coefficient generator shown in FIG.
- FIG. 10 is a block diagram showing another configuration example of the coefficient generator shown in FIG.
- FIG. 11 is a block diagram showing a configuration example of the spectral subtraction unit shown in FIG. 8.
- FIG. 12 is a block diagram showing an example of the configuration of the Fourier coefficient subtracter shown in FIG.
- FIG. 13 is a block diagram showing a configuration example of a spectrum estimation unit shown in FIG.
- FIG. 14 is a block diagram showing an example of the configuration of the noise estimation unit shown in FIG.
- FIG. 15 is a block diagram showing the configuration of the second embodiment of the echo suppressor of the present invention.
- FIG. 16 is a block diagram showing the configuration of the third embodiment of the echo suppressor of the present invention.
- FIG. 17 is a block diagram showing an example of the configuration of the spectral subtraction unit shown in FIG.
- FIG. 18 is a block diagram showing a first configuration example of the Fourier coefficient multiplier shown in FIG.
- FIG. 19 is a block diagram showing an example of the configuration of the gain converter shown in FIG.
- FIG. 20 is a block diagram showing a second configuration example of the spectrum estimation unit shown in FIG.
- FIG. 21 is a block diagram showing a configuration example of an amplitude extraction unit shown in FIG.
- FIG. 22 is a block diagram showing another configuration example of the amplitude extraction unit shown in FIG. ⁇ 23]
- FIG. 23 is a block diagram showing the configuration of the fourth embodiment of the echo suppressor of the present invention.
- FIG. 24 is a block diagram showing the configuration of the fifth embodiment of the echo suppressor of the present invention.
- FIG. 25 is a block diagram showing a configuration example of the echo canceller shown in FIG. 24.
- FIG. 26 is a block diagram showing a configuration example of the spectral subtraction section shown in FIG. 24.
- FIG. 27 is a block diagram showing the configuration of the sixth embodiment of the echo suppressor of the present invention.
- FIG. 28 is a block diagram showing the configuration of the seventh embodiment of the echo suppressor of the present invention.
- FIG. 3 is a block diagram showing a configuration example of the echo suppression apparatus of the present invention.
- the echo suppressor of the present invention is the echo of the first conventional example shown in FIG.
- the coefficient used to calculate the amount of leakage of the far-end signal (echo) that leaks into the near-end signal generated by the acoustic coupling of microphone 1 and speaker 2 (hereinafter referred to as the leakage coefficient)
- the coefficient generator 200 to be generated the output signal of the microphone 1 or the output signal of the subtractor 4 is the first signal, and the output signal of the linear echo canceller 3 is the second signal
- the coefficient generator The configuration further includes a conversion unit 100 that corrects the first signal based on the leakage coefficient generated at 200 and the second signal, and outputs a near-end signal from which the first signal force echo is removed.
- the far-end signal input to speaker 2 is input from terminal 10, and the near-end signal is output from terminal 9.
- the linear echo canceller 3 may be a non-linear echo canceller.
- Conversion unit 100 estimates the amount of echo leakage from the first signal and the second signal, and corrects the first signal based on this estimated value (hereinafter referred to as the leakage estimated value). .
- the first signal is corrected by using the leakage coefficient generated by the coefficient generator 200 as the estimated leakage value.
- the first signal after correction (absolute value) corrected using the estimated leakage value is limited so that it is not smaller than the estimated near-end noise value (absolute value).
- Such processing is performed for each frequency region by dividing the first signal and the second signal into predetermined frequency regions.
- the coefficient generation unit 200 switches the leakage coefficient according to a predetermined usage situation set in advance.
- FIG. 4 is a block diagram illustrating a configuration example of the conversion unit illustrated in FIG.
- Frequency division section 160 divides the first signal input via terminal 162 into M for each predetermined frequency region, and outputs the result to correction unit 166m corresponding to the frequency region.
- the frequency division unit 161 divides the second signal input via the terminal 163 into M for each predetermined frequency region, and outputs it to the correction unit 166m corresponding to the frequency region.
- the correction unit m receives the speech detection result of the speech detection unit 5 input via the terminal 167, the leakage estimated value calculated using the first signal and the second signal in the frequency domain, and the first estimated value.
- the first signal is corrected using the second signal, and the corrected signal is output to the frequency synthesizer 164.
- the correction unit m is a leak generated by the coefficient generation unit 200, which is input via the terminal 67.
- the contamination coefficient is used as the leakage estimation value
- the first signal is corrected using the estimated value and the second signal
- the corrected signal is output to the frequency synthesis unit 164.
- the frequency synthesis unit 164 performs frequency synthesis on the output signal of the correction unit m and outputs it from the terminal 165.
- the leakage estimation value either the leakage coefficient or the value calculated from the first signal and the second signal force may be always used, or these may be switched appropriately.
- a method of switching the leakage estimation value for example, when the near-end speech is larger than the predetermined threshold value, the first signal and the second signal force leakage estimation value are calculated, and the near-end speech is determined.
- the correction unit 166m corrects the first signal using the leakage estimation value, and limits the corrected signal so that it does not become smaller than the estimated value of the near-end noise estimated for each frequency domain. Specifically, the amount of echo contained in the first signal is estimated using the leak estimate and the second signal, the amount of this estimated echo is reduced by the first signal power, and the result after subtraction is calculated. Limit the signal to be less than the estimated near-end noise!
- the amount of echo contained in the first signal is estimated using the leak estimated value and the second signal, the amount of this estimated echo is reduced by the first signal power, and the signal after the subtraction Is limited to be less than the estimated value of near-end noise and is used as the third signal. Then, the ratio of the near-end signal included in the first signal may be estimated from the third signal and the first signal, and the estimated ratio may be multiplied by the first signal.
- the frequency division units 160 and 161 perform frequency division using arbitrary linear transformation such as Fourier transform, cosine transform, and subband analysis filter bank.
- the frequency synthesis unit 164 performs frequency synthesis using an inverse Fourier transform, an inverse cosine transform, a subband synthesis filter bank, or the like corresponding to the linear transformation used in the frequency division units 160 and 161.
- the echo suppressor of the present invention corrects the first signal using the estimated leakage value, and restricts the corrected signal so that it does not become smaller than the estimated value of the near-end noise. It differs from the echo suppressor in the example. According to the echo suppressor of the present invention, the corrected first signal does not become smaller than the near-end noise, so even if the leak estimate is incorrect, the near-end signal is modulated by an uncomfortable far-end signal. Sound can be reduced. [0048] Further, the echo suppressor of the present invention is different from the fourth conventional example in which the amount of echo leakage is appropriately calculated from the first signal and the second signal in that the leakage coefficient is a constant. .
- FIG. 5 is a graph showing the experimental results of examining the correlation between the echo replica signal and the spectrum of the residual echo.
- the horizontal axis of the graph shown in Fig. 5 shows the amplitude of the echo replica signal (the output amplitude of the linear echo canceller 3), and the vertical axis shows the amplitude of the residual echo (echo component included in the first signal). .
- the slope of the correlation (the amplitude of the residual echo Z the amplitude of the echo replica) indicates the magnitude of the echo distortion, and the larger the slope, the greater the distortion. In other words, the slope of the correlation corresponds to the leakage coefficient.
- the coefficient generator 200 differs for each frequency domain of the first signal. If the leakage coefficient is generated and the first signal is corrected by the conversion unit 100 using the leakage coefficient corresponding to the frequency domain, the echo can be sufficiently suppressed.
- the distortion sound of the echo which is said to be unable to be sufficiently suppressed by the linear echo canceller 3, is generated by the distortion sound generated by the speaker 2 itself and the vibration of the housing in which the microphone 1 and the speaker 2 are mounted. It is roughly divided into distorted sound. Furthermore, these distortions vary depending on the usage status of the device that is the object of echo suppression. Therefore, it is desirable that the coefficient generation unit 200 switches and outputs the leakage coefficient according to the usage status of the device that is the target of echo suppression.
- the cause of the distorted sound that also causes the speaker 2 itself is the nonlinearity of the speaker characteristics. Therefore, as shown in FIG. 6, in a mobile phone device that switches a plurality of speakers 301 to 303 as appropriate, when individual speaker characteristics are different, echo distortion varies depending on the speakers used. In such a usage situation, it is sufficient to detect the speaker to be used and switch the leakage coefficient according to the detected speaker power! / ⁇ .
- the amount of distorted sound reaching the microphone 1 from the speaker 2 changes depending on the positional relationship with the microphone 1, so that the distortion of the echo also changes.
- the relative position between the speaker 2 and the microphone 1 may be detected, and the leakage coefficient may be switched according to the detected relative position.
- the positional relationship between the speaker 2 and the microphone 1 is determined by the angle of the hinge 321. Therefore, the angle of the hinge 321 is detected and leakage occurs according to the angle. What is necessary is just to switch a dust coefficient.
- the relative position with respect to the speaker 2 changes depending on the microphone to be used. In such a situation of use, it is only necessary to detect the microphone to be used and switch to a preset leakage coefficient according to the position of the detected microphone.
- distorted sound caused by vibration of the casing is mainly generated at the joint between the components.
- Example when the housing vibrates due to the output sound of the speaker 2 and a sound in which the joint force between components is distorted is generated, this distorted sound is input to the microphone 1 as an echo distortion. Therefore, when the volume of the speaker 2 changes, the acoustic energy transmitted from the speaker 2 to the housing changes, and the distorted sound generated at the joint between the parts also changes. In such a situation of use, it is only necessary to detect the volume setting value of the force 2 and switch the leakage coefficient according to the volume setting value.
- the amount of vibration of the housing changes depending on whether or not the force is fully folded, and the distorted sound generated at the joint between parts also changes. Turn into. In such a use situation, it is only necessary to detect whether or not the cellular phone device 300 is completely folded and to switch the leakage coefficient according to the detection result.
- the position of the speaker changes depending on the bending angle, so that the sound transmitted from the speaker 2 depending on the angle of the hinge 321 even at the same part in the housing.
- the energy changes, and the distortion sound that occurs at the joint between parts changes. Therefore, even in such a usage situation, the angle of the hinge part 321 may be detected, and the leakage coefficient may be switched according to the angle.
- the presence or absence of a slide and the amount of slide may be detected, and the leakage coefficient may be switched according to the detection result.
- the angle of the hinge part, the force force force of the mobile phone device being folded, the presence or absence of a slide, or the amount of slide is detected, and leakage is detected according to the detection result. It is only necessary to switch the reconstitution coefficient.
- the present inventor has confirmed through experiments that the nonlinearity of the echo path changes as the power or amplitude of the signal output from the linear echo canceller 3 increases.
- the leakage coefficient that can sufficiently suppress the echo and the output signal of linear echo canceller 3 Examining the relationship with power, the results shown in Fig. 7 were obtained.
- Figure 7 shows the relationship between the output signal of the linear echo canceller 3 in the frequency band centered at 1875 Hz and the corresponding leakage coefficient.
- the horizontal axis of the graph shown in Fig. 7 shows the power of the output signal of the linear echo canceller 3, and the vertical axis shows the leakage coefficient that can sufficiently suppress the echo.
- the leakage coefficient that can sufficiently suppress the echo changes abruptly when the power value of the output signal of the linear echo canceller 3 is about 2000000 so that the distribution power of the plot points shown in FIG. 7 is also divided. This is because when the power of the output signal of the linear echo canceller 3 is large, the power of the input signal of the linear echo canceller 3, that is, the far-end signal input to the speaker 2, is also large. This is thought to be due to a sharp increase in strain.
- the power or amplitude of the signal output from the linear echo canceller 3 is detected as the usage status, and the leakage coefficient is switched according to the detected value.
- Such a method can use the power and amplitude of the far-end signal or the power and amplitude of a specific frequency component included in the far-end signal instead of the power and amplitude of the output signal of the linear echo canceller 3. It is.
- the method for switching the leakage coefficient based on the output signal of the linear echo canceller 3 is similar to the method for switching the leakage coefficient based on the sound volume 2 setting value. However, since the latter has no far-end signal, the leakage coefficient is selected according to the volume setting even when echo suppression is not required. On the other hand, the former is superior in that it does not select such a leakage coefficient by mistake.
- the method for switching the leakage coefficient described above does not need to detect all of the above-mentioned usage conditions and switch the leakage coefficient, and detects one or more of the usage conditions, and sets the leakage coefficient. You may switch.
- the use status that can be detected by a sensor provided outside the echo suppression device such as the angle of the hinge, the volume setting of the speaker, the speaker to be used, etc.
- the coefficient generator 200 is input to the coefficient generator 200. That's fine.
- the usage of the power and amplitude of the far-end signal, the power and amplitude of the output signal of the linear echo canceller 3, and the power and amplitude of specific frequency components included in the far-end signal are detected in the echo suppressor, The detection result may be input to the coefficient generator 200.
- the first signal is corrected using the estimated leakage value, and the corrected signal is limited so as not to be smaller than the estimated value of the near-end noise. Even if the estimated dust value is calculated incorrectly, the modulation sound of the near-end signal due to the uncomfortable far-end signal can be reduced.
- the leak coefficient that is a constant is not affected by noise, so that a large noise is generated as near-end speech. The echo caused by the echo path can be sufficiently suppressed even in the input environment.
- FIG. 8 is a block diagram showing the configuration of the first embodiment of the echo suppressor of the present invention.
- the echo suppression apparatus of the first embodiment is an example in which the spectral sub-translation unit 6 is used as the conversion unit 100 shown in FIG.
- the coefficient generator 200 of the first embodiment generates a leakage coefficient indicating the amount of echo leakage generated by the acoustic coupling between the microphone 1 and the speaker 2 as described above.
- the spectral subtraction unit 6 receives the output signal of the subtractor 4, the output signal of the linear echo canceller 3, the leakage coefficient generated by the coefficient generation unit 200, and the voice detection result of the voice detection unit 5.
- the spectral subtraction unit 6 divides the output signal of the subtractor 4 and the output signal of the linear echo canceller 3 into predetermined frequency regions, respectively. Echo is removed for each component.
- FIG. 9 is a block diagram showing an example of the configuration of the coefficient generator shown in FIG.
- a coefficient generation unit 200 shown in FIG. 9 is configured to include a coefficient storage unit 201 that holds a leakage coefficient suitable for each frequency region from band 1 to band M.
- the coefficient generation unit 200 reads out the leakage coefficient for each frequency region (band) stored in the coefficient storage unit 201 and outputs it to the spectral subtraction unit 6.
- These leakage coefficients correspond to, for example, the correlation slope at a frequency of 1250 Hz and the correlation slope at a frequency of 3125 Hz shown in FIG.
- FIG. 10 is a block diagram showing another configuration example of the coefficient generator shown in FIG.
- the coefficient generator 200 shown in FIG. 10 is a system including a coefficient storage unit 202 that holds a group of leakage coefficients suitable for each frequency region from band 1 to band M, and an echo suppressor of the present invention.
- This configuration includes a usage status detection unit 203 that detects various usage statuses.
- the coefficient generation unit 200 shown in FIG. 10 is configured to store a leakage coefficient corresponding to the usage state detected by the usage state detection unit 203 among the leakage coefficient group corresponding to each frequency region.
- the leakage coefficient group corresponding to each frequency region includes the leakage coefficient for usage condition 1, the leakage coefficient for usage condition 2, ... It has a leakage coefficient.
- N is an arbitrary value of 2 or more.
- the usage status detection unit 203 detects a volume setting value of the speaker 2, a detected volume setting value, and a predetermined value. And a discriminator for comparing the threshold value and converting the comparison result into a digital value of two or more values.
- the usage status detection unit 203 compares a sensor (not shown) that detects the angle of the hinge unit with the detection angle and a predetermined threshold value, and converts the comparison result into a digital value of two or more values. (Not shown).
- the usage state detection unit 203 includes a determination unit (not shown) that determines which speaker is used and outputs the determination result as a digital value of two or more values.
- the usage situation detection unit 203 determines which microphone is being used and determines It has a judgment unit (not shown) that outputs the result as a digital value of two or more values.
- the usage situation detection unit 203 detects the power or amplitude of the output signal of the linear echo canceller 3. (Not shown) and a discriminator (not shown) for judging the detected power or amplitude as a threshold value and converting it into a digital value of two or more values.
- the required leakage coefficient is 1 from the output power of the linear echo canceller 3 at 2000000. To change suddenly to 20, set the threshold to 2000000, output “0” if it is less than 2000000, output “1” if it exceeds 2000000!
- any use condition that affects the amount of echo leakage can be used. It is also possible to use a plurality of usage conditions in combination.
- the coefficient storage unit 202 selects one corresponding to the output signal of the usage status detection unit 203 from a plurality of leakage coefficients registered in advance corresponding to each frequency region, and selects the selected leakage factor.
- the reconstitution coefficient is output to the spectral subtraction unit 6.
- FIG. 11 is a block diagram showing a configuration example of the spectral subtraction unit shown in FIG.
- the spectral subtraction unit 6 includes a Fourier transform 60, a Fourier transform,
- the Fourier transformer 60 performs M-point Fourier transform processing on the output signal of the subtractor 4, and uses the processing results (amplitude and phase) as the first Fourier coefficients to apply Fourier coefficients corresponding to each frequency domain.
- Output to subtractor 66m (m 1 to M).
- Fourier transform 61 performs M-point Fourier transform processing on the echo replica signal output from linear echo canceller 3, and uses the processing result (amplitude and phase) as the second Fourier coefficient for each frequency domain. Output to the Fourier coefficient subtractor 66m.
- the Fourier coefficient subtractor 66m outputs the first Fourier coefficient output from the Fourier transformer 60, the second Fourier coefficient output from the Fourier transform 61, and the coefficient generator 200 shown in FIG.
- the received leakage coefficient and the voice detection result output from the voice detector 5 are received, and the Fourier coefficient is calculated by performing subtraction processing using those amplitude components, and the calculation result (amplitude and phase) is reversed. Output to Fourier transformer 64.
- the inverse Fourier transform ⁇ 64 performs an inverse Fourier transform process on the Fourier coefficient group output from the Fourier coefficient subtraction units 661 to 66 and outputs the real part of the processing result from the terminal 65.
- FIG. 12 is a block diagram showing a configuration example of the Fourier coefficient subtracter shown in FIG.
- the Fourier coefficient subtractor 66m has a configuration including a spectrum estimation unit 771, a noise estimation unit 778, and a limiter 772.
- the first Fourier coefficient for each frequency domain output from Fourier transformer 60 shown in FIG. 11 is supplied to spectrum estimation unit 771 and noise estimation unit 778 via terminal 700.
- the second Fourier coefficient output from the Fourier transform shown in FIG. 11 is supplied to the spectrum estimation unit 771 via the terminal 703. Also, the leakage coefficient generated by the coefficient generator 20 is output to the spectrum estimation unit 771 via the terminal 67, and the voice detection result output from the voice detection unit 5 is output to the spectrum estimation unit 771 via the terminal 167. Is output.
- Spectrum estimation unit 771 also subtracts the echo component of the first Fourier coefficient force supplied from terminal 700 and outputs the calculation result to limiter 772.
- the noise estimation unit 778 is connected to the terminal 700.
- the first Fourier coefficient force supplied from the controller also estimates the near-end noise value and outputs the estimation result to the limiter 772.
- Limiter 772 limits the upper limit value and lower limit value of the signal received from spectrum estimation section 771 by the near-end noise estimation value received from noise estimation section 778.
- the output signal of the limiter 772 is output to the inverse Fourier transformer 64 shown in FIG.
- FIG. 13 is a block diagram showing a configuration example of the spectrum estimation unit shown in FIG.
- spectrum estimation unit 771 is configured to include estimation unit 791, estimation unit 792, subtractor 706, and multiplier 707.
- the first Fourier coefficient input from the terminal 700 shown in FIG. 12 is supplied to the subtractor 706 and the estimation unit 792. Also, the second Fourier coefficient input from terminal 703 shown in FIG. 12 is supplied to multiplier 707 and estimation unit 792.
- Estimator 792 calculates an echo leak estimate from the speech detection result input via terminal 167, the first Fourier coefficient, and the second Fourier coefficient input via terminal 703. Then, the calculated leakage estimated value is output to the selection unit 791.
- the estimated leakage value is the ratio of the value corresponding to the amplitude or power of the first signal to the value corresponding to the amplitude or power of the second signal during the period when the output signal power of the microphone is not detected. Or the smooth value of this ratio can be used.
- the output signal strength of the microphone is also a smooth value of a value corresponding to the amplitude or power of the first signal with respect to a smooth value of a value corresponding to the amplitude or power of the second signal in a period in which near-end speech is not detected.
- a value obtained by further smoothing the ratio can be used.
- the time constant for smoothing the value corresponding to the amplitude or power of the first signal and the second signal is greater when the first signal and the second signal are increased than when the first signal and the second signal are decreased. Control it to make it smaller.
- the time constant of the smoothing process of the above ratio may be controlled to be long or infinite when near-end speech is detected, and to be shortened otherwise. Or near-end audio is detected. When the detected value is very large and the near-end speech is not detected, or when the above ratio decreases, You can control the value to be smaller.
- Selection section 791 selects either the leakage coefficient input via terminal 67 or the value calculated by estimation section 792, and outputs the selected value to multiplier 707 as an echo leakage estimated value. .
- the selection unit 791 may always select one of the two inputs or may switch the output as appropriate.
- a method for selecting the estimated leakage value by the selection unit 791 for example, depending on the presence or absence of near-end speech or near-end noise, if they are equal to or greater than a predetermined threshold, the value calculated by the estimation unit 79 2 is selected, Otherwise, there is a method of selecting the leakage coefficient input from terminal 67.
- Multiplier 707 multiplies the leakage estimation value output from selection unit 791 by the amplitude of the second Fourier coefficient input via terminal 703, and uses the calculation result as an echo estimation value. Output to 706.
- the subtractor 706 subtracts the first Fourier coefficient power input via the terminal 700 from the estimated echo value output from the multiplier 707, and calculates the Fourier transform coefficient of the signal after echo suppression. Is output from terminal 798 as an estimated value. The estimated value of the Fourier coefficient output from the terminal 798 is output to the limiter 772 shown in FIG.
- noise estimation section 778 shown in FIG. 12 will be described using FIG.
- FIG. 14 is a block diagram showing a configuration example of the noise estimation unit shown in FIG.
- the noise estimation unit 778 includes a subtractor 801, a multiplier 802, an adder 803, a delay 804, a limiter 807, and a smoothing coefficient determination unit 810.
- the first Fourier coefficient output from Fourier transformer 60 is input to noise estimation section 778 via terminal 800.
- the subtractor 810 also subtracts the output signal of the delay unit 804 (the output signal of the noise estimation unit 778) from the first Fourier coefficient force, and outputs the calculation result to the smoothing coefficient determination unit 810 and the multiplier 802.
- Multiplier 802 multiplies the output signal of subtractor 801 and the output signal of smoothing coefficient determination section 810 and outputs the calculation result to adder 803.
- Adder 803 is the output of multiplier 802.
- the power signal and the output signal of delay device 804 are added, and the calculation result is output to limiter 807.
- the limiter 807 limits the upper limit value and the lower limit value so that the output signal of the adder 803 does not exceed a predetermined range, and outputs the signal after the limitation to the output terminal 899 and the delay unit 804. .
- Delay device 804 delays the output signal of limiter 807 by one sample time, and outputs the delayed output signal to subtractor 801 and adder 803.
- the noise estimation unit 778 shown in Fig. 14 has a configuration called a so-called leak integrator or first-order IIR type low-pass filter.
- the coefficient that determines the time constant is supplied as a variable from the smoothing coefficient determination unit 810 that is not a constant. Note that the smoothing coefficient and the time constant of smoothness are inversely proportional.
- the smoothing coefficient determination unit 810 outputs a relatively small coefficient, for example, 0.01 when the output signal of the subtractor 801 is positive, that is, when the output signal of the subtractor 801 increases, and the subtractor 801 When the output value is negative, that is, when the output signal of the subtractor 801 decreases, a relatively large coefficient, for example, 0.5 is output.
- the smoothing coefficient is controlled in this way, the speed at which the output signal of the noise estimation unit 778 increases, that is, the rising speed is slow, and the speed at which the output signal of the noise estimation unit 778 decreases, that is, the falling speed is fast. Become. Therefore, among the signals input to the noise estimation unit 778 shown in FIG. 12, the amplitude value of a signal component that exists constantly with a low signal level is output. The component that exists constantly is near-end noise, and the output signal of the noise estimation unit 778 can be considered as an estimated value (amplitude value) of the near-end noise.
- the limiter 772 shown in Fig. 12 includes, for example, an estimated value of the Fourier coefficient of the signal after echo suppression output from the spectrum estimation unit 771 and a Fourier coefficient of the near-end noise output from the noise estimation unit 778. This is a configuration that compares the estimated value and outputs the larger value. Another configuration example of the limiter 77 2 will be described later.
- the near-end signal S is E + N, which is a signal to be removed.
- This signal E + N is estimated from the Fourier coefficient R of the far-end signal, and when there is near-end speech, the near-end signal force is also subtracted from E + N.
- the result of smoothing SZR when there is no near-end speech using the speech detection result is P1,
- ⁇ [ ⁇ ] represents smoothness ⁇ .
- P1 represents an approximate value of the rate at which the far-end signal R leaks into the near-end signal as an echo, and corresponds to the echo gain in the echo path.
- a value ⁇ 2 (corresponding to the output signal of multiplier 707) obtained by multiplying P1 by R is an estimated value of the echo component and the noise component.
- ⁇ [ ⁇ ] represents the estimated value
- the output signal P3 of the subtractor 706 becomes the Fourier coefficient component A of the near-end speech from which the echo component E and the noise component N are removed.
- the leakage coefficient P1 is an approximate value of the rate at which the far-end signal R leaks into the near-end signal as an echo, and corresponds to the echo gain in the echo path.
- a value P2 (corresponding to the output signal of multiplier 707) obtained by multiplying P1 by R is an estimated value of the echo component.
- the output signal P3 of the subtracter 706 is an estimated value of the sum of the Fourier coefficient component A and the noise component N of the near-end sound from which the echo component E is removed.
- the leakage estimation value calculated by the estimation unit 792 may not be correct due to an error in the speech detection result.
- the leakage coefficient generated by the coefficient generator 200 may be an incorrect value due to an incorrect selection of usage conditions.
- the echo is not sufficiently suppressed and a large distortion occurs in the near-end signal (near-end speech + near-end noise), and the near-end signal is modulated by the far-end signal.
- the noise component N will also be suppressed, so the phenomenon that this near-end signal is modulated by the far-end signal appears more prominently. Such a phenomenon can be reduced by using a limiter 772 as described below.
- Max (a, b) represents an operation for selecting the larger one of a and b.
- the output value P4 of the limiter 772 is always greater than Ex [N]. Therefore, since the output value P4 of the limiter 772 is never smaller than the noise component N, the modulated sound of the noise component N is reduced.
- the echo suppressor of the first embodiment includes the linear echo canceller 3 and the frequency domain nonlinear calculation by the spectral subtraction unit 6, and sufficient echo removal by supplementing each other's poor processing. Get the ability.
- the near-end noise estimated value Ex [N] is limited by the limiter 807, whereby the modulation noise of the near-end noise can be reduced.
- the leakage coefficient P1 used in the spectral subtraction unit 6 is used in an environment with a large near-end noise, for example, by using a preset constant according to the use situation. Even when the situation is changed, the echo is sufficiently suppressed, and near-end speech with less distortion can be obtained.
- FIG. 15 is a block diagram showing the configuration of the second embodiment of the echo suppressor of the present invention.
- the echo suppressor of the second embodiment differs from the echo suppressor of the first embodiment in that the output signal of the microphone 1 is input to the spectral subtraction unit 6 instead of the output signal of the subtractor 4. .
- the main component of the echo is removed by the spectral subtraction unit 6.
- Other configurations and operations are the same as in the first embodiment, and the effect of removing echoes caused by distortion can be obtained in the same manner as in the first embodiment.
- the echo suppressor of the second embodiment also has a linear echo canceller as in the first embodiment, such as when the acoustic transmission system is distorted, or when the echo path estimation is wrong in the linear echo canceller 3. Even if the echo cannot be sufficiently suppressed by 3 alone, the echo can be sufficiently suppressed by the spectral subtraction unit 6.
- the spectral subtraction unit 6 by using a preset constant according to the usage conditions as the estimated leakage value P1 used in the spectral subtraction section 6, even if the usage conditions are changed in an environment where there is a large amount of near-end noise, the echoes are sufficient.
- the near-end speech with less distortion can be obtained.
- the modulation noise of near-end noise can be reduced.
- the spectral subtraction unit 6 is, for example, non-patent document 2 (Xiao jian Lu, a statement by Benoit Champagne "Acoustic Echo Cancellation Over A Non-Linear Channel ", International Workshop on Acoustic Echo and Noise Control 2001), Spectral Subtraction, or Non-Patent Document 3 (A. Alvarez et al.” A Speech Enhancement system Based On It is also possible to use the spectral subtraction described in "Negative Beamrorming And spectral bubtra ction", International Workshop on Acoustic Echo and Noise Control 2001) It is.
- FIG. 16 is a block diagram showing the configuration of the third embodiment of the echo suppressor of the present invention.
- the echo suppressor of the third embodiment is different from the echo suppressor of the first embodiment in that a spectrum subtraction unit 7 is used instead of the spectrum subtraction unit 6 shown in FIG. . Since other configurations and operations are the same as those in the first embodiment, a detailed description thereof will be omitted.
- FIG. 17 is a block diagram showing a configuration example of the spectral subtraction unit shown in FIG.
- the Fourier transform 71 performs M-point Fourier transform processing on the output signal (echo replica signal) of the linear echo canceller 3 shown in FIG. Amplitude and phase) are output as second Fourier coefficients to Fourier coefficient multiplier 76m corresponding to each frequency domain.
- the Fourier coefficient multiplier 76m receives the first Fourier coefficient output from the Fourier transform 70, the second Fourier coefficient output from the Fourier transform 71, and the terminal 67 through FIG.
- the leakage coefficient output from the coefficient generator 200 shown in the figure and the voice detection result output from the voice detector 5 shown in FIG. 16 input via the terminal 167 are received, and their amplitude components are received.
- the Fourier coefficient is calculated by executing the multiplication processing used, and the calculation result (amplitude and phase) is output to the inverse Fourier transform 74.
- FIG. 18 is a block diagram showing a first configuration example of the Fourier coefficient multiplier shown in FIG.
- the Fourier coefficient multiplier 76m in the first configuration example includes a spectrum estimation unit 771, a noise estimation unit 778, a limiter 772, a gain conversion unit 773, and a multiplier 774. .
- the first Fourier coefficient for each frequency domain output from the Fourier transform shown in FIG. 17 is supplied to spectrum estimation section 771 and noise estimation section 778 via terminal 700.
- the second Fourier coefficient output from the Fourier transform shown in FIG. 17 is supplied to spectrum estimation section 771 via terminal 703.
- the leakage coefficient generated by the coefficient generator 20 is supplied to the spectrum estimation unit 771 via the terminal 67, and the voice detection result output from the voice detection unit 5 is supplied to the spectrum estimation unit 771 via the terminal 167. Supplied.
- Spectrum estimation unit 771 also subtracts the echo component of the first Fourier coefficient force supplied from terminal 700 and outputs the calculation result to limiter 772.
- the noise estimation unit 778 estimates the near-end noise value from the first Fourier coefficient supplied from the terminal 700 and outputs the estimation result to the limiter 772.
- the limiter 772 limits the lower limit value of the signal received from the spectrum estimation unit 771 by the near-end noise estimation value received from the noise estimation unit 778.
- the output signal of limiter 772 is output to gain converter 773.
- the error of the output signal of limiter 772 (estimated value of near-end speech and near-end noise after echo suppression) is generally called musical noise.
- the gain converter 773 is provided to reduce musical noise by performing smoothing processing or the like on the output signal of the limiter.
- Multiplier 774 multiplies the output signal of gain converter 773 and the first Fourier coefficient input via terminal 700, and outputs the calculation result via terminal 798.
- FIG. 19 is a block diagram showing a configuration example of the gain converter shown in FIG. 18
- gain conversion section 773 includes amplitude extraction section 7733, amplitude extraction section 7734, divider 7735, and smoothing section 7736.
- the output signal of limiter 772 shown in FIG. 18 is input to amplitude extraction section 7733 via terminal 7731. Also, the first Fourier coefficient input from terminal 700 shown in FIG. 18 is input to amplitude extraction section 7734 via terminal 7732.
- Amplitude extraction section 7733 and amplitude extraction section 7734 detect the amplitude value of the input signal and output the detection result to divider 735.
- Divider 7735 divides the output signal of amplitude extractor 7733 by the output signal of amplitude extractor 7734 and outputs the calculation result to smoother 7736.
- Smoothing section 7736 smoothes the output signal of divider 7735, and outputs the smoothed signal to multiplier 774 shown in FIG.
- the smoothing unit 7736 can have the same configuration as the noise estimation unit 778 shown in FIG. 14 except that, for example, the smoothing coefficients generated by the smoothing coefficient determination unit 810 are different.
- the smoothing unit 7736 When the configuration shown in FIG. 14 is adopted as the smoothing unit 7736, the speed at which the output signal of the smoothing unit 7736 increases by the value of the smoothing coefficient, that is, the rising speed is slowed down, and the output signal of the smoothing unit 7773 decreases. Speed, that is, the falling speed can be increased.
- the amplitude change of speech or music that is, the envelope characteristic
- the envelope characteristic is often fast when rising and slow when falling. If the configuration shown in FIG. 14 is adopted, it is possible to provide such an envelope characteristic, and the accuracy of estimating the ratio of near-end speech and near-end noise included in the near-end signal can be improved.
- Max (a, b) represents an operation for selecting the larger one of a and b.
- the output value P5 of the smoothing unit 7736 is an estimated value of the ratio of near-end speech and near-end noise included in the near-end signal.
- the output value P5 of the smoothing unit 7736 is an estimated value of the ratio of the near-end noise included in the near-end signal.
- the near-end speech and near-end noise in which echoes are suppressed are obtained from the spectral subtraction unit 7 shown in FIG.
- FIG. 20 is a block diagram showing a second configuration example of the spectrum estimation unit shown in FIG.
- the spectrum estimation unit 771 shown in FIG. 20 includes an estimation unit 792, a coefficient generation unit 791, and an amplitude extraction unit.
- the spectrum estimation unit 771 shown in FIG. 20 is illustrated in that an amplitude extraction unit 793 is inserted into the path from the terminal 700 to the subtractor 706, and an amplitude extraction unit 794 is inserted into the path from the terminal 703 to the multiplier 707. Unlike the spectrum estimation unit shown in FIG.
- the amplitude extraction unit 793 detects the amplitude of the input signal and outputs the detected value. Amplitude extraction unit
- FIGS. 21 and 22 can be used for 793.
- FIG. 21 is a block diagram showing a configuration example of the amplitude extraction unit shown in FIG. 20, and FIG.
- FIG. 10 is a block diagram showing another configuration example of the amplitude extraction unit shown in 0. [0190]
- the amplitude extraction unit 793 shown in FIG. 21 includes an absolute value calculation unit 7310 that calculates the absolute value of the input signal, and a smoothing unit 7400 that smoothes and outputs the output signal of the absolute value calculation unit 7310. It is a configuration.
- the amplitude extraction unit 793 shown in FIG. 22 calculates a square calculation unit 7320 that calculates the square of the input signal, a smoothing unit 7400 that smoothes the output signal of the square calculation unit 7320, and a square root of the output signal of the smoothing unit 7400. And a square root calculation unit 7420 that outputs the calculation result.
- the amplitude extraction unit 794 has the same configuration as the amplitude extraction unit 793.
- the output value P6 of the smoothing unit 7736 is as follows.
- the output value P6 of the smoothing unit 7736 is an estimated value of the ratio of the near-end speech and near-end noise included in the near-end signal, similarly to P5 shown in Expression (7). . Therefore, even if the configuration shown in FIG. 20 is used as the spectrum estimation unit 771, the near-end speech and the near-end noise in which echoes are suppressed are obtained from the spectrum subtraction unit 7 shown in FIG. It can be said that it is possible.
- FIG. 23 is a block diagram showing the configuration of the fourth embodiment of the echo suppressor of the present invention.
- the echo suppressor of the fourth embodiment is different from that of the third embodiment shown in Fig. 16 in that the spectrum subtraction unit 7 receives the output signal of the microphone 1 instead of the output signal of the subtractor 4. Unlike the co-suppressor.
- the main component of the echo is removed by the linear echo canceller 3, whereas in the echo suppressor of the fourth embodiment, the spectrum sub-rejection unit 7 Remove major components.
- the limiter 772 shown in Fig. 12 and Fig. 18 a simple configuration example is shown in which the larger one of the two input values is selected.
- the limiter 772 may have any configuration as long as its signal output does not become smaller than the estimated value of near-end noise. For example, when P3 is larger than the near-end noise estimated value Ex [N], a function that increases as the near-end noise estimated value is approached may be selected.
- the spectral subtraction unit 6 and the spectral subtraction unit 7 have been described as examples in which Fourier transform is performed for each predetermined sample period. It is possible to process in units of frames at regular intervals as well as every sample period.
- an example using the linear echo canceller 3 is shown. It is also possible to use a transform domain echo canceller for suppressing the above. In that case, if the conversion region of the conversion region echo canceller is the same conversion region as the spectral subtraction unit 6 and the spectral subtraction unit 7 described above, the amount of calculation of the entire echo suppression device is reduced and the delay time associated with the calculation is reduced. Can be shortened.
- the transform domain echo canceller is an echo canceller that performs echo suppression processing on the transform domain developed by linear transform and re-synthesizes it to the original domain by inverse linear transform.
- FIG. 24 is a block diagram showing the configuration of the fifth embodiment of the echo suppressor of the present invention.
- the echo suppressor of the fifth embodiment has a configuration in which the echo canceller 13 and the spectral subtraction unit 16 perform processing in the Fourier transform region.
- the echo canceller 13 outputs the transform domain signal group 1 and the transform domain signal group 2 to the spectrum subtraction unit 16.
- FIG. 25 is a block diagram showing a configuration example of the echo canceller shown in FIG.
- the far-end signal input from the terminal 31 is developed in the Fourier transform domain by the Fourier transform 35, and is output to the adaptive filter group 38 for each frequency domain.
- the inverse Fourier transform 36 performs an inverse Fourier transform process on the filter output processed by the adaptive filter group 38, and outputs the processing result from the terminal 32.
- the signal output from terminal 32 is the output signal for the echo canceller.
- the echo canceller 13 outputs the output signal of the Fourier transform 37 used in the spectral subtraction unit 16 from the outer output terminal 41 as the transform domain signal group 1, and the adaptive filter group 38 The output is output from vector output terminal 42 as transform domain signal group 2.
- Transform domain signal group 1 is a signal obtained by Fourier transforming the output signal of subtractor 4 shown in FIG. 24, and transform domain signal group 2 is output from echo canceller 13 shown in FIG. 24 to subtracter 4. Can be interpreted as a Fourier-transformed signal.
- FIG. 26 is a block diagram showing a configuration example of the spectrum subtraction unit shown in FIG.
- the spectral subtraction unit 16 shown in Fig. 26 is the first in that the Fourier transform 60 and the Fourier transform 61 shown in Fig. 11 are deleted and the transform domain signal group 1 and transform domain signal group 2 are input. This is different from the spectral subtraction unit 6 used in the echo suppressor of one embodiment.
- the transform domain signal group 1 is a signal obtained by subjecting the output signal of the subtractor 4 shown in FIG. 24 to Fourier transform
- the transform domain signal group 2 is the echo canceller 13 shown in FIG. Can be interpreted as a Fourier-transformed signal.
- echo cancellation to the spectral subtraction unit 16 is performed.
- the Fourier transform processing of the spectrum subtraction unit 16 can be reduced.
- Such a configuration can also be applied to the echo suppressors shown in the second to fourth embodiments.
- a cosine transform region or the like can be used.
- the subband region echo canceller described in Non-Patent Document 4 can be used for echo suppression. It is. In that case, if the processing of the spectral subtraction unit 6 and the spectral suppression unit 7 is performed in the subband region, the filter for conversion into the subband region can be omitted.
- FIG. 27 is a block diagram showing the configuration of the sixth embodiment of the echo suppressor of the present invention.
- the echo suppression apparatus of the sixth embodiment performs processing by the echo canceller and the vector subtraction unit in the subband region.
- the output signal of microphone 1 is developed into N frequency bands by subband analysis filter bank 91, and the far-end signal is subband analyzed.
- the filter bank 92 expands into N frequency bands.
- the output signal of the spectral subtraction unit 96 ⁇ is inversely transformed into the original signal region by the subband synthesis filter bank 99 and output as a near-end signal.
- the echo suppressor of the sixth embodiment all processing is performed in the subband region. Therefore, the synthesis filter bank in the linear echo canceller 3 and the subband analysis filter bank in the spectrum subtraction unit can be omitted. Therefore, the amount of computation corresponding to the subband analysis filter bank and the subband synthesis filter bank can be reduced, and further, the delay time corresponding to the computation can be shortened.
- the configuration of the sixth embodiment shown in FIG. 27 is also applicable to the echo suppression devices shown in the second to fourth embodiments. It is also possible to use a cosine transform region in addition to the Fourier transform region.
- FIG. 28 is a block diagram showing the configuration of the seventh embodiment of the echo suppressor of the present invention.
- the echo suppressor of the seventh embodiment performs the echo canceller and spectral subtraction processing in the Fourier transform domain.
- the output signal force S of the microphone 1 is expanded into M frequency bands by the S Fourier transform ⁇ 191 , and the far-end signal is transformed by the Fourier transform 192. Expanded to M frequency bands.
- the output signal of the Fourier coefficient subtractor 66m for each frequency band is inversely transformed to the original signal region by the inverse Fourier transformer 199 and output as a near-end signal.
- the echo suppression apparatus of the seventh embodiment performs the processing of the echo canceller and the spectral subtraction unit in the conversion area as in the sixth embodiment, but it is! /
- the number M of frequency bands is larger than in the sixth embodiment, and differs from the echo suppressor of the sixth embodiment in that a Fourier coefficient subtractor 66m is used instead of the spectral sub-translation part. ing.
- a Fourier coefficient subtractor 66m is used instead of the spectral sub-translation part. ing.
- the Fourier transform and inverse Fourier transform ⁇ included in the spectrum subtraction section are not necessary, and only the Fourier coefficient subtractor 66m performs the operations necessary for processing the spectrum subtraction! / RU
- the amount of calculation corresponding to the omitted Fourier transformer and inverse Fourier transformer can be reduced.
- the configuration of the seventh embodiment shown in FIG. 28 is also applicable to the echo suppression devices shown in the second to fourth embodiments. It is also possible to use a cosine transform region in addition to the Fourier transform region.
- the linear echo canceller is used.
- a nonlinear echo canceller can be used for echo suppression. Even in this case, the same effect as described above can be obtained if the processing of the spectral subtraction part and the spectral subtraction part is performed in the Fourier transform domain.
- the echo suppressor of the present invention has been described above using a hands-free telephone as an example. It can be applied to various devices in which loudspeaker loudspeaker and microphone sound pickup are performed simultaneously, such as when echoes from the sky are a problem.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
- Telephone Function (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP06822245.4A EP1942583B1 (en) | 2005-10-26 | 2006-10-25 | Echo suppressing method and device |
US12/084,043 US8433074B2 (en) | 2005-10-26 | 2006-10-25 | Echo suppressing method and apparatus |
CN2006800488790A CN101346896B (zh) | 2005-10-26 | 2006-10-25 | 回声抑制方法及设备 |
JP2007542623A JP4702372B2 (ja) | 2005-10-26 | 2006-10-25 | エコー抑圧方法及び装置 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005-311181 | 2005-10-26 | ||
JP2005311181 | 2005-10-26 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007049644A1 true WO2007049644A1 (ja) | 2007-05-03 |
Family
ID=37967754
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2006/321268 WO2007049644A1 (ja) | 2005-10-26 | 2006-10-25 | エコー抑圧方法及び装置 |
Country Status (6)
Country | Link |
---|---|
US (1) | US8433074B2 (ja) |
EP (1) | EP1942583B1 (ja) |
JP (1) | JP4702372B2 (ja) |
KR (1) | KR100974371B1 (ja) |
CN (1) | CN101346896B (ja) |
WO (1) | WO2007049644A1 (ja) |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009051197A1 (ja) * | 2007-10-19 | 2009-04-23 | Nec Corporation | エコー抑圧方法及び装置 |
JP2010032802A (ja) * | 2008-07-29 | 2010-02-12 | Kenwood Corp | 雑音抑制装置、雑音抑制方法、及び雑音抑制プログラム |
JP2011097335A (ja) * | 2009-10-29 | 2011-05-12 | Nikon Corp | 信号処理装置及び撮像装置 |
JP2011203700A (ja) * | 2010-03-26 | 2011-10-13 | Toshiba Corp | 音声判別装置 |
JP2011527025A (ja) * | 2008-06-30 | 2011-10-20 | オーディエンス,インコーポレイテッド | ヌル処理雑音除去を利用した雑音抑制を提供するシステム及び方法 |
WO2013005550A1 (ja) * | 2011-07-01 | 2013-01-10 | クラリオン株式会社 | 直接音抽出装置および残響音抽出装置 |
US8600070B2 (en) | 2009-10-29 | 2013-12-03 | Nikon Corporation | Signal processing apparatus and imaging apparatus |
JP2015507400A (ja) * | 2011-12-16 | 2015-03-05 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | モバイルデバイス中のスピーカーとマイクロフォンとの間の可変距離を動的に補償することによってオーディオ処理機能を最適化すること |
US9536540B2 (en) | 2013-07-19 | 2017-01-03 | Knowles Electronics, Llc | Speech signal separation and synthesis based on auditory scene analysis and speech modeling |
US9558755B1 (en) | 2010-05-20 | 2017-01-31 | Knowles Electronics, Llc | Noise suppression assisted automatic speech recognition |
US9640194B1 (en) | 2012-10-04 | 2017-05-02 | Knowles Electronics, Llc | Noise suppression for speech processing based on machine-learning mask estimation |
US9654609B2 (en) | 2011-12-16 | 2017-05-16 | Qualcomm Incorporated | Optimizing audio processing functions by dynamically compensating for variable distances between speaker(s) and microphone(s) in an accessory device |
CN104427144B (zh) * | 2013-09-11 | 2017-06-13 | 联芯科技有限公司 | 一种线性回声消除方法及其装置 |
US9799330B2 (en) | 2014-08-28 | 2017-10-24 | Knowles Electronics, Llc | Multi-sourced noise suppression |
US9830899B1 (en) | 2006-05-25 | 2017-11-28 | Knowles Electronics, Llc | Adaptive noise cancellation |
Families Citing this family (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8078125B2 (en) * | 2006-06-21 | 2011-12-13 | Nxp B.V. | Method for demodulating a modulated signal, demodulator and receiver |
JP5034595B2 (ja) * | 2007-03-27 | 2012-09-26 | ソニー株式会社 | 音響再生装置および音響再生方法 |
US8401178B2 (en) * | 2008-09-30 | 2013-03-19 | Apple Inc. | Multiple microphone switching and configuration |
JP5347794B2 (ja) * | 2009-07-21 | 2013-11-20 | ヤマハ株式会社 | エコー抑圧方法およびその装置 |
US20120195439A1 (en) * | 2009-10-07 | 2012-08-02 | Pioneer Corporation | Active vibration noise control device |
US8718290B2 (en) | 2010-01-26 | 2014-05-06 | Audience, Inc. | Adaptive noise reduction using level cues |
US8473287B2 (en) | 2010-04-19 | 2013-06-25 | Audience, Inc. | Method for jointly optimizing noise reduction and voice quality in a mono or multi-microphone system |
US8538035B2 (en) * | 2010-04-29 | 2013-09-17 | Audience, Inc. | Multi-microphone robust noise suppression |
EP2444967A1 (en) * | 2010-10-25 | 2012-04-25 | Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. | Echo suppression comprising modeling of late reverberation components |
JPWO2012070670A1 (ja) * | 2010-11-25 | 2014-05-19 | 日本電気株式会社 | 信号処理装置、信号処理方法、及び信号処理プログラム |
US9420390B2 (en) * | 2011-02-03 | 2016-08-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Estimation and suppression of harmonic loudspeaker nonlinearities |
US8737188B1 (en) | 2012-01-11 | 2014-05-27 | Audience, Inc. | Crosstalk cancellation systems and methods |
US9514763B2 (en) * | 2013-05-15 | 2016-12-06 | Lenovo (Singapore) Pte. Ltd. | Noise reduction via tuned acoustic echo cancellation |
GB201309777D0 (en) * | 2013-05-31 | 2013-07-17 | Microsoft Corp | Echo suppression |
CN103561184B (zh) * | 2013-11-05 | 2015-04-22 | 武汉烽火众智数字技术有限责任公司 | 基于近端音频信号标定和修正的消除变频回声的方法 |
GB2521881B (en) | 2014-04-02 | 2016-02-10 | Imagination Tech Ltd | Auto-tuning of non-linear processor threshold |
JP6446893B2 (ja) * | 2014-07-31 | 2019-01-09 | 富士通株式会社 | エコー抑圧装置、エコー抑圧方法及びエコー抑圧用コンピュータプログラム |
TWI579835B (zh) * | 2015-03-19 | 2017-04-21 | 絡達科技股份有限公司 | 音效增益方法 |
CN105611092A (zh) * | 2015-12-18 | 2016-05-25 | 合肥寰景信息技术有限公司 | 一种网络语音同步消噪通讯系统 |
CN105592240A (zh) * | 2015-12-18 | 2016-05-18 | 合肥寰景信息技术有限公司 | 一种网络语音同步消噪通讯装置 |
CN105516524A (zh) * | 2015-12-18 | 2016-04-20 | 合肥寰景信息技术有限公司 | 一种网络语音同步消噪通讯方法 |
CN107045872B (zh) * | 2016-02-05 | 2020-09-01 | 中国电信股份有限公司 | 通话回声的识别方法和装置 |
CN105657110B (zh) * | 2016-02-26 | 2020-02-14 | 深圳Tcl数字技术有限公司 | 语音通信的回声消除方法及装置 |
US10154148B1 (en) * | 2017-08-03 | 2018-12-11 | Polycom, Inc. | Audio echo cancellation with robust double-talk detection in a conferencing environment |
CN110718237B (zh) | 2018-07-12 | 2023-08-18 | 阿里巴巴集团控股有限公司 | 串音数据检测方法和电子设备 |
US11336367B1 (en) * | 2021-03-12 | 2022-05-17 | Iena Corporation | Low-power pre-compensation of linear and nonlinear transmitter effects in narrow-spectrum optical signals |
CN113542980B (zh) * | 2021-07-21 | 2023-03-31 | 深圳市悦尔声学有限公司 | 一种抑制扬声器串扰的方法 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0541681A (ja) * | 1991-08-05 | 1993-02-19 | Toshiba Corp | エコーキヤンセラ |
JPH07240703A (ja) * | 1994-02-28 | 1995-09-12 | Toshiba Corp | 通話障害防止装置 |
JPH089005A (ja) | 1994-06-21 | 1996-01-12 | Nec Corp | 折りたたみ型携帯電話装置 |
JPH08288894A (ja) * | 1995-04-14 | 1996-11-01 | Sony Corp | エコー抑圧装置 |
JPH09116469A (ja) | 1995-10-17 | 1997-05-02 | Nec Corp | エコー・ノイズキャンセラおよびエコー・ノイズ消去方法 |
JP2000252883A (ja) * | 1999-02-25 | 2000-09-14 | Sanyo Electric Co Ltd | エコーキャンセラの制御装置 |
JP2002009677A (ja) * | 2000-06-23 | 2002-01-11 | Matsushita Electric Ind Co Ltd | 音響エコーキャンセラー装置 |
JP2004012884A (ja) | 2002-06-07 | 2004-01-15 | Sharp Corp | 音声認識装置 |
JP2004056453A (ja) | 2002-07-19 | 2004-02-19 | Nec Corp | エコー抑圧方法及び装置 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE69731573T2 (de) * | 1996-02-09 | 2005-03-31 | Texas Instruments Inc., Dallas | Geräuschverminderungsanordnung |
KR100399034B1 (ko) * | 2000-05-02 | 2003-09-22 | 한국과학기술원 | 효율적 메모리 셀 어레이 관리 방법 |
WO2004034734A1 (ja) * | 2002-10-08 | 2004-04-22 | Nec Corporation | アレイ装置および携帯端末 |
-
2006
- 2006-10-25 US US12/084,043 patent/US8433074B2/en active Active
- 2006-10-25 EP EP06822245.4A patent/EP1942583B1/en not_active Not-in-force
- 2006-10-25 KR KR1020087012405A patent/KR100974371B1/ko active IP Right Grant
- 2006-10-25 JP JP2007542623A patent/JP4702372B2/ja not_active Expired - Fee Related
- 2006-10-25 CN CN2006800488790A patent/CN101346896B/zh not_active Expired - Fee Related
- 2006-10-25 WO PCT/JP2006/321268 patent/WO2007049644A1/ja active Application Filing
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0541681A (ja) * | 1991-08-05 | 1993-02-19 | Toshiba Corp | エコーキヤンセラ |
JPH07240703A (ja) * | 1994-02-28 | 1995-09-12 | Toshiba Corp | 通話障害防止装置 |
JPH089005A (ja) | 1994-06-21 | 1996-01-12 | Nec Corp | 折りたたみ型携帯電話装置 |
JPH08288894A (ja) * | 1995-04-14 | 1996-11-01 | Sony Corp | エコー抑圧装置 |
JPH09116469A (ja) | 1995-10-17 | 1997-05-02 | Nec Corp | エコー・ノイズキャンセラおよびエコー・ノイズ消去方法 |
JP2000252883A (ja) * | 1999-02-25 | 2000-09-14 | Sanyo Electric Co Ltd | エコーキャンセラの制御装置 |
JP2002009677A (ja) * | 2000-06-23 | 2002-01-11 | Matsushita Electric Ind Co Ltd | 音響エコーキャンセラー装置 |
JP2004012884A (ja) | 2002-06-07 | 2004-01-15 | Sharp Corp | 音声認識装置 |
JP2004056453A (ja) | 2002-07-19 | 2004-02-19 | Nec Corp | エコー抑圧方法及び装置 |
Non-Patent Citations (4)
Title |
---|
A. ALVAREZ ET AL.: "A Speech Enhancement System Based On Negative Beamforming And Spectral Subtraction", INTERNATIONAL WORKSHOP ON ACOUSTIC ECHO AND NOISE CONTROL, 2001 |
EBERHARD HANSLER: "The hands-free telephone problem: an annotated bibliography update", ANNALS OF TELECOMMUNICATIONS, 1994, pages 360 - 367 |
JOHN J. SHYNK: "Frequency-Domain and Multirate Adaptive Filtering", IEEE SIGNAL PROCESSING MAGAZINE, January 1992 (1992-01-01), pages 14 - 37 |
See also references of EP1942583A4 |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9830899B1 (en) | 2006-05-25 | 2017-11-28 | Knowles Electronics, Llc | Adaptive noise cancellation |
WO2009051197A1 (ja) * | 2007-10-19 | 2009-04-23 | Nec Corporation | エコー抑圧方法及び装置 |
JPWO2009051197A1 (ja) * | 2007-10-19 | 2011-03-03 | 日本電気株式会社 | エコー抑圧方法及び装置 |
US8488776B2 (en) | 2007-10-19 | 2013-07-16 | Nec Corporation | Echo suppressing method and apparatus |
JP2011527025A (ja) * | 2008-06-30 | 2011-10-20 | オーディエンス,インコーポレイテッド | ヌル処理雑音除去を利用した雑音抑制を提供するシステム及び方法 |
JP2010032802A (ja) * | 2008-07-29 | 2010-02-12 | Kenwood Corp | 雑音抑制装置、雑音抑制方法、及び雑音抑制プログラム |
JP2011097335A (ja) * | 2009-10-29 | 2011-05-12 | Nikon Corp | 信号処理装置及び撮像装置 |
US8600070B2 (en) | 2009-10-29 | 2013-12-03 | Nikon Corporation | Signal processing apparatus and imaging apparatus |
JP2011203700A (ja) * | 2010-03-26 | 2011-10-13 | Toshiba Corp | 音声判別装置 |
US9558755B1 (en) | 2010-05-20 | 2017-01-31 | Knowles Electronics, Llc | Noise suppression assisted automatic speech recognition |
CN103503066A (zh) * | 2011-07-01 | 2014-01-08 | 歌乐株式会社 | 直达声提取装置和混响声提取装置 |
JP2013015606A (ja) * | 2011-07-01 | 2013-01-24 | Clarion Co Ltd | 直接音抽出装置および残響音抽出装置 |
WO2013005550A1 (ja) * | 2011-07-01 | 2013-01-10 | クラリオン株式会社 | 直接音抽出装置および残響音抽出装置 |
JP2015507400A (ja) * | 2011-12-16 | 2015-03-05 | クゥアルコム・インコーポレイテッドQualcomm Incorporated | モバイルデバイス中のスピーカーとマイクロフォンとの間の可変距離を動的に補償することによってオーディオ処理機能を最適化すること |
US9232071B2 (en) | 2011-12-16 | 2016-01-05 | Qualcomm Incorporated | Optimizing audio processing functions by dynamically compensating for variable distances between speaker(s) and microphone(s) in a mobile device |
US9654609B2 (en) | 2011-12-16 | 2017-05-16 | Qualcomm Incorporated | Optimizing audio processing functions by dynamically compensating for variable distances between speaker(s) and microphone(s) in an accessory device |
US9640194B1 (en) | 2012-10-04 | 2017-05-02 | Knowles Electronics, Llc | Noise suppression for speech processing based on machine-learning mask estimation |
US9536540B2 (en) | 2013-07-19 | 2017-01-03 | Knowles Electronics, Llc | Speech signal separation and synthesis based on auditory scene analysis and speech modeling |
CN104427144B (zh) * | 2013-09-11 | 2017-06-13 | 联芯科技有限公司 | 一种线性回声消除方法及其装置 |
US9799330B2 (en) | 2014-08-28 | 2017-10-24 | Knowles Electronics, Llc | Multi-sourced noise suppression |
Also Published As
Publication number | Publication date |
---|---|
KR100974371B1 (ko) | 2010-08-05 |
US8433074B2 (en) | 2013-04-30 |
EP1942583B1 (en) | 2016-10-12 |
KR20080066051A (ko) | 2008-07-15 |
US20090154717A1 (en) | 2009-06-18 |
JP4702372B2 (ja) | 2011-06-15 |
CN101346896A (zh) | 2009-01-14 |
EP1942583A1 (en) | 2008-07-09 |
CN101346896B (zh) | 2012-09-05 |
EP1942583A4 (en) | 2011-10-26 |
JPWO2007049644A1 (ja) | 2009-04-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4702372B2 (ja) | エコー抑圧方法及び装置 | |
JP4702371B2 (ja) | エコー抑圧方法及び装置 | |
JP4161628B2 (ja) | エコー抑圧方法及び装置 | |
US8488776B2 (en) | Echo suppressing method and apparatus | |
KR101250124B1 (ko) | 에코 억제 필터를 위한 제어 정보를 계산하는 장치 및 방법 및 지연 값을 계산하는 장치 및 방법 | |
US7035398B2 (en) | Echo cancellation processing system | |
US8306215B2 (en) | Echo canceller for eliminating echo without being affected by noise | |
JP4638039B2 (ja) | 周波数ドメインの非線形プロセッシングを使用したエコー・サプレッションを提供するための方法および装置 | |
JP2004349806A (ja) | 多チャネル音響エコー消去方法、その装置、そのプログラム及びその記録媒体 | |
US8503687B2 (en) | System identification device and system identification method | |
JP5057109B2 (ja) | エコーキャンセラ装置 | |
JP2003250193A (ja) | 反響消去方法、この方法を実施する装置、プログラムおよびその記録媒体 | |
JP3616341B2 (ja) | 多チャネルエコーキャンセル方法、その装置、そのプログラム及び記録媒体 | |
JP4631933B2 (ja) | エコー抑圧方法 | |
KR100431965B1 (ko) | 시변 적응알고리즘이 적용된 음향반향 제거장치 및 그 방법 | |
JP6356087B2 (ja) | エコー消去装置、その方法及びプログラム | |
JP2013005106A (ja) | 場内拡声装置、場内拡声方法、及びそのプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200680048879.0 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
ENP | Entry into the national phase |
Ref document number: 2007542623 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12084043 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2006822245 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2006822245 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020087012405 Country of ref document: KR |