EP3829151A1 - Echounterdrückungsvorrichtung, echounterdrückungsverfahren und echounterdrückungsprogramm - Google Patents

Echounterdrückungsvorrichtung, echounterdrückungsverfahren und echounterdrückungsprogramm Download PDF

Info

Publication number
EP3829151A1
EP3829151A1 EP20203965.7A EP20203965A EP3829151A1 EP 3829151 A1 EP3829151 A1 EP 3829151A1 EP 20203965 A EP20203965 A EP 20203965A EP 3829151 A1 EP3829151 A1 EP 3829151A1
Authority
EP
European Patent Office
Prior art keywords
echo
signal
nonlinear
linear
nonlinear echo
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20203965.7A
Other languages
English (en)
French (fr)
Other versions
EP3829151B1 (de
Inventor
Yuki Terashima
Shinichi Yuzuriha
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Corp of America
Original Assignee
Panasonic Intellectual Property Corp of America
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Corp of America filed Critical Panasonic Intellectual Property Corp of America
Publication of EP3829151A1 publication Critical patent/EP3829151A1/de
Application granted granted Critical
Publication of EP3829151B1 publication Critical patent/EP3829151B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/02—Circuits for transducers, loudspeakers or microphones for preventing acoustic reaction, i.e. acoustic oscillatory feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/002—Applications of echo suppressors or cancellers in telephonic connections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M9/00—Arrangements for interconnection not involving centralised switching
    • H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
    • H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech

Definitions

  • the present disclosure relates to a technique for suppressing a linear echo signal and a nonlinear echo signal included in an input signal acquired by a microphone.
  • voice uttered by a caller on a call transmission side is input to a microphone on the call transmission side and is transmitted as a call transmission signal to an apparatus on a call reception side via a network line.
  • the loudspoken voice from a speaker on the call reception side is collected by a microphone on the call reception side and transmitted to an apparatus on the call transmission side via the network line.
  • voice uttered by the caller after a lapse of time of passing through the network line and a lapse of time of propagation through a space on the call reception side is reproduced from a speaker on the call transmission side.
  • voice propagated between the speaker and the microphone on the call reception side is called echo and hinders the call.
  • echo suppression techniques have been proposed such as an echo canceller, an echo suppressor, and the like.
  • a value is obtained as a second gain coefficient, the value being obtained by making a gain coefficient corresponding to the m-fold frequency value and the frequency value around the m-fold frequency value closer to 0, and if not, the gain coefficient is obtained as the second gain coefficient.
  • the above-described conventional technique has difficulty in stably suppressing a nonlinear echo signal included in an input signal acquired by a microphone and therefore requires further improvement.
  • the present disclosure has been made to solve the above-described problem, and an object thereof is to provide a technique for stably suppressing a nonlinear echo signal included in an input signal acquired by a microphone.
  • An echo suppression device is provided with a first linear echo suppression unit which estimates an amplitude component and a phase component of a linear echo signal included in an input signal acquired by a microphone, to suppress the linear echo signal from the input signal; a nonlinear echo estimation unit which, by using a nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to a speaker and the input signal, and a nonlinear echo signal, estimates the nonlinear echo signal included in the input signal from at least one of the call reception signal and the input signal; a nonlinear echo suppression unit which, by using the nonlinear echo signal estimated by the nonlinear echo estimation unit, suppresses the nonlinear echo signal from an output signal of the first linear echo suppression unit; and a second linear echo suppression unit which estimates an amplitude component of a residual linear echo signal not suppressed by the first linear echo suppression unit, to suppress the residual linear echo signal from an output signal of the nonlinear echo suppression unit.
  • An echo canceller is a technique of removing echoes by estimating an echo signal by an adaptive filter and subtracting the estimated echo signal from a signal of sound collected by a microphone.
  • An echo is an overlap of a direct sound and a reflected sound of a loudspoken sound from a speaker. Therefore, a transmission characteristic between the speaker and the microphone can be represented by an FIR (Finite Impulse Response) filter.
  • An FIR type the adaptive filter learns so as to approximate a transmission characteristic and convolutes a filtering coefficient in a call reception signal to generate a pseudo echo signal as an estimation value of an echo.
  • LMS Least Mean Square
  • NLMS Normalized LMS
  • ICA Independent Component Analysis
  • an echo suppressor is a technique for suppressing an echo by estimating a power spectrum of an echo in a frequency domain and subtracting the estimated power spectrum of the echo from a signal of sound collected by a microphone.
  • An echo suppressor suppresses echoes by, for example, the spectrum subtraction method or the Wiener filtering method.
  • a residual echo might be generated immediately after power application or when an echo path changes because learning of an adaptive filter takes time.
  • noise or a call transmission signal generated in a speaker or a microphone causes erroneous learning of the adaptive filter to generate a pseudo echo signal estimation error, so that the residual echo might be increased.
  • An echo suppressor is therefore commonly used for compensating for echo suppression at a later stage of an echo canceller.
  • Conventional echo cancellers and conventional echo suppressors have a problem that it is difficult to suppress a nonlinear echo to which a nonlinear noise such as a speaker distortion is applied because of estimation of an echo based on a linear model.
  • a nonlinear noise such as a speaker distortion
  • an apparatus for use in a notebook computer or a portable Web conference system an effect of a nonlinear echo derived from a speaker distortion noticeably appears, so that a call might not be made comfortably because a loudspoken sound is made at high volume by a small-scale speaker.
  • JP 2017-191992 A described above it is difficult to suppress a nonlinear echo signal of a frequency component not included in a call reception signal, such as a harmonic distortion.
  • JP 2010-103875 A described above it is difficult to suppress a wide band distortion component and difficult to suppress a distortion component generated at a frequency value other than an integral-multiple frequency value.
  • an echo suppression device which estimates an amplitude component and a phase component of a linear echo signal included in an input signal acquired by a microphone, to suppress the linear echo signal from the input signal; a nonlinear echo estimation unit which, by using a nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to a speaker and the input signal, and a nonlinear echo signal, estimates the nonlinear echo signal included in the input signal from at least one of the call reception signal and the input signal; a nonlinear echo suppression unit which, by using the nonlinear echo signal estimated by the nonlinear echo estimation unit, suppresses the nonlinear echo signal from an output signal of the first linear echo suppression unit; and a second linear echo suppression unit which estimates an amplitude component of a residual linear echo signal not suppressed by the first linear echo suppression unit, to suppress the residual linear echo signal from an output signal of the nonlinear echo suppression unit
  • the nonlinear echo signal included in the input signal is estimated from at least one of the call reception signal and the input signal, and by using the estimated nonlinear echo signal, the nonlinear echo signal is suppressed from an output signal of the first linear echo suppression unit. Accordingly, the nonlinear echo signal included in the input signal acquired by the microphone can be stably suppressed.
  • a residual linear echo signal is suppressed by the second linear echo suppression unit from an output signal in which a nonlinear echo signal is suppressed. Accordingly, it is possible to stabilize operation of the second linear echo suppression unit and improve linear echo signal suppression performance.
  • the nonlinear echo model may be learned with at least one of the call reception signal and the input signal as an input and the nonlinear echo signal as an output, the nonlinear echo model using, as teacher data, at least one of the call reception signal and the input signal, and an output signal of the second linear echo suppression unit which suppresses the residual linear echo signal from an output signal of the first linear echo suppression unit which suppresses a linear echo signal from the input signal.
  • the first linear echo suppression unit and the second linear echo suppression unit suppress only a linear echo signal and do not suppress a nonlinear echo signal
  • a signal with a linear echo signal suppressed by the first linear echo suppression unit and the second linear echo suppression unit can be used as a nonlinear echo signal for teacher data.
  • a nonlinear echo signal is learned with at least one of a call reception signal and an input signal, and an output signal of the second linear echo suppression unit used as teacher data, a complicated distortion by a speaker can be precisely modeled to improve an estimation precision of a nonlinear echo signal.
  • the nonlinear echo model may be a neural network.
  • a nonlinear echo model can be realized by a neural network.
  • the nonlinear echo estimation unit may estimate the nonlinear echo signal included in the input signal from the call reception signal by using the nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal.
  • a nonlinear echo signal can be estimated from a call reception signal by using a nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal, a nonlinear echo signal can be easily estimated from a call reception signal.
  • the nonlinear echo estimation unit may estimate the nonlinear echo signal included in the input signal from the call reception signal and the input signal by using the nonlinear echo model indicative of a relationship between the call reception signal and the input signal, and the nonlinear echo signal.
  • the nonlinear echo estimation unit may estimate the nonlinear echo signal included in the input signal from the call reception signal and an output signal of the first linear echo suppression unit by using the nonlinear echo model indicative of a relationship between the call reception signal and an output signal of the first linear echo suppression unit, and the nonlinear echo signal.
  • a nonlinear echo signal is estimated not only from a call reception signal but also from a call reception signal and an output signal of the first linear echo suppression unit, an estimation precision of a nonlinear echo signal can be improved.
  • the first linear echo suppression unit may include an adaptive filter which generates a pseudo linear echo signal indicative of a component of the call reception signal included in the input signal by convoluting a filtering coefficient and the call reception signal, and a subtraction unit which subtracts the pseudo linear echo signal from the input signal
  • the nonlinear echo estimation unit may estimate the nonlinear echo signal included in the input signal from the call reception signal and the pseudo linear echo signal from the adaptive filter by using the nonlinear echo model indicative of a relationship between the call reception signal and the pseudo linear echo signal from the adaptive filter, and the nonlinear echo signal.
  • a nonlinear echo signal is estimated not only from a call reception signal but also from a call reception signal and a pseudo linear echo signal from the adaptive filter of the first linear echo suppression unit, an estimation precision of a nonlinear echo signal can be improved.
  • the nonlinear echo estimation unit may estimate the nonlinear echo signal included in the input signal from the input signal by using the nonlinear echo model indicative of a relationship between the input signal and the nonlinear echo signal.
  • a nonlinear echo signal is estimated from an input signal using a nonlinear echo model indicative of a relationship between an input signal and a nonlinear echo signal, a nonlinear echo signal can be easily estimated from an input signal.
  • the above-described echo suppression device may be further provided with a correction unit which calculates a variable gain for minimizing one of an output signal of the nonlinear echo suppression unit and an output signal of the second linear echo suppression unit and corrects the nonlinear echo signal estimated by the nonlinear echo estimation unit by using the calculated variable gain.
  • a nonlinear echo signal estimation error can be corrected to improve nonlinear echo signal suppression performance.
  • An echo suppression device includes a first linear echo suppression unit which estimates an amplitude component and a phase component of a linear echo signal included in an input signal acquired by a microphone, to suppress the linear echo signal from the input signal; a nonlinear echo estimation unit which estimates the nonlinear echo signal included in the input signal from at least one of a call reception signal to be output to a speaker and the input signal; a nonlinear echo suppression unit which, by using the nonlinear echo signal estimated by the nonlinear echo estimation unit, suppresses the nonlinear echo signal from the input signal; and a second linear echo suppression unit which estimates an amplitude component of a residual linear echo signal not suppressed by the first linear echo suppression unit, to suppress the residual linear echo signal.
  • a nonlinear echo signal included in an input signal is estimated from at least one of a call reception signal to be output to the speaker and the input signal, and by using the estimated nonlinear echo signal, the nonlinear echo signal is suppressed from the input signal. Accordingly, a nonlinear echo signal included in an input signal acquired by the microphone can be stably suppressed.
  • a residual linear echo signal is suppressed by the second linear echo suppression unit. Accordingly, operation of the second linear echo suppression unit can be stabilized to improve linear echo signal suppression performance.
  • An echo suppression method includes, estimating, by a first linear echo suppression unit, an amplitude component and a phase component of a linear echo signal included in an input signal acquired by a microphone, to suppress the linear echo signal from the input signal; by using a nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to a speaker and the input signal, and a nonlinear echo signal, estimating, by a nonlinear echo estimation unit, the nonlinear echo signal included in the input signal from at least one of the call reception signal and the input signal; by using the nonlinear echo signal estimated by the nonlinear echo estimation unit, suppressing, by a nonlinear echo suppression unit, the nonlinear echo signal from an output signal of the first linear echo suppression unit; and estimating, by a second linear echo suppression unit, an amplitude component of a residual linear echo signal not suppressed by the first linear echo suppression unit, to suppress the residual linear echo signal from an output signal of the nonlinear echo suppression unit.
  • a nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to the speaker and an input signal, and the nonlinear echo signal by using a nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to the speaker and an input signal, and the nonlinear echo signal, a nonlinear echo signal included in the input signal is estimated from at least one of the call reception signal and the input signal, and by using the estimated nonlinear echo signal, the nonlinear echo signal is suppressed from an output signal of the first linear echo suppression unit. Accordingly, it is possible to stably suppress a nonlinear echo signal included in an input signal acquired by the microphone.
  • a residual linear echo signal is suppressed by the second linear echo suppression unit from an output signal in which a nonlinear echo signal is suppressed. Accordingly, operation of the second linear echo suppression unit can be stabilized to improve linear echo signal suppression performance.
  • An echo suppression method includes, estimating, by a first linear echo suppression unit, an amplitude component and a phase component of a linear echo signal included in an input signal acquired by a microphone, to suppress the linear echo signal from the input signal; estimating, by a nonlinear echo estimation unit, the nonlinear echo signal included in the input signal from at least one of a call reception signal to be output to a speaker and the input signal; by using the nonlinear echo signal estimated by the nonlinear echo estimation unit, suppressing, by a nonlinear echo suppression unit, the nonlinear echo signal from the input signal; and estimating, by a second linear echo suppression unit, an amplitude component of a residual linear echo signal not suppressed by the first linear echo suppression unit, to suppress the residual linear echo signal.
  • a nonlinear echo signal included in an input signal is estimated from at least one of a call reception signal to be output to the speaker and the input signal, and by using the estimated nonlinear echo signal, the nonlinear echo signal is suppressed from the input signal. Accordingly, it is possible to stably suppress a nonlinear echo signal included in an input signal acquired by the microphone.
  • a residual linear echo signal is suppressed by the second linear echo suppression unit. Accordingly, operation of the second linear echo suppression unit can be stabilized to improve linear echo signal suppression performance.
  • An echo suppression program causes a computer to function as: a first linear echo suppression unit which estimates an amplitude component and a phase component of a linear echo signal included in an input signal acquired by a microphone, to suppress the linear echo signal from the input signal; a nonlinear echo estimation unit which, by using a nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to a speaker and the input signal, and a nonlinear echo signal, estimates the nonlinear echo signal included in the input signal from at least one of the call reception signal and the input signal; a nonlinear echo suppression unit which, by using the nonlinear echo signal estimated by the nonlinear echo estimation unit, suppresses the nonlinear echo signal from an output signal of the first linear echo suppression unit; and a second linear echo suppression unit which estimates an amplitude component of a residual linear echo signal not suppressed by the first linear echo suppression unit, to suppress the residual linear echo signal from an output signal of the nonlinear echo suppression unit.
  • the nonlinear echo signal included in the input signal is estimated from at least one of the call reception signal and the input signal, and by using the estimated nonlinear echo signal, the nonlinear echo signal is suppressed from an output signal of the first linear echo suppression unit. Accordingly, a nonlinear echo signal included in an input signal acquired by the microphone can be stably suppressed.
  • a residual linear echo signal is suppressed by the second linear echo suppression unit from an output signal in which a nonlinear echo signal is suppressed. Accordingly, operation of the second linear echo suppression unit can be stabilized to improve linear echo signal suppression performance.
  • An echo suppression program causes a computer to function as: a first linear echo suppression unit which estimates an amplitude component and a phase component of a linear echo signal included in an input signal acquired by a microphone, to suppress the linear echo signal from the input signal; a nonlinear echo estimation unit which estimates the nonlinear echo signal included in the input signal from at least one of a call reception signal to be output to a speaker and the input signal; a nonlinear echo suppression unit which, by using the nonlinear echo signal estimated by the nonlinear echo estimation unit, suppresses the nonlinear echo signal from the input signal; and a second linear echo suppression unit which estimates an amplitude component of a residual linear echo signal not suppressed by the first linear echo suppression unit, to suppress the residual linear echo signal.
  • a nonlinear echo signal included in an input signal is estimated from at least one of a call reception signal to be output to the speaker and the input signal, and by using the estimated nonlinear echo signal, the nonlinear echo signal is suppressed from the input signal. Accordingly, it is possible to stably suppress a nonlinear echo signal included in an input signal acquired by the microphone.
  • a residual linear echo signal is suppressed by the second linear echo suppression unit. Accordingly, operation of the second linear echo suppression unit can be stabilized to improve linear echo signal suppression performance.
  • Nonlinear distortion is a generic name of distortion occurring in a case where a system input/output relationship is not proportional. For example, when two tone sine waves of frequencies f1 and f2 are input to a system having an input/output characteristic that an output amplitude clips as an input amplitude is increased, an amplitude spectrum of an output waveform will have nonlinear distortions in frequency components not present in an input signal.
  • the nonlinear distortions are roughly classified into a harmonic distortion occurring at integral multiple frequencies of the input signal such as 2f1 and 2f2 and an intermodulation distortion occurring at frequencies as a sum and a difference in the input signal such as f1 + f2 and f2 - f1.
  • a nonlinear distortion of a loudspoken sound from a speaker becomes a factor for a nonlinear echo.
  • displacement of a diaphragm is increased in a frequency band near a lowest resonance frequency f0.
  • a nonlinear distortion is generated by nonlinearity of a driving force generated by moving of a voice coil over a range of a magnetic flux made by a permanent magnet, or by mechanical nonlinearity of a supporting system such as a cone edge or a damper, or by other nonlinearity.
  • a sound pressure near the lowest resonance frequency f0 is boosted by preprocessing for compensating for a reduction in a sound pressure level in a low frequency band in some cases.
  • a diaphragm is displaced more to become a factor for further generation of a nonlinear distortion.
  • An echo canceller removes echoes by calculating an echo estimation value, i.e., a pseudo echo signal, by an adaptive filter and subtracting the calculated pseudo echo signal from a microphone signal.
  • a pseudo echo y(k) will be represented by an equation (1) below.
  • the equation (1) indicates that a pseudo echo is expressed by a linear sum including changed phase and amplitude of a call reception signal, and cannot express a nonlinear echo irrespective of an adaptive algorithm used in coefficient learning.
  • an echo suppressor is provided at a later stage of an echo canceller.
  • the echo suppressor suppresses a residual echo by estimating a power spectrum of a residual echo not suppressed by the echo canceller.
  • An echo suppressor based on the Wiener filtering method widely used in common estimates an acoustic coupling amount A E ( ⁇ ) between a short-time spectrum X( ⁇ ) of a call reception signal and a short-time spectrum Y EC ( ⁇ ) of a residual echo to calculate a Wiener filter G wiener ( ⁇ ) based on an equation (2) below:
  • G wiener ⁇ Y EC ⁇ 2 ⁇ A E ⁇ X ⁇ 2 Y EC ⁇ 2
  • the echo suppressor obtains a signal Y ES ( ⁇ ) with suppressed echoes by multiplying the short-time spectrum Y EC ( ⁇ ) of the residual echo by the Wiener filter G wiener ( ⁇ ) in a manner shown by an equation (3) below.
  • Y ES ⁇ G wiener ⁇ Y EC ⁇
  • the echo suppressor estimates a residual echo by the acoustic coupling amount A E ( ⁇ ) estimated for each frequency component and the call reception signal X( ⁇ ). Therefore, the echo suppressor cannot estimate a frequency component absent in a call reception signal, such as a nonlinear echo.
  • a conventional echo suppression device is provided with a speaker which loudspeaks a call reception signal, a microphone, an echo canceller which suppresses an echo signal from an input signal acquired by the microphone, and an echo suppressor which suppresses an echo signal from an output signal of the echo canceller.
  • a 1/3 octave band noise at a center frequency of 400 Hz near the lowest resonance frequency f0 of the speaker used in loudspeaking.
  • FIG. 1 is a diagram showing a microphone signal, an echo canceller output signal, and an echo suppressor output signal in a case where a nonlinear echo caused by a speaker distortion is not included in an input signal
  • FIG. 2 is a diagram showing a microphone signal, an echo canceller output signal, and an echo suppressor output signal in a case where a nonlinear echo caused by a speaker distortion is included in an input signal.
  • solid lines represent a microphone signal (input signal) output from a microphone
  • broken lines represent an echo canceller output signal
  • chain dotted lines represent an echo suppressor output signal.
  • the horizontal axes represent a frequency and the vertical axes represent an amplitude level.
  • FIG. 2 secondary to quartic harmonics of an input signal appear, which shows that no nonlinear echoes can be suppressed at all by conventional echo canceller and echo suppressor as described above. Further, focusing on a fundamental tone near 400 Hz in FIG. 1 and FIG. 2 , it is found that while without a nonlinear echo, echoes of about 35 dB are suppressed by the echo canceller, with a nonlinear echo, the suppression amount realized by the echo canceller is decreased to about 20 dB. This is considered to be derived from an error in echo estimation due to erroneous learning caused as a result of forcible updating of a filter coefficient continuously conducted by an adaptive filter for trying to imitate a nonlinear echo which cannot be originally expressed.
  • an echo suppression device estimates nonlinear echoes by using a neural network which enables approximation of an arbitrary nonlinear function.
  • a neural network introducing method there are two possible methods, a method of estimating an amplitude and a phase of a nonlinear echo and applying the estimated results to an echo canceller and a method of estimating only an amplitude of a nonlinear echo and applying the estimated result to an echo suppressor.
  • the former method has problems of requiring higher estimation precision than in the latter and of an increase in a calculation amount.
  • the echo suppression device of the present first embodiment therefore realizes suppression of nonlinear echoes by an echo suppressor method which can be implemented with low power consumption, low cost, and a reduced calculation amount.
  • FIG. 3 is a diagram showing a configuration of a call device in a first embodiment of the present disclosure.
  • FIG. 4 is a diagram showing one example of a signal to be output from each unit of an echo suppression device in the present first embodiment.
  • the call device is used in a loudspeaker type hands-free call system, a loudspeaker type bidirectional communication conference system, an interphone system, and the like.
  • the call device shown in FIG. 3 is provided with an echo suppression device 1, an input terminal 11, a speaker 12, a microphone 13, and an output terminal 22.
  • the input terminal 11 outputs a call reception signal x(k) received from a call device (not shown) on a call reception side to the echo suppression device 1.
  • the speaker 12 externally outputs the input call reception signal x(k).
  • a voice output from the speaker 12 is collected by the microphone 13
  • a voice uttered by a caller on the call reception side will be reproduced behindhand from a speaker on the call reception side to generate a so-called echo.
  • the echo suppression device 1 therefore suppresses an acoustic echo signal included in an input signal x mic (k) output from the microphone 13.
  • the acoustic echo signal includes a linear echo signal and a nonlinear echo signal.
  • the microphone 13 is arranged in a space in which a call transmission party is present, and collects a voice of the call transmission party.
  • the microphone 13 outputs the input signal x mic (k) indicative of the collected voice to the echo suppression device 1.
  • the output terminal 22 outputs an input signal y ES (k) with a linear echo signal and a nonlinear echo signal suppressed by the echo suppression device 1.
  • the input terminal 11 and the output terminal 22 are connected to a communication unit (not shown).
  • the communication unit transmits the input signal y ES (k) to the call device (not shown) on the call reception side via a network and receives the call reception signal x(k) from the call device (not shown) on the call reception side via the network.
  • the network is, for example, the Internet.
  • the echo suppression device 1 is provided with an echo canceller 14, fast Fourier transform units 15 and 16, a nonlinear echo model storage unit 17, a nonlinear echo estimation unit 18, a nonlinear echo suppression unit 19, an echo suppressor 20, and an inverse fast Fourier transform unit 21.
  • the input terminal 11 outputs the call reception signal x(k) to the speaker 12, the echo canceller 14, and the fast Fourier transform unit 15.
  • the echo canceller 14 estimates an amplitude component and a phase component of a linear echo signal included in the input signal x mic (k) acquired by the microphone 13 to suppress the linear echo signal from the input signal x mic (k).
  • the echo canceller 14 is one example of a first linear echo suppression unit. As shown in FIG. 4 , the echo canceller 14 suppresses only a linear echo signal included in the input signal x mic (k) output from the microphone 13.
  • the echo canceller 14 is provided with an adaptive filter and a subtraction unit not shown.
  • the adaptive filter convolutes a filtering coefficient and a call reception signal to generate a pseudo echo signal indicative of a component of a call reception signal included in the input signal x mic (k) acquired by the microphone 13.
  • the subtraction unit calculates an error signal between the input signal x mic (k) from the microphone 13 and the pseudo echo signal from the adaptive filter and outputs the calculated error signal to the adaptive filter.
  • the adaptive filter corrects the filtering coefficient based on the input error signal and convolutes the corrected filtering coefficient and the call reception signal to generate a pseudo echo signal.
  • the adaptive filter corrects the filtering coefficient by using an adaptive algorithm so as to have a minimum error signal.
  • an adaptive algorithm for example, the Normalized Least Mean Square (NLMS) method, the Affine Projection method, or the Recursive Least Square (RLS) method is used.
  • the subtraction unit subtracts the pseudo echo signal of the adaptive filter from the input signal x mic (k) from the microphone 13 to suppress a linear echo signal from the input signal x mic (k). Then, the subtraction unit outputs an input signal y EC (k) with a suppressed linear echo signal to the fast Fourier transform unit 15.
  • the fast Fourier transform unit 15 conducts discrete Fourier transform at a high speed.
  • the fast Fourier transform unit 15 converts the input signal y EC (k) in a time domain to be input to the nonlinear echo suppression unit 19 from the echo canceller 14 into an input signal Y EC ( ⁇ ) in a frequency domain.
  • the fast Fourier transform unit 15 outputs the input signal Y EC ( ⁇ ) in the frequency domain with only a linear echo signal suppressed by the echo canceller 14 to the nonlinear echo suppression unit 19.
  • the fast Fourier transform unit 16 conducts discrete Fourier transform at a high speed.
  • the fast Fourier transform unit 16 converts the call reception signal x(k) in the time domain to be input to the nonlinear echo estimation unit 18 into a call reception signal X( ⁇ ) in the frequency domain.
  • the fast Fourier transform unit 16 outputs the call reception signal X( ⁇ ) in the frequency domain to the nonlinear echo estimation unit 18 and the echo suppressor 20.
  • the nonlinear echo model storage unit 17 stores in advance a nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to the speaker 12 and an input signal acquired by the microphone 13, and a nonlinear echo signal.
  • the nonlinear echo model storage unit 17 in the present first embodiment stores in advance a nonlinear echo model indicative of a relationship between a call reception signal and a nonlinear echo signal.
  • the nonlinear echo model is, for example, a neural network.
  • a nonlinear echo model uses, as teacher data, at least one of a call reception signal and an input signal, and an output signal of the echo suppressor which suppresses a linear echo signal from an output signal of the echo canceller which suppresses a linear echo signal from the input signal, and is learned with at least one of the call reception signal and the input signal as an input and the nonlinear echo signal as an output.
  • the nonlinear echo model in the present first embodiment uses, as teacher data, a call reception signal, and an output signal from the echo suppressor which suppresses a linear echo signal from an output signal of the echo canceller which suppresses a linear echo signal from the input signal, and is learned with the call reception signal as an input and the nonlinear echo signal as an output.
  • the nonlinear echo estimation unit 18 estimates a nonlinear echo signal X NN ( ⁇ ) included in the input signal Y EC ( ⁇ ) from at least one of the call reception signal X( ⁇ ) to be output to the speaker 12 and the input signal x mic (k). More specifically, the nonlinear echo estimation unit 18 estimates the nonlinear echo signal X NN ( ⁇ ) included in the input signal Y EC ( ⁇ ) from at least one of the call reception signal X( ⁇ ) and the input signal x mic (k) by using a nonlinear echo model indicative of a relationship between at least one of the call reception signal X( ⁇ ) to be output to the speaker 12 and the input signal x mic (k), and the nonlinear echo signal.
  • the nonlinear echo estimation unit 18 in the present first embodiment estimates the nonlinear echo signal X NN ( ⁇ ) included in the input signal from the call reception signal X( ⁇ ) by using a nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal.
  • the nonlinear echo estimation unit 18 reads the nonlinear echo model from the nonlinear echo model storage unit 17.
  • the nonlinear echo estimation unit 18 acquires the nonlinear echo signal X NN ( ⁇ ) from the nonlinear echo model by inputting the call reception signal X( ⁇ ) output from the fast Fourier transform unit 16 to the nonlinear echo model.
  • the nonlinear echo estimation unit 18 outputs the nonlinear echo signal X NN ( ⁇ ) estimated using the call reception signal X( ⁇ ) to the nonlinear echo suppression unit 19.
  • the nonlinear echo suppression unit 19 suppresses the nonlinear echo signal X NN ( ⁇ ) from the input signal Y EC ( ⁇ ) by using the nonlinear echo signal X NN ( ⁇ ) estimated by the nonlinear echo estimation unit 18. More specifically, the nonlinear echo suppression unit 19 suppresses the nonlinear echo signal X NN ( ⁇ ) from the output signal of the echo canceller 14 by using the nonlinear echo signal X NN ( ⁇ ) estimated by the nonlinear echo estimation unit 18.
  • the nonlinear echo suppression unit 19 calculates a Wiener filter G NN ( ⁇ ) from the estimated nonlinear echo signal X NN ( ⁇ ) and the input signal Y EC ( ⁇ ) from the echo canceller 14 based on an equation (4) below.
  • G NN ⁇ Y EC ⁇ 2 ⁇ X NN ⁇ 2 Y EC ⁇ 2
  • the nonlinear echo suppression unit 19 obtains an input signal Y NL-ES ( ⁇ ) with a suppressed nonlinear echo signal by multiplying the input signal Y EC ( ⁇ ) by the Wiener filter G NN ( ⁇ ) in a manner as shown in an equation (5) below.
  • Y NL ⁇ ES ⁇ G NN ⁇ Y EC ⁇
  • the nonlinear echo suppression unit 19 outputs the input signal Y NL-ES ( ⁇ ) with only the nonlinear echo signal X NN ( ⁇ ) suppressed to the echo suppressor 20.
  • the echo suppressor 20 suppresses a residual linear echo signal by estimating an amplitude component of a residual linear echo signal not suppressed by the echo canceller 14. More specifically, the echo suppressor 20 suppresses a residual linear echo signal from the output signal Y NL-ES ( ⁇ ) of the nonlinear echo suppression unit 19 by estimating an amplitude component of a residual linear echo signal not suppressed by the echo canceller 14.
  • the echo suppressor 20 is one example of a second linear echo suppression unit.
  • the echo suppressor 20 suppresses a residual linear echo signal by a spectrum subtraction method or the Wiener filtering method.
  • the echo suppressor 20 estimates an acoustic coupling amount for each frequency by using a space including only an echo signal or a coherence function.
  • the echo suppressor 20 calculates a suppression gain by using the estimated acoustic coupling amount and the output signal Y NL-ES ( ⁇ ) of the nonlinear echo suppression unit 19, and the call reception signal X( ⁇ ).
  • the echo suppressor 20 suppresses a residual linear echo signal not suppressed by the echo canceller 14 by multiplying the output signal of the nonlinear echo suppression unit 19 by the calculated suppression gain.
  • the echo suppressor 20 outputs the input signal Y ES ( ⁇ ) in which only the residual linear echo signal is suppressed from the input signal Y NL-ES ( ⁇ ) to the inverse fast Fourier transform unit 21.
  • the inverse fast Fourier transform unit 21 conducts inverse discrete Fourier transform at a high speed.
  • the inverse fast Fourier transform unit 21 converts the input signal Y ES ( ⁇ ) in the frequency domain to be input from the echo suppressor 20 to the output terminal 22 into the input signal y ES (k) in the time domain.
  • the inverse fast Fourier transform unit 21 outputs the input signal y ES (k) to the output terminal 22.
  • FIG. 5 is a flow chart for describing operation of the echo suppression device in the first embodiment of the present disclosure.
  • Step S1 the echo canceller 14 suppresses a linear echo signal from the input signal x mic (k) by estimating an amplitude component and a phase component of the linear echo signal included in the input signal x mic (k) acquired by the microphone 13.
  • Step S2 the nonlinear echo estimation unit 18 estimates the nonlinear echo signal X NN ( ⁇ ) included in the input signal from the call reception signal X( ⁇ ) by using the nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal.
  • Step S3 the nonlinear echo suppression unit 19 suppresses the nonlinear echo signal X NN ( ⁇ ) estimated by the nonlinear echo estimation unit 18 from the input signal Y EC ( ⁇ ) output from the echo canceller 14.
  • Step S4 the echo suppressor 20 suppresses a residual linear echo signal from the input signal Y NL-ES ( ⁇ ) from the nonlinear echo suppression unit 19 by estimating an amplitude component of the residual linear echo signal not suppressed by the echo canceller 14.
  • the echo suppressor 20 outputs the input signal Y ES ( ⁇ ) in which only the residual linear echo signal is suppressed from the input signal Y NL-ES ( ⁇ ) to the inverse fast Fourier transform unit 21.
  • the inverse fast Fourier transform unit 21 outputs the input signal y ES (k) in the time domain to the output terminal 22.
  • the nonlinear echo model indicative of a relationship between at least one of a call reception signal to be output to the speaker 12 and an input signal, and a nonlinear echo signal the nonlinear echo signal included in the input signal is estimated from at least one of the call reception signal and the input signal, and by using the estimated nonlinear echo signal, the nonlinear echo signal is suppressed from the output signal of the echo canceller 14. Accordingly, the nonlinear echo signal included in the input signal acquired by the microphone 13 can be stably suppressed.
  • a residual linear echo signal is suppressed by the echo suppressor 20 from an output signal in which a nonlinear echo signal is suppressed. Accordingly, it is possible to stabilize operation of the echo suppressor 20 and improve linear echo signal suppression performance.
  • FIG. 6 is a diagram showing a configuration of a learning device in the first embodiment of the present disclosure.
  • FIG. 7 is a diagram showing one example of a signal to be output from each unit of the learning device in the present first embodiment.
  • the learning device shown in FIG. 6 is provided with a nonlinear echo model creation device 2, an input terminal 31, a speaker 32, a microphone 33, and an output terminal 39.
  • the input terminal 31 outputs the call reception signal x(k) received from the call device (not shown) on the call reception side to the echo suppression device 1.
  • the speaker 32 externally outputs the input call reception signal x(k).
  • the microphone 33 is arranged in a space in which a call transmission party is present, and collects a voice of the call transmission party.
  • the microphone 33 outputs the input signal x mic (k) indicative of the collected voice to the nonlinear echo model creation device 2.
  • the output terminal 39 outputs the input signal y ES (k) with a linear echo signal suppressed by the nonlinear echo model creation device 2.
  • a configuration of the input terminal 31, the speaker 32, the microphone 33, and the output terminal 39 is the same as the configuration of the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22 in FIG. 3 .
  • the nonlinear echo model creation device 2 is provided with an echo canceller 34, fast Fourier transform units 35 and 36, an echo suppressor 37, an inverse fast Fourier transform unit 38, a nonlinear echo model learning unit 40, and a nonlinear echo model storage unit 41.
  • the echo canceller 34 estimates an amplitude component and a phase component of a linear echo signal included in the input signal x mic (k) acquired by the microphone 13 to suppress the linear echo signal from the input signal x mic (k).
  • a configuration of the echo canceller 34 is the same as the configuration of the echo canceller 14 shown in FIG. 3 .
  • the echo canceller 34 outputs the input signal y EC (k) with a suppressed linear echo signal to the fast Fourier transform unit 35.
  • the fast Fourier transform unit 35 conducts discrete Fourier transform at a high speed.
  • the fast Fourier transform unit 35 converts the input signal y EC (k) in the time domain to be input from the echo canceller 34 to the echo suppressor 37 into the input signal Y EC ( ⁇ ) in the frequency domain.
  • the fast Fourier transform unit 35 outputs the input signal Y EC ( ⁇ ) in the frequency domain with only the linear echo signal suppressed by the echo canceller 34 to the echo suppressor 37 .
  • the fast Fourier transform unit 36 conducts discrete Fourier transform at a high speed.
  • the fast Fourier transform unit 36 converts the call reception signal x(k) in the time domain to be input to the echo suppressor 37 into the call reception signal X( ⁇ ) in the frequency domain.
  • the fast Fourier transform unit 36 outputs the call reception signal X( ⁇ ) in the frequency domain to the echo suppressor 37 and the nonlinear echo model learning unit 40.
  • the echo suppressor 37 estimates an amplitude component of a residual linear echo signal not suppressed by the echo canceller 34 to suppress a residual linear echo signal from the input signal Y EC ( ⁇ ).
  • the echo suppressor 37 outputs the input signal Y ES ( ⁇ ) with only a residual linear echo signal suppressed from the input signal Y EC ( ⁇ ) to the inverse fast Fourier transform unit 21 and the nonlinear echo model learning unit 40.
  • the inverse fast Fourier transform unit 38 conducts inverse discrete Fourier transform at a high speed.
  • the inverse fast Fourier transform unit 38 converts the input signal Y ES ( ⁇ ) in the frequency domain to be input from the echo suppressor 37 to the output terminal 39 into the input signal y ES (k) in the time domain.
  • the inverse fast Fourier transform unit 38 outputs the input signal y ES (k) to the output terminal 39.
  • the nonlinear echo model learning unit 40 learns a nonlinear echo model in which there are used, as teacher data, at least one of the call reception signal X( ⁇ ) and the input signal x mic (k), and the output signal Y ES ( ⁇ ) of the echo suppressor 37 which suppresses a residual linear echo signal from the output signal Y EC ( ⁇ ) of the echo canceller 34 which suppresses a linear echo signal from the input signal x mic (k), with at least one of the call reception signal X( ⁇ ) and the input signal x mic (k) used as an input and with the nonlinear echo signal used as an output.
  • the nonlinear echo model learning unit 40 in the present first embodiment learns a nonlinear echo model in which there are used, as teacher data, the call reception signal X( ⁇ ), and the output signal Y ES ( ⁇ ) of the echo suppressor 37 which suppresses a residual linear echo signal from the output signal Y EC ( ⁇ ) of the echo canceller 34 which suppresses a linear echo signal from the input signal x mic (k), with the call reception signal X( ⁇ ) as an input and the nonlinear echo signal as an output.
  • the nonlinear echo model is a neural network in which the amplitude spectrum X( ⁇ ) of the call reception signal, and the residual echo amplitude spectrum Y ES ( ⁇ ) of the echo canceller 34 and the echo suppressor 37 are learned in advance as teacher data.
  • the echo canceller 34 and the echo suppressor 37 can suppress only a linear echo signal. Therefore, output signals (residual echo signals) of the echo canceller 34 and the echo suppressor 37 are substantially equal to nonlinear echo signals.
  • the nonlinear echo model learning unit 40 can model a relationship between an amplitude spectrum of a call reception signal and an amplitude spectrum of a nonlinear echo signal.
  • Examples of machine learning include supervised learning in which a relationship between an input and an output is learned using teacher data in which a label (output information) is applied to input information, unsupervised learning in which a data structure is constructed with only unlabeled inputs, semi-supervised learning coping with both labelled and unlabeled inputs, and reinforcement learning in which action maximizing a return is learned by trial and error.
  • supervised learning in which a relationship between an input and an output is learned using teacher data in which a label (output information) is applied to input information
  • unsupervised learning in which a data structure is constructed with only unlabeled inputs
  • semi-supervised learning coping with both labelled and unlabeled inputs semi-supervised learning coping with both labelled and unlabeled inputs
  • reinforcement learning in which action maximizing a return is learned by trial and error.
  • the nonlinear echo model learning unit 40 stores a learned nonlinear echo model in the nonlinear echo model storage unit 41.
  • the nonlinear echo model storage unit 41 stores a nonlinear echo model learned by the nonlinear echo model learning unit 40.
  • the echo suppression device 1 shown in FIG. 3 may be provided with the nonlinear echo model learning unit 40.
  • the echo suppression device 1 may be further provided with a mode switching unit which switches a learning mode and an echo suppression mode.
  • the echo canceller 14 outputs an output signal to the echo suppressor 20.
  • the nonlinear echo model learning unit 40 may learn a nonlinear echo model using, as teacher data, the input signal Y ES ( ⁇ ) with a linear echo signal suppressed by the echo canceller 14 and the echo suppressor 20, and the call reception signal X( ⁇ ).
  • a nonlinear echo model learned by the learning device may be stored in advance in the nonlinear echo model storage unit 17 of the echo suppression device 1.
  • the echo suppression device 1 may receive a nonlinear echo model learned by the learning device and update the nonlinear echo model stored in the nonlinear echo model storage unit 17.
  • an amplitude spectrum of short-time Fourier transform is used as an input/output feature value.
  • FIG. 8 to FIG. 11 are diagrams showing examples where an amplitude spectrum of a nonlinear echo signal is estimated in the neural network.
  • FIG. 8 is a diagram showing an amplitude spectrum of a call reception signal including a 1/3 octave band noise
  • FIG. 9 is a diagram showing amplitude spectra of a correct value and an estimation value of a nonlinear echo signal included in an input signal obtained by a microphone when the call reception signal shown in FIG. 8 is loudspoken
  • FIG. 10 is a diagram showing an amplitude spectrum of a call reception signal including a female voice
  • FIG. 11 is a diagram showing amplitude spectra of a correct value and an estimation value of a nonlinear echo signal included in an input signal obtained by the microphone when the call reception signal shown in FIG. 10 is loudspoken.
  • the horizontal axis represents a frequency and the vertical axis represents an amplitude level.
  • solid lines represent a correct value of a nonlinear echo signal and broken lines represent an estimation value of the nonlinear echo signal.
  • the neural network estimates a nonlinear echo signal indicated by the solid line with high precision.
  • the conventional echo suppression device is provided only with an echo canceller and an echo suppressor and suppresses only a linear echo signal by the echo canceller and the echo suppressor.
  • FIG. 12 is a diagram showing results of frequency analyses of an output signal from a conventional echo suppression device and an output signal from the echo suppression device in the present first embodiment.
  • the horizontal axis represents a frequency and the vertical axis represents an amplitude level.
  • a solid line represents an input signal from the microphone 13
  • a broken line represents an output signal from the conventional echo suppression device
  • a chain dotted line represents an output signal from the echo suppression device 1 of the present first embodiment.
  • the call reception signal is a 1/3 octave band noise with a center frequency of 315 Hz.
  • the echo suppression device 1 of the present first embodiment obtains a suppression effect of 15 dB to 20 dB exceeding a target value with respect to a harmonic distortion as a nonlinear echo signal. Further, the echo suppression device 1 of the present first embodiment obtains an effect of suppression higher by about 15 dB than by the conventional echo suppression device also with respect to a 315 Hz linear echo signal. This is considered to be derived from stable estimation of an acoustic coupling amount in the echo suppressor 20 at the later stage, the stable estimation being enabled by suppression of a nonlinear echo signal by the nonlinear echo suppression unit 19 of the present first embodiment.
  • ERLE Echo Return Loss Enhancement
  • FIG. 13 is a diagram showing a temporal change of an amplitude of an input signal including a male voice and a temporal change of an echo suppression amount (ERLE) with respect to the input signal.
  • the horizontal axis represents time and the vertical axis represents an amplitude.
  • the horizontal axis represents time and the vertical axis represents an echo suppression amount.
  • a solid line represents an echo suppression amount by the echo suppression device 1 of the present first embodiment and a broken line represents an echo suppression amount by the conventional echo suppression device.
  • the echo suppression device 1 of the present first embodiment obtains an effect of suppression by about 10 dB higher than the suppression obtained by the conventional echo suppression device. It is therefore demonstrated that the echo suppression device 1 of the present first embodiment is sufficiently effective also for an input signal having a complicated frequency structure such as a person's voice.
  • the echo suppression device 1 of the present first embodiment enables a comfortable call even a speaker with a lot of distortions, thereby contributing to improvement in quality, and size and cost reduction of a notebook computer, a Web conference system, and the like.
  • the nonlinear echo estimation unit 18 in the first embodiment estimates a nonlinear echo signal included in an input signal from a call reception signal by using a nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal.
  • a nonlinear echo estimation unit in a second embodiment estimates a nonlinear echo signal included in an input signal from a call reception signal and the input signal by using a nonlinear echo model indicative of a relationship between the call reception signal and the input signal, and the nonlinear echo signal.
  • FIG. 14 is a diagram showing a configuration of a call device in the second embodiment of the present disclosure.
  • the call device shown in FIG. 14 is provided with an echo suppression device 1A, the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • the same configuration as that of the first embodiment will be given the same reference sign to omit description thereof.
  • the echo suppression device 1A is provided with the echo canceller 14, the fast Fourier transform units 15, 16, and 23, a nonlinear echo model storage unit 171, a nonlinear echo estimation unit 181, the nonlinear echo suppression unit 19, the echo suppressor 20, and the inverse fast Fourier transform unit 21.
  • the microphone 13 outputs the input signal x mic (k) to the echo canceller 14 and also to the nonlinear echo estimation unit 181 via the fast Fourier transform unit 23.
  • the fast Fourier transform unit 23 conducts discrete Fourier transform at a high speed.
  • the fast Fourier transform unit 23 converts the input signal x mic (k) in the time domain to be input to the nonlinear echo estimation unit 181 into the input signal X mic ( ⁇ ) in the frequency domain.
  • the fast Fourier transform unit 23 outputs the input signal X mic ( ⁇ ) in the frequency domain to the nonlinear echo estimation unit 181.
  • the nonlinear echo model storage unit 171 stores in advance a nonlinear echo model indicative of a relationship between a call reception signal to be output to the speaker 12 and an input signal acquired by the microphone 13, and a nonlinear echo signal.
  • the nonlinear echo model is, for example, a neural network.
  • the nonlinear echo model in the present second embodiment uses, as teacher data, a call reception signal, an input signal, and an output signal of the echo suppressor which suppresses a residual linear echo signal from an output signal of the echo canceller which suppresses a linear echo signal from the input signal, and is learned with the call reception signal and the input signal as an input and the nonlinear echo signal as an output.
  • the call reception signal X( ⁇ ) and the input signal X mic ( ⁇ ) in the frequency domain are input to the nonlinear echo model learning unit 40 shown in FIG. 6 .
  • the nonlinear echo model learning unit 40 in the present second embodiment learns a nonlinear echo model in which there are used, as teacher data, the call reception signal X( ⁇ ), the input signal X mic ( ⁇ ), and the output signal Y ES ( ⁇ ) of the echo suppressor 37 which suppresses a residual linear echo signal from the output signal Y EC ( ⁇ ) of the echo canceller 34 which suppresses a linear echo signal from the input signal x mic (k), with the call reception signal X( ⁇ ) and the input signal X mic ( ⁇ ) as an input and the nonlinear echo signal as an output.
  • the nonlinear echo estimation unit 181 estimates the nonlinear echo signal X NN ( ⁇ ) included in the input signal from the call reception signal X( ⁇ ) and the input signal X mic ( ⁇ ) by using a nonlinear echo model indicative of a relationship between a call reception signal and an input signal, and a nonlinear echo signal.
  • the nonlinear echo estimation unit 181 reads the nonlinear echo model from the nonlinear echo model storage unit 171.
  • the nonlinear echo estimation unit 181 acquires the nonlinear echo signal X NN ( ⁇ ) from the nonlinear echo model by inputting, to the nonlinear echo model, the call reception signal X( ⁇ ) output from the fast Fourier transform unit 16 and the input signal X mic ( ⁇ ) output from the fast Fourier transform unit 23.
  • the nonlinear echo estimation unit 181 outputs the nonlinear echo signal X NN ( ⁇ ) estimated by using the call reception signal X( ⁇ ) and the input signal X mic ( ⁇ ) to the nonlinear echo suppression unit 19.
  • the nonlinear echo estimation unit 181 in the present second embodiment estimates the nonlinear echo signal X NN ( ⁇ ) from the call reception signal X( ⁇ ) and the input signal X mic ( ⁇ ) by using the nonlinear echo model indicative of a relationship between a call reception signal and an input signal, and a nonlinear echo signal.
  • the nonlinear echo estimation unit 18 in the first embodiment estimates a nonlinear echo signal included in an input signal from a call reception signal by using a nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal.
  • a nonlinear echo estimation unit in a third embodiment estimates a nonlinear echo signal included in an input signal from a call reception signal and an output signal of the echo canceller 14 by using a nonlinear echo model indicative of a relationship between the call reception signal and the output signal of the echo canceller 14, and the nonlinear echo signal.
  • FIG. 15 is a diagram showing a configuration of a call device in the third embodiment of the present disclosure.
  • the call device shown in FIG. 15 is provided with an echo suppression device 1B, the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • the same configuration as that of the first embodiment will be given the same reference sign to omit description thereof.
  • the echo suppression device 1B is provided with the echo canceller 14, the fast Fourier transform units 15 and 16, a nonlinear echo model storage unit 172, a nonlinear echo estimation unit 182, the nonlinear echo suppression unit 19, the echo suppressor 20, and the inverse fast Fourier transform unit 21.
  • the fast Fourier transform unit 15 outputs the input signal Y EC ( ⁇ ) in the frequency domain with only a linear echo signal suppressed by the echo canceller 14 to the nonlinear echo suppression unit 19 and the nonlinear echo estimation unit 182.
  • the nonlinear echo model storage unit 172 stores, in advance, a nonlinear echo model indicative of a relationship between a call reception signal to be output to the speaker 12 and an output signal of the echo canceller, and a nonlinear echo signal.
  • the nonlinear echo model is, for example, a neural network.
  • the nonlinear echo model in the present third embodiment uses, as teacher data, a call reception signal, an output signal of the echo canceller, and an output signal of the echo suppressor which suppresses a residual linear echo signal from an output signal of the echo canceller which suppresses a linear echo signal from an input signal, and is learned with the call reception signal and the output signal of the echo canceller as an input and the nonlinear echo signal as an output.
  • the call reception signal X( ⁇ ) and the output signal Y EC ( ⁇ ) in the frequency domain of the echo canceller 34 are input to the nonlinear echo model learning unit 40 shown in FIG. 6 .
  • the nonlinear echo model learning unit 40 in the present third embodiment learns a nonlinear echo model in which there are used, as teacher data, the call reception signal X( ⁇ ), the output signal Y EC ( ⁇ ) in the frequency domain of the echo canceller 34, and the output signal Y ES ( ⁇ ) of the echo suppressor 37 which suppresses a residual linear echo signal from the output signal Y EC ( ⁇ ) in the frequency domain of the echo canceller 34 which suppresses a linear echo signal from the input signal x mic (k), with the call reception signal X( ⁇ ) and the output signal Y EC ( ⁇ ) in the frequency domain of the echo canceller 34 as an input and the nonlinear echo signal as an output.
  • the nonlinear echo estimation unit 182 estimates the nonlinear echo signal X NN ( ⁇ ) included in an input signal from the call reception signal X( ⁇ ) and the output signal Y EC ( ⁇ ) in the frequency domain of the echo canceller 14 by using a nonlinear echo model indicative of a relationship between a call reception signal and an output signal of the echo canceller, and a nonlinear echo signal.
  • the nonlinear echo estimation unit 182 reads the nonlinear echo model from the nonlinear echo model storage unit 172.
  • the nonlinear echo estimation unit 182 acquires the nonlinear echo signal X NN ( ⁇ ) from the nonlinear echo model by inputting, to the nonlinear echo model, the call reception signal X( ⁇ ) output from the fast Fourier transform unit 16 and the input signal Y EC ( ⁇ ) output from the fast Fourier transform unit 15.
  • the nonlinear echo estimation unit 182 outputs the nonlinear echo signal X NN ( ⁇ ) estimated by using the call reception signal X( ⁇ ) and the input signal Y EC ( ⁇ ) to the nonlinear echo suppression unit 19.
  • the nonlinear echo estimation unit 182 in the present third embodiment estimates the nonlinear echo signal X NN ( ⁇ ) from the call reception signal X( ⁇ ) and the output signal Y EC ( ⁇ ) in the frequency domain of the echo canceller 14 by using the nonlinear echo model indicative of a relationship between a call reception signal and an output signal of the echo canceller 14, and a nonlinear echo signal.
  • a nonlinear echo signal is estimated from a call reception signal and an output signal of the echo canceller, an estimation precision of a nonlinear echo signal can be further improved.
  • the nonlinear echo estimation unit 18 in the first embodiment estimates a nonlinear echo signal included in an input signal from a call reception signal by using a nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal.
  • a nonlinear echo estimation unit in a fourth embodiment estimates a nonlinear echo signal included in an input signal from a call reception signal and a pseudo linear echo signal from an adaptive filter of an echo canceller by using a nonlinear echo model indicative of a relationship between the call reception signal and the pseudo linear echo signal from the adaptive filter of the echo canceller, and the nonlinear echo signal.
  • FIG. 16 is a diagram showing a configuration of a call device in the fourth embodiment of the present disclosure.
  • the call device shown in FIG. 16 is provided with an echo suppression device 1C, the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • the same configuration as that of the first embodiment will be given the same reference sign to omit description thereof.
  • the echo suppression device 1C is provided with the echo canceller 14, the fast Fourier transform units 15, 16, 24, a nonlinear echo model storage unit 173, a nonlinear echo estimation unit 183, the nonlinear echo suppression unit 19, the echo suppressor 20, and the inverse fast Fourier transform unit 21.
  • the echo canceller 14 is provided with an adaptive filter 141 and a subtraction unit 142.
  • the adaptive filter 141 generates a pseudo linear echo signal indicative of a component of a call reception signal included in an input signal by convoluting a filtering coefficient and the call reception signal.
  • the subtraction unit 142 subtracts a pseudo linear echo signal from an input signal.
  • the fast Fourier transform unit 24 conducts discrete Fourier transform at a high speed.
  • the fast Fourier transform unit 24 converts a pseudo linear echo signal in the time domain to be input to the nonlinear echo estimation unit 183 into a pseudo linear echo signal in the frequency domain.
  • the fast Fourier transform unit 24 outputs the pseudo linear echo signal in the frequency domain to the nonlinear echo estimation unit 183.
  • the nonlinear echo model storage unit 173 stores, in advance, a nonlinear echo model indicative of a relationship between a call reception signal to be output to the speaker 12 and a pseudo linear echo signal from the adaptive filter of the echo canceller, and a nonlinear echo signal.
  • the nonlinear echo model is, for example, a neural network.
  • the nonlinear echo model in the present fourth embodiment uses, as teacher data, a call reception signal, a pseudo linear echo signal from the adaptive filter of the echo canceller, and an output signal of the echo suppressor which suppresses a residual linear echo signal from an output signal of the echo canceller which suppresses a linear echo signal from an input signal, and is learned with the call reception signal and the pseudo linear echo signal as an input and the nonlinear echo signal as an output.
  • the call reception signal X( ⁇ ) and the pseudo linear echo signal from the adaptive filter of the echo canceller 34 are input to the nonlinear echo model learning unit 40 shown in FIG. 6 .
  • the nonlinear echo model learning unit 40 in the present fourth embodiment learns a nonlinear echo model in which there are used, as teacher data, the call reception signal X( ⁇ ), the pseudo linear echo signal from the adaptive filter of the echo canceller 34, and the output signal Y ES ( ⁇ ) of the echo suppressor 37 which suppresses a residual linear echo signal from the output signal Y EC ( ⁇ ) of the echo canceller 34 which suppresses a linear echo signal from the input signal x mic (k), with the call reception signal X( ⁇ ) and the pseudo linear echo signal as an input and the nonlinear echo signal as an output.
  • the nonlinear echo estimation unit 183 estimates the nonlinear echo signal X NN ( ⁇ ) included in an input signal from the call reception signal X( ⁇ ) and the pseudo linear echo signal from the adaptive filter 141 by using a nonlinear echo model indicative of a relationship between a call reception signal and a pseudo linear echo signal from the adaptive filter, and a nonlinear echo signal.
  • the nonlinear echo estimation unit 183 reads the nonlinear echo model from the nonlinear echo model storage unit 173.
  • the nonlinear echo estimation unit 183 acquires the nonlinear echo signal X NN ( ⁇ ) from the nonlinear echo model by inputting, to the nonlinear echo model, the call reception signal X( ⁇ ) output from the fast Fourier transform unit 16 and the pseudo linear echo signal output from the fast Fourier transform unit 24.
  • the nonlinear echo estimation unit 183 outputs the nonlinear echo signal X NN ( ⁇ ) estimated by using the call reception signal X( ⁇ ) and the pseudo linear echo signal to the nonlinear echo suppression unit 19.
  • the nonlinear echo estimation unit 183 in the present fourth embodiment estimates the nonlinear echo signal X NN ( ⁇ ) from the call reception signal X( ⁇ ) and the pseudo linear echo signal from the adaptive filter 141 of the echo canceller 14 by using the nonlinear echo model indicative of a relationship between a call reception signal and a pseudo linear echo signal from the adaptive filter of the echo canceller, and a nonlinear echo signal.
  • a nonlinear echo signal is estimated from a call reception signal and a pseudo linear echo signal from the adaptive filter 141 of the echo canceller 14, an estimation precision of a nonlinear echo signal can be further improved.
  • the nonlinear echo estimation unit 18 in the first embodiment estimates a nonlinear echo signal included in an input signal from a call reception signal by using a nonlinear echo model indicative of a relationship between the call reception signal and the nonlinear echo signal.
  • a nonlinear echo estimation unit in a fifth embodiment estimates a nonlinear echo signal included in an input signal from the input signal by using a nonlinear echo model indicative of a relationship between the input signal and the nonlinear echo signal.
  • FIG. 17 is a diagram showing a configuration of a call device in the fifth embodiment of the present disclosure.
  • the call device shown in FIG. 17 is provided with an echo suppression device ID, the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • the same configuration as those of the first and second embodiments will be given the same reference sign to omit description thereof.
  • the echo suppression device 1D is provided with the echo canceller 14, the fast Fourier transform units 15, 16, 23, a nonlinear echo model storage unit 174, a nonlinear echo estimation unit 184, the nonlinear echo suppression unit 19, the echo suppressor 20, and the inverse fast Fourier transform unit 21.
  • the microphone 13 outputs the input signal x mic (k) to the echo canceller 14 and also to the nonlinear echo estimation unit 184 via the fast Fourier transform unit 23.
  • the fast Fourier transform unit 23 conducts discrete Fourier transform at a high speed.
  • the fast Fourier transform unit 23 converts the input signal x mic (k) in the time domain to be input to the nonlinear echo estimation unit 184 into the input signal X mic ( ⁇ ) in the frequency domain.
  • the fast Fourier transform unit 23 outputs the input signal X mic ( ⁇ ) in the frequency domain to the nonlinear echo estimation unit 184.
  • the nonlinear echo model storage unit 174 stores, in advance, a nonlinear echo model indicative of a relationship between an input signal acquired by the microphone 13 and a nonlinear echo signal.
  • the nonlinear echo model is, for example, a neural network.
  • the nonlinear echo model in the present fifth embodiment uses, as teacher data, an input signal acquired by the microphone, and an output signal of the echo suppressor which suppresses a residual linear echo signal from an output signal of the echo canceller which suppresses a linear echo signal from the input signal, and is learned with the input signal as an input and the nonlinear echo signal as an output.
  • the input signal X mic ( ⁇ ) in the frequency domain is input to the nonlinear echo model learning unit 40 shown in FIG. 6 .
  • the nonlinear echo model learning unit 40 in the present fifth embodiment learns a nonlinear echo model in which there are used, as teacher data, the input signal X mic ( ⁇ ), and the output signal Y ES ( ⁇ ) of the echo suppressor 37 which suppresses a residual linear echo signal from the output signal Y EC ( ⁇ ) of the echo canceller 34 which suppresses a linear echo signal from the input signal x mic (k), with the input signal X mic ( ⁇ ) as an input and the nonlinear echo signal as an output.
  • the nonlinear echo estimation unit 184 estimates the nonlinear echo signal X NN ( ⁇ ) included in the input signal from the input signal X mic ( ⁇ ) by using a nonlinear echo model indicative of a relationship between an input signal and a nonlinear echo signal.
  • the nonlinear echo estimation unit 184 reads the nonlinear echo model from the nonlinear echo model storage unit 174.
  • the nonlinear echo estimation unit 184 acquires the nonlinear echo signal X NN ( ⁇ ) from the nonlinear echo model by inputting, to the nonlinear echo model, the input signal X mic ( ⁇ ) output from the fast Fourier transform unit 23.
  • the nonlinear echo estimation unit 184 outputs the nonlinear echo signal X NN ( ⁇ ) estimated by using the input signal X mic ( ⁇ ) to the nonlinear echo suppression unit 19.
  • Operation of the echo suppression device 1D in the present fifth embodiment differs from the first embodiment only in Step S2 shown in FIG. 5 .
  • the nonlinear echo estimation unit 184 in the present fifth embodiment estimates the nonlinear echo signal X NN ( ⁇ ) from the input signal X mic ( ⁇ ) by using the nonlinear echo model indicative of a relationship between an input signal and a nonlinear echo signal.
  • the fifth embodiment enables estimation of a nonlinear echo signal even from an input signal acquired by the microphone 13.
  • a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 is output to the nonlinear echo suppression unit 19.
  • an estimation error of a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 is corrected using an output signal of the nonlinear echo suppression unit 19.
  • FIG. 18 is a diagram showing a configuration of a call device in the sixth embodiment of the present disclosure.
  • the call device shown in FIG. 18 is provided with an echo suppression device IE, the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • an echo suppression device IE the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • the same configuration as that of the first embodiment will be given the same reference sign to omit description thereof.
  • the echo suppression device 1E is provided with the echo canceller 14, the fast Fourier transform units 15 and 16, the nonlinear echo model storage unit 17, the nonlinear echo estimation unit 18, the nonlinear echo suppression unit 19, the echo suppressor 20, the inverse fast Fourier transform unit 21, and a correction unit 25.
  • the correction unit 25 calculates a variable gain for minimizing an output signal of the nonlinear echo suppression unit 19 and corrects a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 by using the calculated variable gain. At this time, the correction unit 25 calculates a variable gain such that the output signal of the nonlinear echo suppression unit 19 nears 0. Then, the correction unit 25 multiplies the nonlinear echo signal estimated by the nonlinear echo estimation unit 18 by the calculated variable gain. In this manner, the correction unit 25 corrects an estimation error of the nonlinear echo signal estimated by the nonlinear echo estimation unit 18.
  • Step S2 new processing is added between Step S2 and Step S3 shown in FIG. 5 .
  • the correction unit 25 calculates a variable gain for minimizing an output signal of the nonlinear echo suppression unit 19 and corrects a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 by using the calculated variable gain.
  • the present sixth embodiment since an estimation error of a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 is corrected by using an output signal of the nonlinear echo suppression unit 19, an estimation precision of the nonlinear echo signal can be improved to enable improvement in echo suppression performance.
  • the present sixth embodiment is effective, in particular, in a case where a nonlinear echo model has a fixed value.
  • the echo suppression devices 1A to 1D in the second to fifth embodiments may be provided with the correction unit 25 of the present sixth embodiment.
  • a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 is output to the nonlinear echo suppression unit 19.
  • an estimation error of a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 is corrected using an output signal of the echo suppressor 20.
  • FIG. 19 is a diagram showing a configuration of a call device in the seventh embodiment of the present disclosure.
  • the call device shown in FIG. 19 is provided with an echo suppression device IF, the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • an echo suppression device IF the input terminal 11, the speaker 12, the microphone 13, and the output terminal 22.
  • the same configuration as that of the first embodiment will be given the same reference sign to omit description thereof.
  • the echo suppression device IF is provided with the echo canceller 14, the fast Fourier transform units 15 and 16, the nonlinear echo model storage unit 17, the nonlinear echo estimation unit 18, the nonlinear echo suppression unit 19, the echo suppressor 20, the inverse fast Fourier transform unit 21, and a correction unit 251.
  • the correction unit 251 calculates a variable gain for minimizing an output signal of the echo suppressor 20 and corrects a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 by using the calculated variable gain. At this time, the correction unit 25 calculates a variable gain such that the output signal of the echo suppressor 20 nears 0. Then, the correction unit 251 multiplies the nonlinear echo signal estimated by the nonlinear echo estimation unit 18 by the calculated variable gain. In this manner, the correction unit 251 corrects an estimation error of the nonlinear echo signal estimated by the nonlinear echo estimation unit 18.
  • Step S2 As operation of the echo suppression device IF in the present seventh embodiment, new processing is added between Step S2 and Step S3 shown in FIG. 5 . Specifically, in the present seventh embodiment, after the processing of Step S2, the correction unit 251 calculates a variable gain for minimizing an output signal of the echo suppressor 20 and corrects a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 by using the calculated variable gain.
  • the present seventh embodiment since an estimation error of a nonlinear echo signal estimated by the nonlinear echo estimation unit 18 is corrected by using an output signal of the echo suppressor 20, an estimation precision of the nonlinear echo signal can be improved to enable improvement in echo suppression performance.
  • the present seventh embodiment is effective, in particular, in a case where a nonlinear echo model has a fixed value.
  • the echo suppression devices 1A to 1D in the second to fifth embodiments may be provided with the correction unit 251 of the present seventh embodiment.
  • each component may be configured by dedicated hardware or realized by execution of a software program suitable for each component.
  • Each component may have a program execution unit such as a CPU or a processor realized by reading and execution of a software program recorded in a recording medium such as a hard disk or a semiconductor memory.
  • LSIs Large Scale Integration
  • integrated circuits typically integrated circuits. These may be individually formed into one chip, or may be formed into one chip so as to be partly or entirely included.
  • an integrated circuit is not limited to an LSI but may be realized as a dedicated circuit or a general-purpose processor. It is possible to use an FPGA (Field Programmable Gate Array) programmable after manufacturing of an LSI, or a reconfigurable processor in which connection or setting of a circuit cell in an LSI can be reconfigured.
  • FPGA Field Programmable Gate Array
  • a part or all of the functions of the devices according to the embodiments of the present disclosure can be realized by execution of a program by a processor such as a CPU.
  • the technique of the present disclosure enables stable suppression of a nonlinear echo signal included in an input signal acquired by a microphone, the technique is useful for suppressing a linear echo signal and a nonlinear echo signal included in the input signal acquired by the microphone.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Otolaryngology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
  • Telephone Function (AREA)
  • Circuit For Audible Band Transducer (AREA)
EP20203965.7A 2019-11-12 2020-10-26 Echounterdrückungsvorrichtung, echounterdrückungsverfahren und echounterdrückungsprogramm Active EP3829151B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962934119P 2019-11-12 2019-11-12
JP2020087944 2020-05-20

Publications (2)

Publication Number Publication Date
EP3829151A1 true EP3829151A1 (de) 2021-06-02
EP3829151B1 EP3829151B1 (de) 2023-07-26

Family

ID=73020138

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20203965.7A Active EP3829151B1 (de) 2019-11-12 2020-10-26 Echounterdrückungsvorrichtung, echounterdrückungsverfahren und echounterdrückungsprogramm

Country Status (4)

Country Link
US (1) US11197093B2 (de)
EP (1) EP3829151B1 (de)
JP (1) JP2021184587A (de)
CN (1) CN112863532A (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112420073B (zh) * 2020-10-12 2024-04-16 北京百度网讯科技有限公司 语音信号处理方法、装置、电子设备和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030031315A1 (en) * 2001-07-20 2003-02-13 Belt Harm Jan Willem Echo canceller having nonlinear echo suppressor for harmonics calculations
JP2010103875A (ja) 2008-10-27 2010-05-06 Nippon Telegr & Teleph Corp <Ntt> エコー抑圧装置、エコー抑圧方法、エコー抑圧プログラム、記録媒体
JP2017191992A (ja) 2016-04-12 2017-10-19 日本電信電話株式会社 エコー抑圧装置、その方法、プログラム、及び記録媒体
US20190222691A1 (en) * 2018-01-18 2019-07-18 Knowles Electronics, Llc Data driven echo cancellation and suppression
JP2020087944A (ja) 2018-11-14 2020-06-04 日亜化学工業株式会社 発光素子、発光装置及び発光素子の製造方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140079232A1 (en) * 2011-05-19 2014-03-20 Nec Corporation Audio processing device, audio processing method, and recording medium recording audio processing program
US10477031B2 (en) * 2015-12-08 2019-11-12 Nuance Communications, Inc. System and method for suppression of non-linear acoustic echoes

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030031315A1 (en) * 2001-07-20 2003-02-13 Belt Harm Jan Willem Echo canceller having nonlinear echo suppressor for harmonics calculations
JP2010103875A (ja) 2008-10-27 2010-05-06 Nippon Telegr & Teleph Corp <Ntt> エコー抑圧装置、エコー抑圧方法、エコー抑圧プログラム、記録媒体
JP2017191992A (ja) 2016-04-12 2017-10-19 日本電信電話株式会社 エコー抑圧装置、その方法、プログラム、及び記録媒体
US20190222691A1 (en) * 2018-01-18 2019-07-18 Knowles Electronics, Llc Data driven echo cancellation and suppression
JP2020087944A (ja) 2018-11-14 2020-06-04 日亜化学工業株式会社 発光素子、発光装置及び発光素子の製造方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SCHALK-SCHUPP INGO ET AL: "Approximation of a nonlinear distortion function for combined linear and nonlinear residual echo suppression", 2016 IEEE INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC), IEEE, 13 September 2016 (2016-09-13), pages 1 - 5, XP032983160, DOI: 10.1109/IWAENC.2016.7602960 *

Also Published As

Publication number Publication date
EP3829151B1 (de) 2023-07-26
US20210144472A1 (en) 2021-05-13
JP2021184587A (ja) 2021-12-02
US11197093B2 (en) 2021-12-07
CN112863532A (zh) 2021-05-28

Similar Documents

Publication Publication Date Title
US11315587B2 (en) Signal processor for signal enhancement and associated methods
EP1942582B1 (de) Echounterdrückungsverfahren und einrichtung
CN111341336B (zh) 一种回声消除方法、装置、终端设备及介质
JP4161628B2 (ja) エコー抑圧方法及び装置
US9768829B2 (en) Methods for processing audio signals and circuit arrangements therefor
Milani et al. On maximum achievable noise reduction in ANC systems
US20100208908A1 (en) Echo supressing method and apparatus
CN110211602B (zh) 智能语音增强通信方法及装置
KR20160076059A (ko) 디스플레이장치 및 그 반향 제거방법
EP3829151B1 (de) Echounterdrückungsvorrichtung, echounterdrückungsverfahren und echounterdrückungsprogramm
Ding Fast affine projection adaptation algorithms with stable and robust symmetric linear system slovers
CN111312268B (zh) 声学回声消除装置和声学回声消除方法以及记录介质
Wang et al. A frequency-domain nonlinear echo processing algorithm for high quality hands-free voice communication devices
WO2022195955A1 (ja) エコー抑圧装置、エコー抑圧方法及びエコー抑圧プログラム
JP4663630B2 (ja) マルチチャンネルシステム同定装置
KR20050047374A (ko) 통신 기기용 하이브리드 소음 제거 시스템 및 방법
JP2002261659A (ja) 多チャネルエコーキャンセル方法、その装置、そのプログラム及び記録媒体
EP4064726A1 (de) Tonabnehmervorrichtung, tonabnehmerverfahren und tonabnehmerprogramm
JPWO2022195955A5 (de)
JP5925149B2 (ja) 音響結合量推定装置、エコー消去装置、その方法及びプログラム
JP4631933B2 (ja) エコー抑圧方法
Tchassi Acoustic echo cancellation for single-and dual-microphone devices: application to mobile devices
JP2019220917A (ja) エコー消去装置、エコー消去方法、プログラム
Rezaii et al. Robust multi-channel crosstalk resistant noise cancellation based on SAD structure and LMMN Algorithm
Takeichi et al. Echo canceler algorithm for adaptive Volterra filters in double talk states

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211115

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230301

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602020014375

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230726

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1593313

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231027

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231126

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231127

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231026

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231126

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231027

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231020

Year of fee payment: 4

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602020014375

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230726

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231026

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20231026

26N No opposition filed

Effective date: 20240429