WO2021017134A1 - 回声消除方法及装置、电子设备、可读存储介质 - Google Patents
回声消除方法及装置、电子设备、可读存储介质 Download PDFInfo
- Publication number
- WO2021017134A1 WO2021017134A1 PCT/CN2019/108247 CN2019108247W WO2021017134A1 WO 2021017134 A1 WO2021017134 A1 WO 2021017134A1 CN 2019108247 W CN2019108247 W CN 2019108247W WO 2021017134 A1 WO2021017134 A1 WO 2021017134A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- audio signal
- signal
- amplitude value
- harmonic distortion
- value
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000005236 sound signal Effects 0.000 claims abstract description 189
- 238000012546 transfer Methods 0.000 claims abstract description 53
- 238000012545 processing Methods 0.000 claims abstract description 15
- 230000006870 function Effects 0.000 claims description 58
- 238000012360 testing method Methods 0.000 claims description 49
- 238000005316 response function Methods 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 8
- 230000008030 elimination Effects 0.000 claims description 3
- 238000003379 elimination reaction Methods 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 description 40
- 238000004364 calculation method Methods 0.000 description 16
- 238000010586 diagram Methods 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000002592 echocardiography Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0264—Noise filtering characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
Definitions
- This application relates to the technical field of audio signal processing, and more specifically, to an echo cancellation method, an echo cancellation device, an electronic device, and a computer-readable storage medium.
- an echo cancellation module is generally added.
- One purpose of this application is to provide a new technical solution for echo cancellation.
- an echo cancellation method including:
- the echo signal is eliminated from the second audio signal.
- the amplitude value of the transfer function is obtained in the following manner:
- the amplitude value of the transfer function is determined according to the intensity value of the test audio signal and the intensity value of the test echo signal.
- the using the third audio signal and the amplitude value of the transfer function to determine the echo signal generated by the first audio signal in the second audio signal includes:
- the third audio signal is processed by a filter to obtain the processed third audio signal, which is used as the first audio signal from the second audio signal.
- Echo signal generated by audio signal is used as the first audio signal from the second audio signal.
- the method further includes:
- the amplitude value of the distortion response function and the amplitude value of the transfer function to determine a harmonic distortion signal
- the amplitude value of the distortion response function is obtained in the following manner:
- the harmonic distortion signal includes at least a second harmonic distortion signal and a third harmonic distortion signal.
- the determining the harmonic distortion signal by using the low-frequency distortion signal, the amplitude value of the distortion response function, and the amplitude value of the transfer function includes:
- a filter is used to process the signal corresponding to the frequency band information of the harmonic distortion signal to obtain the signal corresponding to the processed harmonic distortion signal frequency band information;
- the harmonic distortion signal is determined from the signal corresponding to the frequency band information of the processed harmonic distortion signal.
- an echo cancellation device including:
- An audio signal acquisition module for acquiring a first audio signal received by at least one speaker and a second audio signal received by a microphone
- a delay compensation module configured to perform delay compensation processing on the first audio signal to obtain a third audio signal
- a transfer function amplitude value acquisition module configured to acquire the amplitude value of the transfer function corresponding to the audio signal transmitted from the speaker to the microphone;
- An echo signal determining module configured to use the third audio signal and the amplitude value of the transfer function to determine the echo signal generated by the first audio signal in the second audio signal;
- the elimination module is used to eliminate the echo signal from the second audio signal.
- an electronic device including: a memory and a processor, the memory is used to store instructions, the instructions are used to control the processor to operate to perform any of the The method described in one item.
- a computer-readable storage medium having a computer program stored thereon, and the computer program, when executed by a processor, implements the method according to any one of the first aspects.
- the echo cancellation method provided by the embodiment of the present application can effectively and accurately eliminate the echo and improve the user experience.
- Figure 1 is a schematic diagram of echo generation.
- Fig. 2 is a block diagram of the hardware configuration of an electronic device that can be used to implement the echo cancellation method of any embodiment of the present application.
- Fig. 3 is a processing flowchart of an echo cancellation method according to an embodiment of the present application.
- Fig. 4 is a schematic block diagram of an echo cancellation device according to an embodiment of the present application.
- Fig. 5 is a schematic flowchart of an echo cancellation method according to an example of the present application.
- Fig. 6 is a functional block diagram of an electronic device according to an embodiment of the present application.
- the echo involved in the embodiment of the present application is an acoustic echo.
- the process of acoustic echo generation can be obtained.
- the user A in Figure 1 speaks, and the speech signal (speech1) is transmitted to the room where user B is located. Due to the reflection of the space, the echo speech1 (Echo) is input from the microphone again, and the voice signal of user B (speech2) is superimposed. At this time, user A will hear user B's voice (speech2) superimposed with his own voice (speech1 (Echo)), which affects the normal call quality. At this time, applying the echo cancellation module in the room where user B is located can cancel the echo of user A, so that user A can only hear the voice of user B.
- Fig. 2 is a block diagram of the hardware configuration of an electronic device that can be used to implement the echo cancellation method of any embodiment of the present application.
- the electronic device 2000 may be an electronic device such as a mobile phone, a portable computer, a tablet computer, and a palmtop computer.
- the electronic device 2000 may include a processor 2100, a memory 2200, an interface device 2300, a communication device 2400, a display device 2500, an input device 2600, a speaker 2700, a microphone 2800, and so on.
- the processor 2100 may be a central processing unit CPU, a microprocessor MCU, or the like.
- the memory 2200 includes, for example, ROM (Read Only Memory), RAM (Random Access Memory), nonvolatile memory such as a hard disk, and the like.
- the interface device 2300 includes, for example, a USB interface, a headphone interface, and the like.
- the communication device 2400 can perform wired or wireless communication, for example.
- the display device 2500 is, for example, a liquid crystal display, a touch display, or the like.
- the input device 2600 may include, for example, a touch screen, a keyboard, and the like. The user can input/output voice information through the speaker 2700 and the microphone 2800.
- the present application may only involve some of the devices.
- the electronic device 2000 only involves the memory 2200 and the processor 2100.
- the memory 2200 of the electronic device 2000 is used to store instructions, and the instructions are used to control the processor 2100 to execute the echo cancellation method provided in the embodiments of the present application.
- Fig. 3 is a processing flowchart of an echo cancellation method according to an embodiment of the present application.
- the echo cancellation method is implemented by electronic equipment.
- the echo cancellation method may include the following steps S3100-S3500.
- Step S3100 Obtain a first audio signal received by at least one speaker and a second audio signal received by a microphone.
- the first audio signal is an audio signal received by the speaker before a digital-to-analog converter (DAC).
- DAC digital-to-analog converter
- the second audio signal is an audio signal received by a microphone and after an analog-to-digital converter (ADC).
- ADC analog-to-digital converter
- the second audio signal includes at least an echo signal generated by the first audio signal.
- the first audio signal is broadcast through the speaker, it is transmitted to the microphone.
- the microphone also receives the sound signal sent by the user.
- the second audio signal includes the echo signal generated by the first audio signal and the sound emitted by the user. signal.
- Step S3200 Perform delay compensation processing on the first audio signal to obtain a third audio signal.
- the first audio signal received by the speaker and the echo signal received by the microphone have a certain delay, before the echo signal is eliminated from the second audio signal, the first audio signal is subjected to delay compensation processing to align the second audio signal The echo signal in the signal.
- Step S3300 Obtain the amplitude value of the transfer function corresponding to the audio signal from the speaker to the microphone.
- the first audio signal received by the speaker and the echo signal received by the microphone will have a certain delay and there is a difference, but the two are highly correlated, that is, the echo signal received by the microphone is caused by the first audio signal received by the speaker.
- the echo signal received by the microphone can be expressed as a function of the first audio signal received by the speaker, and this function is the transfer function.
- the amplitude value of the transfer function can be obtained in the following ways: Obtain the test audio signal received by the speaker and the test echo signal generated by the test audio signal received by the microphone; determine according to the strength value of the test audio signal and the strength value of the test echo signal The magnitude of the transfer function.
- the number of test audio signals is multiple. Each test audio signal corresponds to a frequency value.
- the frequency value covers 20Hz-20KHz.
- the measured amplitude value of the transfer function is the amplitude value of the transfer function corresponding to each frequency point.
- the amplitude value F(X) of the transfer function corresponding to each frequency point is calculated,
- X is different frequency points
- a is the intensity value of the test audio signal corresponding to a certain frequency point
- A is the intensity value of the test echo signal corresponding to the frequency point.
- Step S3400 using the third audio signal and the amplitude value of the transfer function to determine the echo signal generated by the first audio signal in the second audio signal.
- Step S3400 may further include the following steps S3410-S3420.
- Step S3410 Determine the gain value or attenuation value of the third audio signal according to the amplitude value of the transfer function.
- the gain value or attenuation value Y of the third audio signal is calculated
- Y is the gain value or attenuation value corresponding to a certain frequency point in the third audio signal.
- Step S3420 Based on the gain value or attenuation value of the third audio signal, the third audio signal is processed by the filter to obtain the processed third audio signal as the first audio signal generated by the second audio signal Echo signal.
- the third audio signal includes audio signals corresponding to multiple frequency points.
- the audio signal corresponding to each frequency point in the third audio signal is processed by the filter. For example, if the attenuation value of the audio signal corresponding to 1000 Hz in the third audio signal is -5DB, then the filter performs -5DB attenuation processing on the audio signal corresponding to 1000 Hz in the third audio signal.
- Step S3500 Eliminate the echo signal from the second audio signal.
- the echo cancellation method provided by the embodiment of the present application can effectively and accurately eliminate the echo and improve the user experience.
- the echo cancellation method further includes the following steps S3600-S3900.
- Step S3600 Obtain frequency band information of the harmonic distortion signal in the third audio signal.
- Harmonic distortion signal refers to the extra harmonic components of the output signal than the input signal when the audio signal passes through the power amplifier.
- the frequency band information of the harmonic distortion signal can be set according to the test situation.
- Step S3700 Obtain the amplitude value of the distortion response function corresponding to the audio signal transmitted from the speaker to the microphone.
- the amplitude value of the distortion response function is obtained by: obtaining the test audio signal received by the speaker and the test harmonic distortion signal corresponding to the test audio signal received by the microphone; according to the strength value of the test audio signal and the strength of the test harmonic distortion signal Value to determine the magnitude of the distortion response function.
- the number of test audio signals is multiple. Each test audio signal corresponds to a frequency value. This frequency value covers the frequency band of harmonic distortion signals.
- the measured amplitude value of the distortion response function is the amplitude value of the distortion response function corresponding to each frequency point.
- the amplitude value Dis(X) of the distortion response function corresponding to each frequency point is calculated,
- X is different frequency points
- a is the intensity value of the test audio signal corresponding to a certain frequency point
- A is the intensity value of the test echo signal corresponding to a certain frequency point
- N is the harmonic distortion signal corresponding to the frequency point.
- the harmonic distortion signal includes at least a second harmonic distortion signal and a third harmonic distortion signal.
- the second harmonic distortion signal refers to the harmful interference signal that is twice the original frequency.
- the third harmonic distortion signal refers to a harmful interference signal that is three times the original frequency.
- N 2 is the intensity value of the second harmonic distortion signal corresponding to the frequency point
- N 3 is the intensity value of the third harmonic distortion signal corresponding to the frequency point.
- the intensity value of the tested harmonic distortion signal can be measured by a harmonic measuring device (for example, a harmonic analyzer).
- Step S3800 using the frequency band information of the harmonic distortion signal, the amplitude value of the distortion response function, and the amplitude value of the transfer function to determine the harmonic distortion signal.
- Step S3800 further includes the following steps S3810-S3830.
- Step S3810 Determine the gain value or attenuation value of the frequency band information of the harmonic distortion signal according to the amplitude value of the transfer function.
- the gain value or attenuation value corresponding to each frequency point in the harmonic distortion signal frequency band is determined.
- Step S3820 Based on the gain value or attenuation value of the frequency band information of the harmonic distortion signal, a filter is used to process the signal corresponding to the frequency band information of the harmonic distortion signal to obtain the signal corresponding to the frequency band information of the processed harmonic distortion signal.
- Step S3830 Determine a harmonic distortion signal from the signal corresponding to the frequency band information of the processed harmonic distortion signal according to the amplitude value of the distortion response function.
- the harmonic distortion signal THD is calculated
- THD Y*Dis(X)—Calculation formula (4).
- the calculation formula (4) becomes the calculation formula (4a)
- THD Y*[Dis 2 (X)+Dis 3 (X)]—Calculation formula (4a).
- step S3900 while eliminating the echo signal from the second audio signal, the harmonic distortion signal is eliminated.
- Fig. 4 is a schematic block diagram of an echo cancellation device according to an embodiment of the present application.
- the echo cancellation device 4000 of this embodiment may include an audio signal acquisition module 4100, a delay compensation module 4200, a transfer function amplitude value acquisition module 4300, an echo signal determination module 4400, and a cancellation module 4500.
- the audio signal acquisition module 4100 is configured to acquire a first audio signal received by at least one speaker and a second audio signal received by a microphone.
- the delay compensation module 4200 is configured to perform delay compensation processing on the first audio signal to obtain a third audio signal.
- the transfer function amplitude value acquisition module 4300 is used to acquire the amplitude value of the transfer function corresponding to the audio signal transmitted from the speaker to the microphone.
- the amplitude value of the transfer function can be obtained in the following ways: Obtain the test audio signal received by the speaker and the test echo signal generated by the test audio signal received by the microphone; determine according to the strength value of the test audio signal and the strength value of the test echo signal The magnitude of the transfer function.
- the echo signal determining module 4400 is configured to use the third audio signal and the amplitude value of the transfer function to determine the echo signal generated by the first audio signal in the second audio signal.
- the cancellation module 4500 is used to cancel the echo signal from the second audio signal.
- the echo signal determining module 4400 is further configured to determine the gain value or attenuation value of the third audio signal according to the amplitude value of the transfer function; based on the gain value or attenuation value of the third audio signal, use a filter to The audio signal is processed to obtain the processed third audio signal, which is used as the echo signal generated by the second audio signal in the first audio signal. Specifically, refer to the above calculation formula (2).
- the echo cancellation device 4000 may further include a harmonic distortion signal frequency band information acquisition module, a distortion response function amplitude value acquisition module, and a harmonic distortion signal determination module.
- the frequency band information acquisition module of the harmonic distortion signal is used to obtain the frequency band information of the harmonic distortion signal in the third audio signal.
- the distortion response function amplitude value obtaining module is used to obtain the amplitude value of the distortion response function corresponding to the audio signal transmitted from the speaker to the microphone.
- the amplitude value of the distortion response function is obtained by: obtaining the test audio signal received by the speaker and the test harmonic distortion signal corresponding to the test audio signal received by the microphone; according to the strength value of the test audio signal and the strength of the test harmonic distortion signal Value to determine the magnitude of the distortion response function. Specifically, refer to the above calculation formula (3).
- the harmonic distortion signal determination module is used to determine the harmonic distortion signal by using the frequency band information of the harmonic distortion signal, the amplitude value of the distortion response function and the amplitude value of the transfer function.
- the elimination module is also used to eliminate the harmonic distortion signal while eliminating the echo signal from the second audio signal.
- the harmonic distortion signal determination module is further configured to determine the gain value or attenuation value of the frequency band information of the harmonic distortion signal according to the amplitude value of the transfer function;
- the filter processes the signal corresponding to the frequency band information of the harmonic distortion signal to obtain the signal corresponding to the frequency band information of the processed harmonic distortion signal; according to the amplitude value of the distortion response function, from the signal corresponding to the frequency band information of the processed harmonic distortion signal Determine the harmonic distortion signal in.
- the harmonic distortion signal determination module is further configured to determine the gain value or attenuation value of the frequency band information of the harmonic distortion signal according to the amplitude value of the transfer function;
- the filter processes the signal corresponding to the frequency band information of the harmonic distortion signal to obtain the signal corresponding to the frequency band information of the processed harmonic distortion signal; according to the amplitude value of the distortion response function, from the signal corresponding to the frequency band information of the processed harmonic distortion signal Determine the harmonic distortion signal in.
- the above calculation formula (4) refer to the above calculation formula (4).
- this example shows two electronic devices, the first electronic device and the second electronic device.
- User A using the first electronic device and user B using the second electronic device can have a conversation.
- the voice signal of user A is transmitted to the left speaker and right speaker of the second electronic device through the microphone of the first electronic device.
- the left speaker and the right speaker respectively form two echoes after playing the voice signal of user A.
- the two echoes are re-input from the microphone of the second electronic device and superimposed on the voice signal of user B.
- user A can hear user B's voice signal and two echo signals through the speaker of the first electronic device.
- the echo cancellation method provided in this example is used to eliminate the above two echo signals.
- the echo cancellation method at least includes the following steps S501-S511.
- the echo cancellation method is implemented by the second electronic device.
- the components included in the following steps are all components in the second electronic device.
- Step S501 Acquire the voice signal S l of user A received by the left speaker, the voice signal S r of user A received by the right speaker, and the audio signal S received by the microphone.
- the voice signal S l of user A received by the left speaker and the voice signal S r of user A received by the right speaker are audio signals before conversion by the ADC converter.
- the audio signal S received by the microphone is the audio signal received by the microphone and converted by the DAC converter.
- the audio signal includes two echo signals and the B user's voice signal.
- Step S502 delay compensation module using the first and second delay compensation module, A user A's voice signal to a left speaker, respectively, the user receives a voice signal S l and the right speaker received delay compensation processing S r, respectively, Obtain the processed signal S l 'and signal S r '.
- Step S503 Obtain the amplitude value of the first transfer function corresponding to the audio signal transferred from the left speaker to the microphone, and the amplitude value of the second transfer function corresponding to the audio signal transferred from the right speaker to the microphone.
- Step S504 Determine the gain value or attenuation value of the signal S l ′ according to the amplitude value of the first transfer function, and determine the gain value or attenuation value of the signal S r ′ according to the amplitude value of the second transfer function.
- Step S505 based on the signal S l 'attenuation value or a gain value by a first filter signal S l', to give the first return echo signal S l, and a signal S r 'or a gain value based on the attenuation value .
- the second filter is used to process the signal S r 'to obtain the second echo signal S 2 times .
- Step S506 the audio signal S received from the microphone cancels the first echo signal S 1 time to obtain the audio signal S 1 , and then cancels the second echo signal S 2 times from the audio signal S 1 to obtain the audio signal S 2 .
- Step S507 Obtain frequency band information of the harmonic distortion signal.
- Step S508 based on the frequency band information of the harmonic distortion signal, the first low-pass filter is used to intercept the low-frequency signal S l low from the speech signal S l ', and the second low-pass filter is used to intercept the low-frequency signal from the speech signal S r ' S r is low .
- Step S509 Obtain the amplitude value of the first distortion response function corresponding to the audio signal transferred from the left speaker to the microphone, and the amplitude value of the second distortion response function corresponding to the audio signal transferred from the speaker to the microphone.
- Step S510 the value based on the first amplitude distortion amplitude value in response to the first transfer function and a function of using the first harmonic generation module, determining a first low harmonic distortion harmonic signal from the low frequency signal S l S l, and, based on The amplitude value of the second distortion response function and the amplitude value of the second transfer function are used to determine the harmonic of the second harmonic distortion signal S r from the low frequency signal S r low by using the second harmonic generation module.
- Step S511 the audio signal S 2 from the first to eliminate the harmonic distortion harmonic signal S l, to obtain an audio signal S 3, and then to eliminate the second harmonic distortion harmonic signal S r from the audio signal to obtain an audio signal S 4.
- the audio signal S 4 is transmitted to the first electronic device.
- the electronic device 2000 may include the echo cancellation device 4000 according to any embodiment of the present application, for implementing the echo cancellation method of any embodiment of the present application.
- the electronic device 2000 may include a processor 2100 and a memory 2200.
- the memory 2200 is configured to store executable instructions
- the processor 2100 is configured to operate the electronic device 2000 according to the control of the instructions to execute the echo cancellation method according to any embodiment of the present application.
- a computer-readable storage medium on which a computer program is stored, and the computer program, when executed by a processor, implements the echo cancellation method as in any embodiment of the present application.
- the computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present application.
- the steps of the method or algorithm described in combination with the embodiments disclosed herein can be directly implemented by hardware, a software module executed by a processor, or a combination of the two.
- the software module can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or all areas in the technical field. Any other known storage media.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Circuit For Audible Band Transducer (AREA)
- Telephone Function (AREA)
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
Abstract
一种回声消除方法及装置、电子设备、可读存储介质，方法包括：获取至少一个扬声器接收的第一音频信号以及麦克风接收的第二音频信号(S3100)；对第一音频信号进行延时补偿处理，得到第三音频信号(S3200)；获取音频信号从扬声器传递至麦克风对应的传递函数的幅度值(S3300)；利用第三音频信号和传递函数的幅度值，确定第二音频信号中、由第一音频信号产生的回声信号(S3400)；从第二音频信号中消除回声信号(S3500)。
Description
本申请要求于2019年7月26日提交中国专利局、申请号为201910683643.3、申请名称为“回声消除方法及装置、电子设备、可读存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
本申请涉及音频信号处理技术领域，更具体地，涉及一种回声消除方法、一种回声消除装置、一种电子设备以及一种计算机可读存储介质。
在语音系统中，为了避免远端信号回声对近端语音质量的影响，一般会添加回声消除模块。
传统回声消除算法，在处理多声道喇叭播放时，由于各个声道信号具有强相关性，自适应滤波器在处理麦克风接收到的信号时，容易导致自适应滤波器的解不唯一，从而不能有效地消除回声。
发明内容
本申请的一个目的是提供一种用于消除回声的新技术方案。
根据本申请的第一方面，提供了一种回声消除方法，包括：
获取至少一个扬声器接收的第一音频信号以及麦克风接收的第二音频信号；
对所述第一音频信号进行延时补偿处理，得到第三音频信号；
获取音频信号从所述扬声器传递至所述麦克风对应的传递函数的幅度值；
利用所述第三音频信号和所述传递函数的幅度值，确定所述第二音频信号中、由所述第一音频信号产生的回声信号；
从所述第二音频信号中消除所述回声信号。
可选地，所述传递函数的幅度值通过以下方式获得：
获取所述扬声器接收的测试音频信号和所述麦克风接收的、由所述测试音频信号产生的测试回声信号；
根据所述测试音频信号的强度值和所述测试回声信号的强度值，确定所述传递函数的幅度值。
可选地，所述利用所述第三音频信号和所述传递函数的幅度值，确定所述第二音频信号中、由所述第一音频信号产生的回声信号包括：
根据所述传递函数的幅度值确定所述第三音频信号的增益值或者衰减值；
基于所述第三音频信号的增益值或者衰减值，利用滤波器对所述第三音频信号进行处理，得到处理后的第三音频信号，以作为所述第一音频信号中、由所述第二音频信号产生的回声信号。
可选地，所述方法还包括：
获得所述第三音频信号中的谐波失真信号频段信息；
获取所述音频信号从所述扬声器传递至所述麦克风对应的失真响应函数的幅度值；
利用所述谐波失真信号频段信息、所述失真响应函数的幅度值和所述传递函数的幅度值，确定谐波失真信号；
在从所述第二音频信号中消除所述回声信号的同时，消除所述谐波失真信号。
可选地，所述失真响应函数的幅度值通过以下方式获得：
获取所述扬声器接收的测试音频信号和所述麦克风接收的、由所述测试音频信号对应的测试谐波失真信号；
根据所述测试音频信号的强度值和所述测试谐波失真信号的强度值，确定所述失真响应函数的幅度值。
可选地，所述谐波失真信号至少包括二次谐波失真信号和三次谐波失真信号。
可选地，所述利用所述低频失真信号、所述失真响应函数的幅度值和所述传递函数的幅度值，确定谐波失真信号包括：
根据所述传递函数的幅度值确定所述谐波失真信号频段信息的增益 值或者衰减值；
基于所述谐波失真信号频段信息的增益值或者衰减值，利用滤波器对所述谐波失真信号频段信息对应的信号进行处理，得到处理后的谐波失真信号频段信息对应的信号；
根据所述失真响应函数的幅度值，从所述处理后的谐波失真信号频段信息对应的信号中确定所述谐波失真信号。
根据本申请的第二方面，提供了一种回声消除装置，包括：
音频信号获取模块，用于获取至少一个扬声器接收的第一音频信号以及麦克风接收的第二音频信号；
延时补偿模块，用于对所述第一音频信号进行延时补偿处理，得到第三音频信号；
传递函数幅度值获取模块，用于获取音频信号从所述扬声器传递至所述麦克风对应的传递函数的幅度值；
回声信号确定模块，用于利用所述第三音频信号和所述传递函数的幅度值，确定所述第二音频信号中、由所述第一音频信号产生的回声信号；
消除模块，用于从所述第二音频信号中消除所述回声信号。
根据本申请的第三方面，提供了一种电子设备，包括：存储器和处理器，所述存储器用于存储指令，所述指令用于控制所述处理器进行操作以执行根据第一方面中任一项所述的方法。
根据本申请的第四方面，提供了一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序在被处理器执行时实现根据第一方面中任意一项所述的方法。
本申请实施例提供的回声消除方法，能够有效、准确地消除回声，提升了用户体验。
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一部分附图，对于本领域普通技术人员来讲， 在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。
图1是回声产生的示意图。
图2是可用于实现本申请任意实施例的回声消除方法的电子设备的硬件配置的框图。
图3是根据本申请一个实施例的回声消除方法的处理流程图。
图4为根据本申请实施例的回声消除装置的原理框图。
图5是根据本申请一个例子的回声消除方法的流程示意图。
图6是根据本申请实施例的电子设备的一种原理框图。
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
本申请实施例涉及的回声为声学回声。根据图1所示，可以得到声学回声产生的过程。
图1中的A用户说话，语音信号(speech1)传到B用户所在的房间，由于空间的反射，形成回音speech1(Echo)重新从麦克风输入，同时叠加了B用户的语音信号(speech2)。此时，A用户将会听到B用户的声音(speech2)叠加了自己的声音(speech1(Echo))，影响了正常的通话质量。此时在B用户所在房间应用回音抵消模块，可以抵消掉A用户的回声，让A用户只听到B用户的声音。
<硬件配置>
图2是可用于实现本申请任意实施例的回声消除方法的电子设备的硬件配置的框图。
电子设备2000可以是手机、便携式电脑、平板电脑、掌上电脑等等电子设备。
电子设备2000可以包括处理器2100、存储器2200、接口装置2300、通信装置2400、显示装置2500、输入装置2600、扬声器2700、麦克风2800， 等等。其中，处理器2100可以是中央处理器CPU、微处理器MCU等。存储器2200例如包括ROM(只读存储器)、RAM(随机存取存储器)、诸如硬盘的非易失性存储器等。接口装置2300例如包括USB接口、耳机接口等。通信装置2400例如能够进行有线或无线通信。显示装置2500例如是液晶显示屏、触摸显示屏等。输入装置2600例如可以包括触摸屏、键盘等。用户可以通过扬声器2700和麦克风2800输入/输出语音信息。
尽管在图2中对电子设备2000均示出了多个装置，但是，本申请可以仅涉及其中的部分装置，例如，电子设备2000只涉及存储器2200和处理器2100。
应用于本申请的实施例中，电子设备2000的所述存储器2200用于存储指令，所述指令用于控制所述处理器2100执行本申请实施例提供的回声消除方法。
在上述描述中，技术人员可以根据本申请所公开方案设计指令。指令如何控制处理器进行操作，这是本领域公知，故在此不再详细描述。
<方法实施例>
图3是根据本申请一个实施例的回声消除方法的处理流程图。该回声消除方法是由电子设备实施的。
根据图3所示，该回声消除方法可以包括以下步骤S3100-S3500。
步骤S3100，获取至少一个扬声器接收的第一音频信号以及麦克风接收的第二音频信号。
第一音频信号为扬声器接收的、数模转换(Digital to analog converter，DAC)之前的音频信号。
第二音频信号为麦克风接收的、模数转换(Analog to digital converter，ADC)之后的音频信号。
第二音频信号至少包括由第一音频信号产生的回声信号。例如，第一音频信号经扬声器播出后，传递至麦克风中，同时，麦克风还接收到用户发出的声音信号，这样，第二音频信号包括由第一音频信号产生的回声信号和用户发出的声音信号。
步骤S3200，对第一音频信号进行延时补偿处理，得到第三音频信号。
由于扬声器接收的第一音频信号与麦克风接收的回声信号会有一定延时，因此，在从第二音频信号中消除回声信号之前，对第一音频信号进行延时补偿处理，以对齐第二音频信号中的回声信号。
步骤S3300，获取音频信号从扬声器传递至麦克风对应的传递函数的幅度值。
扬声器接收的第一音频信号与麦克风接收的回声信号会有一定延时，存在差异，但是两者是高度相关的，即麦克风接收的回声信号是由扬声器接收的第一音频信号引起的，这样，可以把麦克风接收的回声信号表示为扬声器接收的第一音频信号的函数，这个函数为传递函数。
该传递函数的幅度值可以通过以下方式获得：获取扬声器接收的测试音频信号和麦克风接收的、由测试音频信号产生的测试回声信号；根据测试音频信号的强度值和测试回声信号的强度值，确定传递函数的幅度值。
测试音频信号的数量为多个。每一个测试音频信号对应一个频率值。该频率值涵盖20Hz-20KHz。这样，测得的传递函数的幅度值为各个频点对应的传递函数的幅度值。具体地，基于以下计算式(1)，计算得到各个频点对应的传递函数的幅度值F(X)，
F(X)＝A/a—计算式(1)，
其中，X为不同频点，a为某一频点对应的测试音频信号的强度值，A为该频点对应的测试回声信号的强度值。
步骤S3400，利用第三音频信号和传递函数的幅度值，确定第二音频信号中、由第一音频信号产生的回声信号。
步骤S3400可以进一步包括以下步骤S3410-S3420。
步骤S3410，根据传递函数的幅度值确定第三音频信号的增益值或者衰减值。
基于以下计算式(2)，计算得到第三音频信号的增益值或者衰减值Y，
Y＝20log
10F(X)—计算式(2)，
其中，Y为第三音频信号中某一频点对应的增益值或者衰减值。
步骤S3420，基于第三音频信号的增益值或者衰减值，利用滤波器对第三音频信号进行处理，得到处理后的第三音频信号，以作为第一音频信号中、由第二音频信号产生的回声信号。
第三音频信号包括多个频点对应的音频信号。利用滤波器对第三音频信号中各个频点对应的音频信号进行处理。例如，第三音频信号中1000Hz对应的音频信号的衰减值为-5DB，那么，滤波器对该第三音频信号中1000Hz对应的音频信号进行-5DB的衰减处理。
步骤S3500，从第二音频信号中消除回声信号。
本申请实施例提供的回声消除方法，能够有效、准确地消除回声，提升了用户体验。
扬声器播放第一音频信号时容易存在失真，特别是低频部分。该部分失真信号难以通过上述步骤S3100-S3500进行消除。为了解决这一技术问题，在本申请的一个实施例中，回声消除方法还包括以下步骤S3600-S3900。
步骤S3600，获得第三音频信号中的谐波失真信号频段信息。
谐波失真信号指音频信号通过功率放大器时，输出信号比输入信号多出的额外谐波成份。
谐波失真信号频段信息可以根据测试情况进行设定。
步骤S3700，获取音频信号从扬声器传递至麦克风对应的失真响应函数的幅度值。
失真响应函数的幅度值通过以下方式获得：获取扬声器接收的测试音频信号和麦克风接收的、由测试音频信号对应的测试谐波失真信号；根据测试音频信号的强度值和测试谐波失真信号的强度值，确定失真响应函数的幅度值。
测试音频信号的数量为多个。每一个测试音频信号对应一个频率值。该频率值涵盖谐波失真信号频段。这样，测得的失真响应函数的幅度值为各个频点对应的失真响应函数的幅度值。具体地，基于以下计算式(3)，计算得到各个频点对应的失真响应函数的幅度值Dis(X)，
Dis(X)＝N/A—计算式(3)，
其中，X为不同频点，a为某一频点对应的测试音频信号的强度值，A为某一频点对应的测试回声信号的强度值，N为该频点对应的谐波失真信号的强度值。
在一个实施例中，谐波失真信号至少包括二次谐波失真信号和三次谐波失真信号。
二次谐波失真信号是指原有频率的二倍频的有害干扰信号。三次谐波失真信号是指原有频率的三倍频的有害干扰信号。
基于计算式(3)，可以得到二次失真响应函数的幅度值Dis
2(X)和三次失真响应函数的幅度值Dis
3(X)，
Dis
2(X)＝N
2/A，
Dis
3(X)＝N
3/A，
其中，N
2为该频点对应的二次谐波失真信号的强度值，N
3为该频点对应的三次谐波失真信号的强度值。
测试谐波失真信号的强度值可以通过谐波测量设备(例如，谐波分析仪)测量得到。
步骤S3800，利用谐波失真信号频段信息、失真响应函数的幅度值和传递函数的幅度值，确定谐波失真信号。
步骤S3800进一步包括以下步骤S3810-S3830。
步骤S3810，根据传递函数的幅度值确定谐波失真信号频段信息的增益值或者衰减值。
基于计算式(2)，确定谐波失真信号频段中各个频点对应的增益值或者衰减值。
步骤S3820，基于谐波失真信号频段信息的增益值或者衰减值，利用滤波器对谐波失真信号频段信息对应的信号进行处理，得到处理后的谐波失真信号频段信息对应的信号。
步骤S3830，根据失真响应函数的幅度值，从处理后的谐波失真信号频段信息对应的信号中确定谐波失真信号。
基于计算式(4)，计算得到谐波失真信号THD，
THD＝Y*Dis(X)—计算式(4)。
例如，当谐波失真信号包括二次谐波失真信号和三次谐波失真信号时，计算式(4)变为计算式(4a)，
THD＝Y*[Dis
2(X)+Dis
3(X)]—计算式(4a)。
步骤S3900，在从第二音频信号中消除回声信号的同时，消除谐波失真信号。
<装置实施例>
图4为根据本申请实施例的回声消除装置的原理框图。
根据图4所示，本实施例的回声消除装置4000可以包括音频信号获取模块4100、延时补偿模块4200、传递函数幅度值获取模块4300、回声信号确定模块4400、消除模块4500。
音频信号获取模块4100用于获取至少一个扬声器接收的第一音频信号以及麦克风接收的第二音频信号。
延时补偿模块4200用于对第一音频信号进行延时补偿处理，得到第三音频信号。
传递函数幅度值获取模块4300用于获取音频信号从扬声器传递至麦克风对应的传递函数的幅度值。
该传递函数的幅度值可以通过以下方式获得：获取扬声器接收的测试音频信号和麦克风接收的、由测试音频信号产生的测试回声信号；根据测试音频信号的强度值和测试回声信号的强度值，确定传递函数的幅度值。
传递函数的幅度值具体可以参见上述计算式(1)。
回声信号确定模块4400用于利用第三音频信号和传递函数的幅度值，确定第二音频信号中、由第一音频信号产生的回声信号。
消除模块4500用于从第二音频信号中消除回声信号。
在一个实施例中，回声信号确定模块4400进一步用于根据传递函数的幅度值确定第三音频信号的增益值或者衰减值；基于第三音频信号的增益值或者衰减值，利用滤波器对第三音频信号进行处理，得到处理后的第三音频信号，以作为第一音频信号中、由第二音频信号产生的回声信号。具体地，参见上述计算式(2)。
在一个实施例中，回声消除装置4000还可以包括谐波失真信号频段信息获取模块、失真响应函数幅度值获取模块、谐波失真信号确定模块。
谐波失真信号频段信息获取模块用于获得第三音频信号中的谐波失真信号频段信息。
失真响应函数幅度值获取模块用于获取音频信号从扬声器传递至麦克风对应的失真响应函数的幅度值。
失真响应函数的幅度值通过以下方式获得：获取扬声器接收的测试音频信号和麦克风接收的、由测试音频信号对应的测试谐波失真信号；根据测试音频信号的强度值和测试谐波失真信号的强度值，确定失真响应函数的幅度值。具体地，可以参见上述计算式(3)。
谐波失真信号确定模块用于利用谐波失真信号频段信息、失真响应函数的幅度值和传递函数的幅度值，确定谐波失真信号。
消除模块还用于在从第二音频信号中消除回声信号的同时，消除谐波失真信号。
在一个实施例中，谐波失真信号确定模块进一步用于根据传递函数的幅度值确定谐波失真信号频段信息的增益值或者衰减值；基于谐波失真信号频段信息的增益值或者衰减值，利用滤波器对谐波失真信号频段信息对应的信号进行处理，得到处理后的谐波失真信号频段信息对应的信号；根据失真响应函数的幅度值，从处理后的谐波失真信号频段信息对应的信号中确定谐波失真信号。具体地，参见上述计算式(4)。
<例子>
根据图5所示，本例子示出了两个电子设备，分别是第一电子设备和第二电子设备。使用第一电子设备的A用户与使用第二电子设备的B用户可以进行通话。
A用户说话时，A用户的语音信号通过第一电子设备的麦克风传到第二电子设备的左扬声器和右扬声器。左扬声器和右扬声器在播放A用户的语音信号后，分别形成两个回声，该两个回声重新从第二电子设备的麦克风输入，同时叠加了B用户的语音信号。此时，A用户通过第一电子设备的扬声器可以听到B用户的语音信号和两个回声信号。
为了不影响通话质量，利用本例子提供的回声消除方法消除上述两个回声信号。
该回声消除方法至少包括以下步骤S501-S511。该回声消除方法是由第二电子设备实施的。以下步骤包括的各个部件均为第二电子设备中的部件。
步骤S501，获取左扬声器接收的A用户的语音信号S
l、右扬声器接收的A用户的语音信号S
r和麦克风接收的音频信号S。
左扬声器接收的A用户的语音信号S
l和右扬声器接收的A用户的语音信号S
r为ADC转换器转换之前的音频信号。
麦克风接收的音频信号S为麦克风接收的、DAC转换器转换之后的音频信号。该音频信号包括两个回声信号和B用户的语音信号。
步骤S502，利用第一延时补偿模块和第二延时补偿模块，分别对左扬声器接收的A用户的语音信号S
l和右扬声器接收的A用户的语音信号进行延时补偿处理S
r，分别得到处理后的信号S
l’和信号S
r’。
步骤S503，获取音频信号从左扬声器传递至麦克风对应的第一传递函数的幅度值，以及音频信号从右扬声器传递至麦克风对应的第二传递函数的幅度值。
步骤S504，根据第一传递函数的幅度值确定信号S
l’的增益值或者衰减值，以及根据第二传递函数的幅度值确定信号S
r’的增益值或者衰减值。
步骤S505，基于信号S
l’的增益值或者衰减值，利用第一滤波器对信号S
l’进行处理，得到第一回声信号S
l回，以及，基于信号S
r’的增益值或者衰减值，利用第二滤波器对信号S
r’进行处理，得到第二回声信号S
2回。
步骤S506，从麦克风接收的音频信号S消除第一回声信号S
l回，得到音频信号S
1，再从音频信号S
1消除第二回声信号S
2回，得到音频信号S
2。
步骤S507，获得谐波失真信号频段信息。
步骤S508，基于谐波失真信号频段信息，利用第一低通滤波器，从语音信号S
l’截取低频信号S
l低，以及利用第二低通滤波器，从语音信号S
r’截取低频信号S
r低。
步骤S509，获取音频信号从左扬声器传递至麦克风对应的第一失真 响应函数的幅度值，以及音频信号从扬声器传递至麦克风对应的第二失真响应函数的幅度值。
步骤S510，基于第一失真响应函数的幅度值和第一传递函数的幅度值，利用第一谐波生成模块，从低频信号S
l低确定第一谐波失真信号S
l谐，以及，基于第二失真响应函数的幅度值和第二传递函数的幅度值，利用第二谐波生成模块，从低频信号S
r低确定第二谐波失真信号S
r谐。
步骤S511，从音频信号S
2消除第一谐波失真信号S
l谐，得到音频信号S
3，再从音频信号中消除第二谐波失真信号S
r谐，得到音频信号S
4。
最后，将音频信号S
4传递至第一电子设备中。
<电子设备实施例>
在一个实施例中，根据图6所示，电子设备2000可以包括根据本申请任意实施例的回声消除装置4000，用于实施本申请任意实施例的回声消除方法。
在另一个实施例中，电子设备2000可以包括处理器2100和存储器2200。该存储器2200用于存储可执行的指令，该处理器2100用于根据指令的控制运行电子设备2000执行根据本申请任意实施例的回声消除方法。
<计算机可读存储介质>
在本实施例中，还提供一种计算机可读存储介质，其上存储有计算机程序，计算机程序在被处理器执行时实现如本申请任意实施例的回声消除方法。
本申请可以是系统、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质，其上载有用于使处理器实现本申请的各个方面的计算机可读程序指令。
本说明书中各个实施例采用并列或者递进的方式描述，每个实施例重点说明的都是与其它实施例的不同之处，各个实施例之间相同或相似部分互相参见即可。对于实施例公开的装置而言，由于其与实施例公开的方法相对应，所以描述的比较简单，相关之处可参见方法部分说明。
本领域普通技术人员还可以理解，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实 现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块，或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。
还需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
Claims (10)
- 一种回声消除方法，其特征在于，包括：获取至少一个扬声器接收的第一音频信号以及麦克风接收的第二音频信号；对所述第一音频信号进行延时补偿处理，得到第三音频信号；获取音频信号从所述扬声器传递至所述麦克风对应的传递函数的幅度值；利用所述第三音频信号和所述传递函数的幅度值，确定所述第二音频信号中、由所述第一音频信号产生的回声信号；从所述第二音频信号中消除所述回声信号。
- 根据权利要求1所述的方法，其特征在于，所述传递函数的幅度值通过以下方式获得：获取所述扬声器接收的测试音频信号和所述麦克风接收的、由所述测试音频信号产生的测试回声信号；根据所述测试音频信号的强度值和所述测试回声信号的强度值，确定所述传递函数的幅度值。
- 根据权利要求1所述的方法，其特征在于，所述利用所述第三音频信号和所述传递函数的幅度值，确定所述第二音频信号中、由所述第一音频信号产生的回声信号包括：根据所述传递函数的幅度值确定所述第三音频信号的增益值或者衰减值；基于所述第三音频信号的增益值或者衰减值，利用滤波器对所述第三音频信号进行处理，得到处理后的第三音频信号，以作为所述第一音频信号中、由所述第二音频信号产生的回声信号。
- 根据权利要求1所述的方法，其特征在于，所述方法还包括：获得所述第三音频信号中的谐波失真信号频段信息；获取所述音频信号从所述扬声器传递至所述麦克风对应的失真响应函数的幅度值；利用所述谐波失真信号频段信息、所述失真响应函数的幅度值和所 述传递函数的幅度值，确定谐波失真信号；在从所述第二音频信号中消除所述回声信号的同时，消除所述谐波失真信号。
- 根据权利要求4所述的方法，其特征在于，所述失真响应函数的幅度值通过以下方式获得：获取所述扬声器接收的测试音频信号和所述麦克风接收的、由所述测试音频信号对应的测试谐波失真信号；根据所述测试音频信号的强度值和所述测试谐波失真信号的强度值，确定所述失真响应函数的幅度值。
- 根据权利要求5所述的方法，其特征在于，所述谐波失真信号至少包括二次谐波失真信号和三次谐波失真信号。
- 根据权利要求4所述的方法，其特征在于，所述利用所述低频失真信号、所述失真响应函数的幅度值和所述传递函数的幅度值，确定谐波失真信号包括：根据所述传递函数的幅度值确定所述谐波失真信号频段信息的增益值或者衰减值；基于所述谐波失真信号频段信息的增益值或者衰减值，利用滤波器对所述谐波失真信号频段信息对应的信号进行处理，得到处理后的谐波失真信号频段信息对应的信号；根据所述失真响应函数的幅度值，从所述处理后的谐波失真信号频段信息对应的信号中确定所述谐波失真信号。
- 一种回声消除装置，其特征在于，包括：音频信号获取模块，用于获取至少一个扬声器接收的第一音频信号以及麦克风接收的第二音频信号；延时补偿模块，用于对所述第一音频信号进行延时补偿处理，得到第三音频信号；传递函数幅度值获取模块，用于获取音频信号从所述扬声器传递至所述麦克风对应的传递函数的幅度值；回声信号确定模块，用于利用所述第三音频信号和所述传递函数的 幅度值，确定所述第二音频信号中、由所述第一音频信号产生的回声信号；消除模块，用于从所述第二音频信号中消除所述回声信号。
- 一种电子设备，其特征在于，包括：存储器和处理器，所述存储器用于存储指令，所述指令用于控制所述处理器进行操作以执行根据权利要求1-7中任一项所述的方法。
- 一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序在被处理器执行时实现根据权利要求1-7中任意一项所述的方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910683643.3A CN110310654A (zh) | 2019-07-26 | 2019-07-26 | 回声消除方法及装置、电子设备、可读存储介质 |
| CN201910683643.3 | 2019-07-26 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2021017134A1 true WO2021017134A1 (zh) | 2021-02-04 |
Family
ID=68081842
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/108247 WO2021017134A1 (zh) | 2019-07-26 | 2019-09-26 | 回声消除方法及装置、电子设备、可读存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110310654A (zh) |
| WO (1) | WO2021017134A1 (zh) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110310654A (zh) * | 2019-07-26 | 2019-10-08 | 歌尔科技有限公司 | 回声消除方法及装置、电子设备、可读存储介质 |
| CN113160840B (zh) * | 2020-01-07 | 2022-10-25 | 北京地平线机器人技术研发有限公司 | 噪声滤除方法、装置、可移动设备及计算机可读存储介质 |
| CN113382119B (zh) * | 2020-02-25 | 2022-12-06 | 北京字节跳动网络技术有限公司 | 消除回声的方法、装置、可读介质和电子设备 |
| CN111863011B (zh) * | 2020-07-30 | 2024-03-12 | 北京达佳互联信息技术有限公司 | 音频处理方法及电子设备 |
| CN112700788B (zh) * | 2020-12-23 | 2024-05-03 | 普联国际有限公司 | 回声消除中回声路径的建模方法、装置、设备及存储介质 |
| CN113411724B (zh) * | 2021-05-07 | 2023-03-31 | 佳禾智能科技股份有限公司 | 基于骨导耳机通话的回音消除方法、计算机程序介质、骨导耳机 |
| CN113555029A (zh) * | 2021-07-21 | 2021-10-26 | 歌尔科技有限公司 | 一种语音设备控制方法、系统、介质及语音设备 |
| US11863710B2 (en) * | 2021-11-01 | 2024-01-02 | Mediatek Inc. | Audio device and method for detecting device status of audio device in audio/video conference |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130163748A1 (en) * | 2011-12-27 | 2013-06-27 | Broadcom Corporation | System for reducing speakerphone echo |
| CN108630219A (zh) * | 2018-05-08 | 2018-10-09 | 北京小鱼在家科技有限公司 | 一种音频处理系统、方法、装置、设备及存储介质 |
| CN109286730A (zh) * | 2017-07-20 | 2019-01-29 | 阿里巴巴集团控股有限公司 | 一种回声检测的方法、装置及系统 |
| CN109308905A (zh) * | 2017-07-28 | 2019-02-05 | 北京搜狗科技发展有限公司 | 音频数据处理方法、装置、电子设备和存储介质 |
| CN110310654A (zh) * | 2019-07-26 | 2019-10-08 | 歌尔科技有限公司 | 回声消除方法及装置、电子设备、可读存储介质 |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015086229A1 (en) * | 2013-12-12 | 2015-06-18 | Koninklijke Philips N.V. | Echo cancellation |
| CN105516859B (zh) * | 2015-11-27 | 2019-04-16 | 深圳Tcl数字技术有限公司 | 消除回声的方法和系统 |
| CN106303119A (zh) * | 2016-09-26 | 2017-01-04 | 维沃移动通信有限公司 | 一种通话过程中的回声消除方法和移动终端 |
| CN106911872B (zh) * | 2017-02-21 | 2020-04-10 | 豪威科技(上海)有限公司 | 降低回声抵消残留的方法及设备 |
| CN107231597B (zh) * | 2017-05-25 | 2020-05-15 | 深圳市泰衡诺科技有限公司 | 扬声器谐波失真值的测试方法及系统 |
| CN107105366B (zh) * | 2017-06-15 | 2022-09-23 | 歌尔股份有限公司 | 一种多通道回声消除电路、方法和智能设备 |
| CN108711433B (zh) * | 2018-05-18 | 2020-08-14 | 歌尔科技有限公司 | 一种回声消除方法和装置 |
| CN108600915B (zh) * | 2018-08-09 | 2024-02-06 | 歌尔科技有限公司 | 一种音频输出的方法、装置、谐波失真滤除设备及终端 |
| CN110956973A (zh) * | 2018-09-27 | 2020-04-03 | 深圳市冠旭电子股份有限公司 | 一种回声消除方法、装置及智能终端 |
| CN109273020B (zh) * | 2018-09-29 | 2022-04-19 | 阿波罗智联(北京)科技有限公司 | 音频信号处理方法、装置、设备和存储介质 |
| CN109360578B (zh) * | 2018-12-07 | 2021-11-19 | 歌尔科技有限公司 | 音频设备的回声消除方法、音频设备及可读存储介质 |
| CN109862200B (zh) * | 2019-02-22 | 2021-02-12 | 北京达佳互联信息技术有限公司 | 语音处理方法、装置、电子设备及存储介质 |
| CN109831733B (zh) * | 2019-02-26 | 2020-11-24 | 北京百度网讯科技有限公司 | 音频播放性能的测试方法、装置、设备和存储介质 |
-
2019
- 2019-07-26 CN CN201910683643.3A patent/CN110310654A/zh active Pending
- 2019-09-26 WO PCT/CN2019/108247 patent/WO2021017134A1/zh active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130163748A1 (en) * | 2011-12-27 | 2013-06-27 | Broadcom Corporation | System for reducing speakerphone echo |
| CN109286730A (zh) * | 2017-07-20 | 2019-01-29 | 阿里巴巴集团控股有限公司 | 一种回声检测的方法、装置及系统 |
| CN109308905A (zh) * | 2017-07-28 | 2019-02-05 | 北京搜狗科技发展有限公司 | 音频数据处理方法、装置、电子设备和存储介质 |
| CN108630219A (zh) * | 2018-05-08 | 2018-10-09 | 北京小鱼在家科技有限公司 | 一种音频处理系统、方法、装置、设备及存储介质 |
| CN110310654A (zh) * | 2019-07-26 | 2019-10-08 | 歌尔科技有限公司 | 回声消除方法及装置、电子设备、可读存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110310654A (zh) | 2019-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021017134A1 (zh) | 回声消除方法及装置、电子设备、可读存储介质 | |
| CN108376548B (zh) | 一种基于麦克风阵列的回声消除方法与系统 | |
| US9142205B2 (en) | Leakage-modeling adaptive noise canceling for earspeakers | |
| US9014387B2 (en) | Coordinated control of adaptive noise cancellation (ANC) among earspeaker channels | |
| US9495952B2 (en) | Electronic devices for controlling noise | |
| JP2020507955A (ja) | ミキシング後音響エコーキャンセルシステム及び方法 | |
| US11848023B2 (en) | Audio noise reduction | |
| TWI506620B (zh) | 通訊裝置及其語音處理方法 | |
| JP2015517683A (ja) | 雑音消去パーソナルオーディオデバイスにおける二次経路モデルおよび漏出経路モデルのエラー信号コンテンツ制御適応 | |
| US8208621B1 (en) | Systems and methods for acoustic echo cancellation | |
| EP3282678B1 (en) | Signal processor with side-tone noise reduction for a headset | |
| US20110178800A1 (en) | Distortion Measurement for Noise Suppression System | |
| US9344050B2 (en) | Dynamic speaker management with echo cancellation | |
| JP2017513296A (ja) | 周波数依存側音較正 | |
| KR20160055871A (ko) | 부 경로를 트레이닝하기 위해 내부 백색 잡음을 적응적으로 형성함으로써 적응형 잡음 소거를 위한 시스템들 및 방법들 | |
| JP2009522904A (ja) | 音響エコーキャンセラ | |
| US20150110298A1 (en) | Sensor | |
| US20180350394A1 (en) | Voice activity detection for communication headset | |
| US11902758B2 (en) | Method of compensating a processed audio signal | |
| US11380313B2 (en) | Voice-based control in a media system or other voice-controllable sound generating system | |
| CN112272848A (zh) | 使用间隙置信度的背景噪声估计 | |
| GB2550457A (en) | Method and apparatus for acoustic crosstalk cancellation | |
| US11380312B1 (en) | Residual echo suppression for keyword detection | |
| US20200186923A1 (en) | Methods, systems and apparatus for improved feedback control | |
| WO2020225851A1 (ja) | データ補正装置、データ補正方法、およびプログラム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19940151 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19940151 Country of ref document: EP Kind code of ref document: A1 |