CN113178203B - Echo cancellation method, echo cancellation system, audio device and readable storage medium - Google Patents
Echo cancellation method, echo cancellation system, audio device and readable storage medium Download PDFInfo
- Publication number
- CN113178203B CN113178203B CN202110442772.0A CN202110442772A CN113178203B CN 113178203 B CN113178203 B CN 113178203B CN 202110442772 A CN202110442772 A CN 202110442772A CN 113178203 B CN113178203 B CN 113178203B
- Authority
- CN
- China
- Prior art keywords
- audio
- signal
- digital
- echo cancellation
- signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 77
- 230000005236 sound signal Effects 0.000 claims abstract description 175
- 230000008569 process Effects 0.000 claims description 39
- 230000003044 adaptive effect Effects 0.000 claims description 18
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 10
- 238000013500 data storage Methods 0.000 claims description 5
- 238000012856 packing Methods 0.000 claims description 4
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses an echo cancellation method, which is applied to audio equipment comprising an audio player and an audio collector, and comprises the following steps: acquiring a first audio signal input by an audio player; acquiring a second audio signal acquired by an audio acquisition device; and eliminating the echo signal introduced by the first audio signal in the second audio signal to obtain the second audio signal without the echo, so as to identify the second audio signal without the echo. Therefore, the echo signal introduced into the audio collector by the audio player can be eliminated, so that the audio collector is prevented from correctly recognizing the voice command due to the influence of the echo signal, and the pickup performance of the audio equipment is improved. The invention also discloses an echo cancellation system, audio equipment and a readable storage medium, which have the same beneficial effects as the echo cancellation method.
Description
Technical Field
The present invention relates to the field of intelligent audio devices, and in particular, to an echo cancellation method and system, an audio device, and a readable storage medium.
Background
The smart sound box has functions of playing audio signals, receiving voice instructions, performing voice interaction and the like. At present, in order to better promote the audio playback effect of intelligent audio amplifier, need the audio source of intelligent audio amplifier broadcast high tone quality, big volume usually, nevertheless must lead to on the sound coupling of speaker in the audio amplifier to the microphone in the audio amplifier like this to influence the microphone and correctly discern voice command, lead to the pickup performance of intelligent audio amplifier relatively poor.
Therefore, how to provide a solution to the above technical problem is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The invention aims to provide an echo cancellation method, an echo cancellation system, audio equipment and a readable storage medium, which can cancel echo signals introduced into an audio collector by an audio player, so that the audio collector is prevented from correctly recognizing voice instructions due to the influence of the echo signals, and the sound pickup performance of the audio equipment is improved.
In order to solve the above technical problem, the present invention provides an echo cancellation method applied to an audio device including an audio player and an audio collector, including:
acquiring a first audio signal input by the audio player;
acquiring a second audio signal acquired by the audio acquisition device;
and eliminating the echo signal introduced by the first audio signal in the second audio signal to obtain a second audio signal with the echo eliminated so as to identify the second audio signal with the echo eliminated.
Preferably, the audio apparatus further comprises: the audio player comprises an I/V sensing module and a power amplifier chip, wherein the I/V sensing module is used for amplifying the power of a first audio signal which is pre-input to the audio player and then supplying the first audio signal to the audio player;
a process of obtaining a first audio signal input by the audio player, comprising:
acquiring a first analog voltage current signal input by the audio player by using the I/V sensing module, and performing analog-to-digital conversion on the first analog voltage current signal to obtain a first digital voltage current signal;
and extracting the voltage signal in the first digital voltage and current signal to obtain a first digital audio signal which needs to be referred to during echo cancellation processing.
Preferably, the audio collector includes: a microphone array constituted by a plurality of microphones; the audio device further includes: ADC chips corresponding to the multiple microphone groups divided by the microphone array one by one;
a process of acquiring a second audio signal acquired by the audio acquirer, comprising:
and performing analog-to-digital conversion on the second analog audio signals acquired by each microphone group by using the ADC chip to obtain second digital audio signals required to be used in echo cancellation processing.
Preferably, the echo cancellation method further comprises:
initializing the power amplifier chip and the ADC chip after the audio equipment is started;
in the process of initializing the power amplifier chip, configuring the clock frequency and the frame frequency of an audio port corresponding to the power amplifier chip, a first effective data length corresponding to a sensing signal feedback terminal and a voltage channel number corresponding to the I/V sensing module; the frame of digital audio signals transmitted by the sensing signal feedback terminal comprise digital audio signals of a voltage channel and digital audio signals of a current channel;
in the process of initializing the ADC chip, configuring the clock frequency and the frame frequency of an audio port corresponding to the ADC chip, the length of second effective data corresponding to a signal acquisition feedback terminal and the number of microphone channels corresponding to a plurality of microphones one by one; wherein, a frame of digital audio signals transmitted by the acquisition signal feedback terminal comprise digital audio signals of a plurality of microphone channels;
extracting the voltage signal in the first digital voltage current signal to obtain a first digital audio signal to be referred to in the echo cancellation process, including:
extracting a first digital voltage current effective signal which has the same length as the first effective data and is at a high position from each frame of first digital voltage current signals, and extracting a first digital audio channel signal corresponding to the voltage channel number from the first digital voltage current effective signal for reference use in echo cancellation processing;
the process of obtaining the second audio signal collected by the audio collector further comprises:
and extracting a second digital audio effective signal which has the same length with the second effective data and is at a high level from each frame of second digital audio signals, and respectively extracting a plurality of second digital audio channel signals which correspond to a plurality of microphone channel numbers one by one from the second digital audio effective signal for echo cancellation processing.
Preferably, the echo cancellation method further comprises:
sequentially storing a plurality of second digital audio channel signals and first digital audio channel signals at different frame frequencies;
and when the echo cancellation processing is carried out, packing the plurality of second digital audio channel signals and the first digital audio channel signals under the same frame frequency according to the data storage sequence to obtain a data packet used for the echo cancellation processing.
Preferably, the process of canceling the echo signal introduced by the first audio signal in the second audio signal includes:
taking the second audio signal as a positive input end signal of a preset adaptive filter, and taking the first audio signal as a negative input end signal of the adaptive filter;
performing mean square error minimization processing on an output signal of the adaptive filter by adjusting the weighted value of the coefficient of the adaptive filter on each input end signal;
and taking the output signal after the mean square error minimization processing as a second audio signal for eliminating echo.
In order to solve the above technical problem, the present invention further provides an echo cancellation system applied to an audio device including an audio player and an audio collector, including:
the first acquisition module is used for acquiring a first audio signal input by the audio player;
the second acquisition module is used for acquiring a second audio signal acquired by the audio acquisition device;
and the echo cancellation module is used for performing cancellation processing on an echo signal introduced by the first audio signal in the second audio signal to obtain a second audio signal with echo being cancelled so as to perform identification processing on the second audio signal with echo being cancelled.
In order to solve the above technical problem, the present invention further provides an audio device, including:
an audio player;
an audio collector;
a processor for implementing the steps of any of the echo cancellation methods described above when executing a computer program stored therein.
In order to solve the above technical problem, the present invention further provides a readable storage medium, in which a computer program is stored, and when the computer program is called and executed by a processor, the computer program can implement the steps of any of the above echo cancellation methods.
The invention provides an echo cancellation method, which is applied to audio equipment comprising an audio player and an audio collector, and comprises the following steps: acquiring a first audio signal input by an audio player; acquiring a second audio signal acquired by an audio acquisition device; and eliminating the echo signal introduced by the first audio signal in the second audio signal to obtain the second audio signal without the echo, so as to identify the second audio signal without the echo. Therefore, the echo signal introduced into the audio collector by the audio player can be eliminated, so that the audio collector is prevented from correctly recognizing the voice command due to the influence of the echo signal, and the pickup performance of the audio equipment is improved.
The invention also provides an echo cancellation system, an audio device and a readable storage medium, which have the same beneficial effects as the echo cancellation method.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a flowchart of an echo cancellation method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an audio device according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an echo cancellation system according to an embodiment of the present invention.
Detailed Description
The core of the invention is to provide an echo cancellation method, a system, audio equipment and a readable storage medium, which can cancel the echo signal introduced into the audio collector by the audio player, thereby avoiding the influence of the echo signal on the audio collector to correctly identify the voice command and improving the sound pickup performance of the audio equipment.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1 and fig. 2, fig. 1 is a flowchart of an echo cancellation method according to an embodiment of the present invention, and fig. 2 is a schematic structural diagram of an audio device according to an embodiment of the present invention.
The echo cancellation method is applied to audio equipment (such as an intelligent sound box) comprising an audio player and an audio collector, and comprises the following steps:
step S1: a first audio signal input by an audio player is acquired.
Step S2: and acquiring a second audio signal acquired by the audio acquisition device.
And step S3: and eliminating the echo signal introduced by the first audio signal in the second audio signal to obtain the second audio signal without the echo, so as to identify the second audio signal without the echo.
Specifically, as shown in fig. 2, the audio device of the present application includes an audio player 11 and an audio collector 12, where the audio player 11 is used for playing an audio signal, and the audio collector 12 is used for collecting a voice instruction. Considering that the sound of audio player 11 in the audio device is likely to couple to audio collector 12, which affects audio collector 12 to correctly recognize the voice command, and reduces the sound pickup performance of the audio device, the technical means adopted in the present application is: the echo signal introduced into audio collector 12 by audio player 11 is eliminated, so that the influence of echo signal on correct recognition of voice command by audio collector 12 is avoided, and the pickup performance of audio equipment is improved.
More specifically, in the present application, a first audio signal input by audio player 11 is obtained, and a second audio signal acquired by audio collector 12 is obtained at the same time, considering that an echo signal introduced by the first audio signal input by audio player 11 may be doped in the second audio signal acquired by audio collector 12, the echo signal introduced by the first audio signal in the second audio signal is eliminated to obtain a second audio signal with an echo eliminated, so as to perform recognition processing on the second audio signal with an echo eliminated, thereby ensuring that audio collector 12 correctly recognizes a voice instruction.
The invention provides an echo cancellation method, which is applied to audio equipment comprising an audio player and an audio collector, and comprises the following steps: acquiring a first audio signal input by an audio player; acquiring a second audio signal acquired by an audio acquisition device; and eliminating the echo signal introduced by the first audio signal in the second audio signal to obtain the second audio signal without the echo, so as to identify the second audio signal without the echo. Therefore, the echo signal introduced into the audio collector by the audio player can be eliminated, so that the audio collector is prevented from correctly recognizing the voice command due to the influence of the echo signal, and the pickup performance of the audio equipment is improved.
On the basis of the above-described embodiment:
as an alternative embodiment, the audio device further comprises: the internal part of the audio player comprises an I/V sensing module and a power amplifier chip 14 which is used for amplifying the power of a first audio signal which is pre-input to the audio player 11 and then supplying the amplified signal to the audio player 11;
the process of acquiring the first audio signal input by the audio player 11 includes:
acquiring a first analog voltage current signal input by the audio player 11 by using the I/V sensing module, and performing analog-to-digital conversion on the first analog voltage current signal to obtain a first digital voltage current signal;
and extracting the voltage signal in the first digital voltage and current signal to obtain a first digital audio signal required to be referred to during echo cancellation processing.
Further, as shown in fig. 2, the audio device of the present application further includes a power amplifier chip 14, where the power amplifier chip 14 is mainly configured to process (e.g., sound effect processing) the first audio signal pre-input to the audio player 11, then perform power amplification (e.g., signal power amplification is performed by using a Class D power amplifier disposed inside the power amplifier chip 14), and then supply the processed first audio signal to the audio player 11, so that the audio player 11 plays the processed first audio signal through the power amplifier chip 14.
Moreover, an I/V (current/voltage) sensing module is further disposed inside the power amplifier chip 14 of the present application, and the I/V sensing module is connected to an input end of the audio player 11, and is configured to detect a first analog voltage current signal (a first analog current signal + a first analog voltage signal) input by the audio player 11, and perform analog-to-digital conversion on the detected first analog voltage current signal to obtain a first digital voltage current signal (a first digital current signal + a first digital voltage signal), so as to be used when adjusting the power of the audio player 11.
Based on this, considering that the first digital voltage signal in the first digital voltage-current signal is the first digital audio signal to be referred to for the echo cancellation processing, the first digital voltage-current signal is obtained by the I/V sensing module, and then the voltage signal in the first digital voltage-current signal is extracted, so that the first digital audio signal to be referred to for the echo cancellation processing can be obtained.
It can be seen that, in the present application, an extra ADC (Analog-to-Digital Converter) chip does not need to be added for Analog-to-Digital conversion of the first Analog voltage and current signal input by the audio player 11, and an I/V sensing module having a function similar to that of the ADC chip in the power amplifier chip 14 is directly utilized, so as to save hardware cost and reduce complexity of circuit board wiring.
As an alternative embodiment, audio collector 12 includes: a microphone array constituted by a plurality of microphones; the audio device further includes: ADC chips 15 corresponding to a plurality of microphone groups divided by a microphone array one to one;
the process of obtaining a second audio signal captured by audio harvester 12 includes:
the ADC chip 15 is used to perform analog-to-digital conversion on the second analog audio signal collected by each microphone group, so as to obtain a second digital audio signal required to be used in echo cancellation processing.
Further, as shown in fig. 2, the audio collector 12 of the present application includes a microphone array composed of a plurality of microphones, each of which is used for collecting an external voice instruction, and the present application divides the microphones of the microphone array into a plurality of microphone groups, for example, in the microphone array composed of 4 microphones, 2 microphones are a group. The audio device further comprises ADC chips 15 corresponding to the plurality of microphone groups one to one, and the plurality of ADC chips 15 are used for performing analog-to-digital conversion on the second analog audio signals collected by each microphone group one by one to obtain a plurality of second digital audio signals for echo cancellation processing.
As an alternative embodiment, the echo cancellation method further includes:
after the audio equipment is started, initializing a power amplifier chip 14 and an ADC chip 15;
in the process of initializing the power amplifier chip 14, configuring the clock frequency and the frame frequency of an audio port corresponding to the power amplifier chip 14, a first effective data length corresponding to a sensing signal feedback terminal, and a voltage channel number corresponding to an I/V sensing module; the sensing signal feedback terminal is used for transmitting a sensing signal to the sensing signal feedback terminal, wherein the sensing signal feedback terminal transmits a frame of digital audio signals comprising a digital audio signal of a voltage channel and a digital audio signal of a current channel;
in the process of initializing the ADC chip 15, configuring a clock frequency and a frame frequency of an audio port corresponding to the ADC chip 15, a second effective data length corresponding to the collected signal feedback terminal, and microphone channel numbers corresponding to the plurality of microphones one to one; wherein, a frame of digital audio signals transmitted by the acquisition signal feedback terminal comprise digital audio signals of a plurality of microphone channels;
the process of extracting the voltage signal in the first digital voltage current signal to obtain the first digital audio signal to be referred to in the echo cancellation process includes:
extracting a first digital voltage current effective signal which has the same length as the first effective data and is at a high position from each frame of first digital voltage current signals, and extracting a first digital audio channel signal corresponding to a voltage channel number from the first digital voltage current effective signal for reference use in echo cancellation processing;
the process of acquiring a second audio signal captured by audio collector 12 further comprises:
and extracting a second digital audio effective signal which has the same length with the second effective data and is at a high level from each frame of second digital audio signals, and respectively extracting a plurality of second digital audio channel signals which correspond to the plurality of microphone channel numbers one by one from the second digital audio effective signals for use in echo cancellation processing.
Further, as shown in fig. 2, the audio device of the present application further includes a processor 13 (e.g., a CPU) respectively connected to the power amplifier chip 14 and the plurality of ADC chips 15, and it should be noted that, when the processor 13 executes a computer program stored therein, the processor 13 may implement any of the steps of the echo cancellation method of the present application.
Specifically, the processor 13 is connected to both the power amplifier chip 14 and the ADC chip 15 via an audio interface (e.g., TDM interface). The audio interface includes four terminals: BCLK (clock signal terminal), fsync (frame signal terminal), dout (audio signal transmission terminal), din (Din corresponding to the power amplifier chip 14 is referred to as a sense signal feedback terminal, and Din corresponding to the ADC chip 15 is referred to as a collected signal feedback terminal). The processor 13 sends the first audio signal pre-input to the audio player 11 to the power amplifier chip 14 for processing through the Dout of the audio interface. The I/V sensing module in the power amplifier chip 14 sends the first digital voltage and current signal to the processor 13 through Din of the audio interface for processing. The ADC chip 15 sends the second digital audio signal to the processor 13 for processing through Din of the audio interface.
Based on this, according to the present application, after the audio device is powered on, the power amplifier chip 14 and the ADC chip 15 are initialized, and specifically, the power amplifier chip 14 and the ADC chip 15 may be initialized through the I2C bus. In the process of initializing the power amplifier chip 14, the clock frequency and the frame frequency of the audio port (TDM 1) corresponding to the power amplifier chip 14, the first effective data length corresponding to the sensing signal feedback terminal Din, and the voltage channel number corresponding to the I/V sensing module are configured. In the process of initializing the ADC chip 15, the clock frequency and the frame frequency of the audio port (TDM 2) corresponding to the ADC chip 15, the second effective data length corresponding to the collected signal feedback terminal Din, and the microphone channel numbers corresponding to the plurality of microphones one to one are configured. It should be noted that, a frame of digital audio signals transmitted by the sensing/collecting signal feedback terminal Din may be divided into digital audio signals of different channels (slots), specifically, the frame of digital audio signals transmitted by the sensing signal feedback terminal Din includes a digital audio signal of a voltage channel and a digital audio signal of a current channel; one frame of digital audio signals transmitted by the acquisition signal feedback terminal Din comprise digital audio signals of a plurality of microphone channels. It should be further noted that, in addition to the valid signals (at a high bit) of the digital audio channel signal, some invalid signals (generally, "0", at a low bit) exist in the frame of digital audio signals, the first valid data length corresponding to the sensing signal feedback terminal Din represents the data length occupied by the valid signals in the frame of digital audio signals transmitted by the sensing signal feedback terminal Din; the second effective data length corresponding to the acquired signal feedback terminal Din represents the data length occupied by the effective signal in one frame of digital audio signals transmitted by the acquired signal feedback terminal Din.
The processing procedure of the first digital voltage and current signal transmitted on the sensing signal feedback terminal Din by the present application is as follows: firstly, a first digital voltage current effective signal which has the same length with first effective data and is at a high position is extracted from each frame of first digital voltage current signal, and then a first digital audio channel signal corresponding to a voltage channel number is extracted from the first digital voltage current effective signal and is used as a reference when echo cancellation processing is carried out. Similarly, the processing flow of the second digital audio signal transmitted on the acquisition signal feedback terminal Din in the present application is: firstly, second digital audio effective signals which have the same length with the second effective data and are at a high level are extracted from each frame of second digital audio signals, and then a plurality of second digital audio channel signals which are in one-to-one correspondence with a plurality of microphone channel numbers are respectively extracted from the second digital audio effective signals for use in echo cancellation processing.
For example, the microphone array includes four microphones, namely, a microphone 1, a microphone 2, a microphone 3 and a microphone 4, a frame of second digital audio signal has 32 bits in total, a second digital audio effective signal occupies 16 bits higher than the frame of second digital audio signal, the 16-bit higher signal includes 4-channel digital audio signals, the ADC chip puts the 4-bit audio signal collected by the microphone 1 into a first channel (channel number is "1"), puts the 4-bit audio signal collected by the microphone 2 into a second channel (channel number is "2"), puts the 4-bit audio signal collected by the microphone 3 into a third channel (channel number is "3"), puts the 4-bit audio signal collected by the microphone 4 into a fourth channel (channel number is "4"), and complements the 16-bit lower signal by 0 to form a frame of second digital audio signal.
As an alternative embodiment, the echo cancellation method further includes:
sequentially storing a plurality of second digital audio channel signals and first digital audio channel signals at different frame frequencies;
and when the echo cancellation processing is carried out, packing the plurality of second digital audio channel signals and the first digital audio channel signals under the same frame frequency according to the data storage sequence to obtain a data packet used for the echo cancellation processing.
Further, the present application may further sequentially store the plurality of second digital audio channel signals and the first digital audio channel signals at different frame frequencies in order for use when waiting for the echo cancellation processing, specifically, the storage order of the plurality of second digital audio channel signals and the first digital audio channel signals at each frame frequency is: until the second digital audio channel signal micn corresponding to the last microphone channel number and the first digital audio channel signal REF, the signal storage sequence at different frame frequencies is: microrefmic1mic2. Microref.
Based on this, when performing echo cancellation processing, the plurality of second digital audio channel signals and the first digital audio channel signals at the same frame frequency are packed according to the data storage sequence, for example, the signals mic1mic2.. MicnREF at the same frame frequency are packed, so as to obtain a plurality of data packets at different frame frequencies, which are used when performing echo cancellation processing.
It should be noted that, the data length of the multiple second digital audio channel signals combined at the same frame frequency is equal to the data length of the first digital audio channel signal, which is convenient for signal processing.
As an alternative embodiment, the process of performing cancellation processing on an echo signal introduced by the first audio signal in the second audio signal includes:
taking the second audio signal as a positive input end signal of a preset adaptive filter, and taking the first audio signal as a negative input end signal of the adaptive filter;
the output signal of the adaptive filter is subjected to mean square error minimization processing by adjusting the weighted value of the adaptive filter to the coefficient of each input end signal;
and taking the output signal after the mean square error minimization processing as a second audio signal for eliminating echo.
Specifically, the adaptive filter is adopted to eliminate an echo signal introduced by the first audio signal in the second audio signal. More specifically, the present application inputs the second audio signal (specifically, the mic1mic2.. Micn signal extracted after unpacking the packet) to the positive input terminal of the adaptive filter, inputs the first audio signal (specifically, the REF signal extracted after unpacking the packet) to the negative input terminal of the adaptive filter, and then performs a mean square error minimization process (i.e., performs a cancellation process on an echo signal introduced from the first audio signal in the second audio signal) on an output signal of the adaptive filter by adjusting a coefficient weighted value of each input terminal signal of the adaptive filter, where the output signal of the adaptive filter after the mean square error minimization process is used as the second audio signal for canceling the echo, and is used for subsequent identification process.
Referring to fig. 3, fig. 3 is a schematic structural diagram of an echo cancellation system according to an embodiment of the present invention.
The echo cancellation system is applied to audio equipment comprising an audio player and an audio collector, and comprises the following components:
the first obtaining module 1 is used for obtaining a first audio signal input by an audio player;
the second acquisition module 2 is used for acquiring a second audio signal acquired by the audio acquisition device;
the echo cancellation module 3 is configured to perform cancellation processing on an echo signal introduced from the first audio signal in the second audio signal to obtain a second audio signal with echo cancelled, so as to perform identification processing on the second audio signal with echo cancelled.
For the introduction of the echo cancellation system, reference is made to the above embodiments of the echo cancellation method, which are not described herein again.
The present application further provides an audio device comprising:
an audio player 11;
an audio collector 12;
a processor 13 for implementing the steps of any of the echo cancellation methods described above when executing a computer program stored therein.
Specifically, as shown in fig. 2, the audio device of the present application includes an audio player 11, an audio collector 12, a processor 13, a power amplifier chip 14, and an ADC chip 15. For the introduction of the audio device in the present application, please refer to the above embodiments of the echo cancellation method, which is not described herein again.
The present application further provides a readable storage medium, in which a computer program is stored, and when the computer program is called and executed by a processor, the steps of any one of the echo cancellation methods described above can be implemented.
For the introduction of the readable storage medium, reference is made to the above embodiments of the echo cancellation method, which are not described herein again.
It should also be noted that, in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (5)
1. An echo cancellation method applied to an audio device including an audio player and an audio collector, comprising:
acquiring a first audio signal input by the audio player;
acquiring a second audio signal acquired by the audio acquisition device;
eliminating echo signals introduced by the first audio signals in the second audio signals to obtain second audio signals with echo eliminated so as to identify the second audio signals with echo eliminated;
the audio device further comprises: the audio player comprises an I/V sensing module and a power amplifier chip, wherein the I/V sensing module is used for amplifying the power of a first audio signal which is pre-input to the audio player and then supplying the first audio signal to the audio player;
a process of obtaining a first audio signal input by the audio player, comprising:
acquiring a first analog voltage current signal input by the audio player by using the I/V sensing module, and performing analog-to-digital conversion on the first analog voltage current signal to obtain a first digital voltage current signal;
extracting a voltage signal in the first digital voltage and current signal to obtain a first digital audio signal which needs to be referred to during echo cancellation processing;
the audio collector comprises: a microphone array constituted by a plurality of microphones; the audio device further includes: ADC chips corresponding to the multiple microphone groups divided by the microphone array one by one;
a process of acquiring a second audio signal acquired by the audio acquirer includes:
performing analog-to-digital conversion on the second analog audio signal acquired by each microphone group by using the ADC chip to obtain a second digital audio signal required to be used during echo cancellation processing;
the echo cancellation method further comprises:
initializing the power amplifier chip and the ADC chip after the audio equipment is started;
in the process of initializing the power amplifier chip, configuring the clock frequency and the frame frequency of an audio port corresponding to the power amplifier chip, the first effective data length corresponding to a sensing signal feedback terminal and the voltage channel number corresponding to the I/V sensing module; the sensing signal feedback terminal is used for transmitting a sensing signal to the sensing signal feedback terminal, wherein the sensing signal feedback terminal transmits a frame of digital audio signals comprising a digital audio signal of a voltage channel and a digital audio signal of a current channel;
in the process of initializing the ADC chip, configuring the clock frequency and the frame frequency of an audio port corresponding to the ADC chip, the length of second effective data corresponding to a signal acquisition feedback terminal and microphone channel numbers corresponding to a plurality of microphones one by one; wherein, a frame of digital audio signals transmitted by the acquisition signal feedback terminal comprise digital audio signals of a plurality of microphone channels;
then, the process of extracting the voltage signal in the first digital voltage-current signal to obtain the first digital audio signal to be referred to in the echo cancellation process includes:
extracting a first digital voltage current effective signal which has the same length as the first effective data and is at a high bit from each frame of first digital voltage current signals, and extracting a first digital audio channel signal corresponding to the voltage channel number from the first digital voltage current effective signal for reference during echo cancellation processing;
the process of obtaining the second audio signal collected by the audio collector further comprises:
extracting second digital audio effective signals which have the same length as the second effective data and are at a high level from each frame of second digital audio signals, and respectively extracting a plurality of second digital audio channel signals which are in one-to-one correspondence with a plurality of microphone channel numbers from the second digital audio effective signals for echo cancellation processing;
the echo cancellation method further comprises:
sequentially storing a plurality of second digital audio channel signals and first digital audio channel signals at different frame frequencies;
and when the echo cancellation processing is carried out, packing the plurality of second digital audio channel signals and the plurality of first digital audio channel signals under the same frame frequency according to the data storage sequence to obtain a data packet used for the echo cancellation processing.
2. The echo cancellation method according to claim 1, wherein the step of performing cancellation processing on the echo signal introduced by the first audio signal in the second audio signal comprises:
taking the second audio signal as a positive input end signal of a preset adaptive filter, and taking the first audio signal as a negative input end signal of the adaptive filter;
performing mean square error minimization processing on an output signal of the adaptive filter by adjusting the weighted value of the coefficient of the adaptive filter on each input end signal;
and taking the output signal after the mean square error minimization processing as a second audio signal for eliminating echo.
3. An echo cancellation system for use in an audio device including an audio player and an audio collector, comprising:
the first acquisition module is used for acquiring a first audio signal input by the audio player;
the second acquisition module is used for acquiring a second audio signal acquired by the audio acquisition device;
the echo cancellation module is used for performing cancellation processing on an echo signal introduced by the first audio signal in the second audio signal to obtain a second audio signal with echo being cancelled so as to perform identification processing on the second audio signal with echo being cancelled;
the audio device further comprises: the audio player comprises an I/V sensing module and a power amplifier chip, wherein the I/V sensing module is used for amplifying the power of a first audio signal which is pre-input to the audio player and then supplying the first audio signal to the audio player;
a process of obtaining a first audio signal input by the audio player, comprising:
acquiring a first analog voltage current signal input by the audio player by using the I/V sensing module, and performing analog-to-digital conversion on the first analog voltage current signal to obtain a first digital voltage current signal;
extracting a voltage signal in the first digital voltage and current signal to obtain a first digital audio signal which needs to be referred to during echo cancellation processing;
the audio collector comprises: a microphone array constituted by a plurality of microphones; the audio device further includes: ADC chips corresponding to the multiple microphone groups divided by the microphone array one by one;
a process of acquiring a second audio signal acquired by the audio acquirer, comprising:
performing analog-to-digital conversion on the second analog audio signal acquired by each microphone group by using the ADC chip to obtain a second digital audio signal required to be used during echo cancellation processing;
the echo cancellation method further comprises:
after the audio equipment is started, initializing the power amplifier chip and the ADC chip;
in the process of initializing the power amplifier chip, configuring the clock frequency and the frame frequency of an audio port corresponding to the power amplifier chip, a first effective data length corresponding to a sensing signal feedback terminal and a voltage channel number corresponding to the I/V sensing module; the sensing signal feedback terminal is used for transmitting a sensing signal to the sensing signal feedback terminal, wherein the sensing signal feedback terminal transmits a frame of digital audio signals comprising a digital audio signal of a voltage channel and a digital audio signal of a current channel;
in the process of initializing the ADC chip, configuring the clock frequency and the frame frequency of an audio port corresponding to the ADC chip, the length of second effective data corresponding to a signal acquisition feedback terminal and the number of microphone channels corresponding to a plurality of microphones one by one; wherein, a frame of digital audio signals transmitted by the acquisition signal feedback terminal comprise digital audio signals of a plurality of microphone channels;
then, the process of extracting the voltage signal in the first digital voltage-current signal to obtain the first digital audio signal to be referred to in the echo cancellation process includes:
extracting a first digital voltage current effective signal which has the same length as the first effective data and is at a high position from each frame of first digital voltage current signals, and extracting a first digital audio channel signal corresponding to the voltage channel number from the first digital voltage current effective signal for reference use in echo cancellation processing;
the process of obtaining the second audio signal collected by the audio collector further comprises:
extracting a second digital audio effective signal which has the same length with the second effective data and is at a high level from each frame of second digital audio signals, and respectively extracting a plurality of second digital audio channel signals which are in one-to-one correspondence with a plurality of microphone channel numbers from the second digital audio effective signal for use in echo cancellation processing;
the echo cancellation method further comprises:
sequentially storing a plurality of second digital audio channel signals and first digital audio channel signals at different frame frequencies;
and when the echo cancellation processing is carried out, packing the plurality of second digital audio channel signals and the plurality of first digital audio channel signals under the same frame frequency according to the data storage sequence to obtain a data packet used for the echo cancellation processing.
4. An audio device, comprising:
an audio player;
an audio collector;
a processor for implementing the steps of the echo cancellation method according to claim 1 or 2 when executing a computer program stored therein.
5. A readable storage medium, in which a computer program is stored, which, when invoked and executed by a processor, performs the steps of the echo cancellation method according to claim 1 or 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110442772.0A CN113178203B (en) | 2021-04-23 | 2021-04-23 | Echo cancellation method, echo cancellation system, audio device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110442772.0A CN113178203B (en) | 2021-04-23 | 2021-04-23 | Echo cancellation method, echo cancellation system, audio device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113178203A CN113178203A (en) | 2021-07-27 |
| CN113178203B true CN113178203B (en) | 2022-11-04 |
Family
ID=76924522
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110442772.0A Active CN113178203B (en) | 2021-04-23 | 2021-04-23 | Echo cancellation method, echo cancellation system, audio device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113178203B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103457633A (en) * | 2012-08-03 | 2013-12-18 | 万高(杭州)科技有限公司 | Echo noise elimination full mixed line interface |
| CN104969537A (en) * | 2012-12-21 | 2015-10-07 | 微软技术许可有限责任公司 | Echo suppression |
| CN105638263A (en) * | 2016-02-24 | 2016-06-08 | 陕西旭田光电农业科技有限公司 | Ultrasonic energy generating and transforming system for plant factory |
| CN107005763A (en) * | 2014-11-25 | 2017-08-01 | 美商楼氏电子有限公司 | For non-linear and time-varying Echo cancellation reference microphone |
| CN207910995U (en) * | 2017-11-13 | 2018-09-25 | 厦门傅里叶电子有限公司 | Intelligent audio power amplifier chips |
| CN110177183A (en) * | 2019-06-06 | 2019-08-27 | 四川赛科安全技术有限公司 | A kind of implementation method of fire telephone system |
| CN111161751A (en) * | 2019-12-25 | 2020-05-15 | 声耕智能科技(西安)研究院有限公司 | Distributed microphone pickup system and method under complex scene |
| CN111883156A (en) * | 2020-07-22 | 2020-11-03 | Oppo（重庆）智能科技有限公司 | Audio processing method and device, electronic equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2512022A (en) * | 2012-12-21 | 2014-09-24 | Microsoft Corp | Echo suppression |
| US9936282B2 (en) * | 2016-04-14 | 2018-04-03 | Cirrus Logic, Inc. | Over-sampling digital processing path that emulates Nyquist rate (non-oversampling) audio conversion |
| US10847178B2 (en) * | 2018-05-18 | 2020-11-24 | Sonos, Inc. | Linear filtering for noise-suppressed speech detection |
| CN111916100A (en) * | 2019-05-07 | 2020-11-10 | 北京地平线机器人技术研发有限公司 | Echo cancellation method and apparatus, storage medium, and electronic device |
-
2021
- 2021-04-23 CN CN202110442772.0A patent/CN113178203B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103457633A (en) * | 2012-08-03 | 2013-12-18 | 万高(杭州)科技有限公司 | Echo noise elimination full mixed line interface |
| CN104969537A (en) * | 2012-12-21 | 2015-10-07 | 微软技术许可有限责任公司 | Echo suppression |
| CN107005763A (en) * | 2014-11-25 | 2017-08-01 | 美商楼氏电子有限公司 | For non-linear and time-varying Echo cancellation reference microphone |
| CN105638263A (en) * | 2016-02-24 | 2016-06-08 | 陕西旭田光电农业科技有限公司 | Ultrasonic energy generating and transforming system for plant factory |
| CN207910995U (en) * | 2017-11-13 | 2018-09-25 | 厦门傅里叶电子有限公司 | Intelligent audio power amplifier chips |
| CN110177183A (en) * | 2019-06-06 | 2019-08-27 | 四川赛科安全技术有限公司 | A kind of implementation method of fire telephone system |
| CN111161751A (en) * | 2019-12-25 | 2020-05-15 | 声耕智能科技(西安)研究院有限公司 | Distributed microphone pickup system and method under complex scene |
| CN111883156A (en) * | 2020-07-22 | 2020-11-03 | Oppo（重庆）智能科技有限公司 | Audio processing method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113178203A (en) | 2021-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10923138B2 (en) | Sound collection apparatus for far-field voice | |
| CN109360562A (en) | Echo cancel method, device, medium and voice awakening method and equipment | |
| CN111356058B (en) | Echo cancellation method and device and intelligent sound box | |
| KR101902717B1 (en) | Voice wake-up method and device | |
| CN108447483B (en) | speech recognition system | |
| WO2017071183A1 (en) | Voice processing method and device, and pickup circuit | |
| CN112489671A (en) | Echo data eliminating method and device, terminal equipment and storage medium | |
| CN103117083A (en) | Audio information acquisition device and method | |
| CN113178203B (en) | Echo cancellation method, echo cancellation system, audio device and readable storage medium | |
| CN112151051A (en) | Audio data processing method and device and storage medium | |
| CN103559878A (en) | Method for eliminating noise in audio information and device thereof | |
| CN112802490B (en) | Beam forming method and device based on microphone array | |
| CN112243182B (en) | Pickup circuit, method and device | |
| CN208538474U (en) | Speech recognition system | |
| CN212544063U (en) | Automatic test system of audio signal database | |
| CN212969576U (en) | Digital power amplifier system based on PurePath intelligent loudspeaker compensation | |
| CN113990283A (en) | Noise reduction processing method and device, earphone and computer readable storage medium | |
| CN112770158A (en) | Far-field voice control system and method | |
| CN113890951B (en) | Echo cancellation method, device and system | |
| CN218550109U (en) | Multi-microphone extraction circuit | |
| CN110460949A (en) | A kind of production of earphone and detection method | |
| CN219287469U (en) | Audio static noise elimination circuit | |
| TWI849477B (en) | Audio processing apparatus and method having echo canceling mechanism | |
| CN213522355U (en) | Digital audio processing chip | |
| CN212231697U (en) | Voice acquisition device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |