CN112669871A - Signal processing method, electronic device and storage device - Google Patents
Signal processing method, electronic device and storage device Download PDFInfo
- Publication number
- CN112669871A CN112669871A CN202011615064.4A CN202011615064A CN112669871A CN 112669871 A CN112669871 A CN 112669871A CN 202011615064 A CN202011615064 A CN 202011615064A CN 112669871 A CN112669871 A CN 112669871A
- Authority
- CN
- China
- Prior art keywords
- signal
- signals
- subband
- sub
- band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000008030 elimination Effects 0.000 claims abstract description 21
- 238000003379 elimination reaction Methods 0.000 claims abstract description 21
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 13
- 238000005070 sampling Methods 0.000 claims description 27
- 238000001914 filtration Methods 0.000 claims description 11
- 238000001228 spectrum Methods 0.000 claims description 9
- 230000000694 effects Effects 0.000 abstract description 7
- 230000003044 adaptive effect Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 230000004044 response Effects 0.000 description 10
- 230000000903 blocking effect Effects 0.000 description 8
- 239000011159 matrix material Substances 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000000354 decomposition reaction Methods 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
Images
Landscapes
- Circuit For Audible Band Transducer (AREA)
Abstract
The application discloses a signal processing method, an electronic device and a storage device, wherein the method comprises the following steps: acquiring at least one first signal acquired by a signal acquisition device; decomposing the first signal into a plurality of first subband signals in the frequency domain; wherein the plurality of first subband signals have different center frequencies; respectively carrying out non-target signal elimination on the first sub-band signals to obtain second sub-band signals; wherein the second subband signal retains at least part of the non-target signal; respectively eliminating the target signals of the second sub-band signals to obtain third sub-band signals; synthesizing the corresponding second sub-band signal and the third sub-band signal to obtain a fourth sub-band signal; the plurality of fourth subband signals are synthesized to obtain a second signal. According to the scheme, mutual interference among the plurality of first sub-band signals during signal processing can be reduced, and the enhancement effect on the target signal in the second signal is improved.
Description
Technical Field
The present disclosure relates to the field of signal processing technologies, and in particular, to a signal processing method, an electronic device, and a storage device.
Background
With the continuous development of intelligent equipment and the more extensive application of human-computer interaction technology, the precision requirement for signal processing is gradually improved, and after the signal acquisition device acquires the signal, because an interference signal generally exists in the signal, namely a non-target signal exists, the signal needs to be processed to filter the non-target signal in the signal, so that the effect of enhancing the target signal in the signal is achieved.
In the conventional signal processing method, after a plurality of signals are obtained, short-time fourier transform is performed on each signal, and a long window length cannot be selected in consideration of signal delay when the short-time fourier transform is performed, so that the frequency spectrum leakage between frequency bands corresponding to each signal is relatively large, and further any subsequent filtering operation affects adjacent frequency bands, so that target signals of the adjacent frequency bands are also affected. In view of the above, how to improve the signal processing method is an urgent problem to be solved.
Disclosure of Invention
The technical problem mainly solved by the present application is to provide a signal processing method, an electronic device, and a storage device, which can decompose a first signal acquired by a signal acquisition device into a plurality of first subband signals in a frequency domain, and then synthesize the plurality of first subband signals after processing the plurality of first subband signals to obtain a second signal, thereby reducing mutual interference between the plurality of first subband signals during signal processing.
To solve the above technical problem, a first aspect of the present application provides a signal processing method, including: acquiring at least one first signal acquired by a signal acquisition device; decomposing the first signal into a plurality of first subband signals in the frequency domain; wherein the plurality of first subband signals have different center frequencies; respectively carrying out non-target signal elimination on the first sub-band signals to obtain second sub-band signals; wherein the second subband signal is reserved with at least part of non-target signals; respectively carrying out target signal elimination on the second sub-band signals to obtain third sub-band signals; synthesizing the corresponding second sub-band signal and the third sub-band signal to obtain a fourth sub-band signal; synthesizing a plurality of said fourth subband signals to obtain a second signal.
In order to solve the above technical problem, a second aspect of the present application provides an electronic device, which includes a memory and a processor, which are coupled to each other, wherein the memory stores program instructions, and the processor is configured to execute the program instructions to implement the signal processing method in the first aspect.
In order to solve the above technical problem, a third aspect of the present application provides a storage device, which stores program instructions capable of being executed by a processor, and the program instructions are used for implementing the signal processing method in the first aspect.
In the above scheme, at least one first signal acquired by the signal acquisition device is decomposed into a plurality of first subband signals with different center frequencies in a frequency domain, the first subband signals are respectively subjected to non-target signal elimination to obtain second subband signals retaining part of the non-target signals, then the second subband signals are subjected to target signal elimination to obtain third subband signals, the third subband signals are signals except the target signals in the second subband signals, the corresponding second subband signals and the corresponding third subband signals are synthesized to obtain fourth subband signals, and the plurality of fourth subband signals are synthesized to obtain second signals, so that the second signals mainly include the target signals. Therefore, the first signal is decomposed into the plurality of first subband signals, and the first subband signals are used as the unit for signal processing, so that the spectrum aliasing of the first subband signals on each frequency band is reduced, the mutual interference among the plurality of first subband signals during signal processing is reduced, and the enhancement effect on the target signal in the second signal is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein:
FIG. 1 is a schematic flow chart diagram illustrating an embodiment of a signal processing method according to the present application;
FIG. 2 is a diagram illustrating a corresponding first sub-band signal response curve in step S12 in FIG. 1;
FIG. 3 is a schematic flow chart diagram illustrating another embodiment of a signal processing method according to the present application;
FIG. 4 is a schematic diagram of a frame of the corresponding embodiment of FIG. 3;
FIG. 5 is a block diagram of an embodiment of an electronic device of the present application;
FIG. 6 is a block diagram of an embodiment of a memory device according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "system" and "network" are often used interchangeably herein. The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship. Further, the term "plurality" herein means two or more than two.
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a signal processing method according to an embodiment of the present application. Specifically, the method may include the steps of:
step S11: at least one first signal acquired by the signal acquisition device is acquired.
Specifically, the signal acquisition device has a preset position, and the signal acquisition device is used for acquiring signals within a preset range, wherein the preset range can be any angle from 0 to 360 degrees.
Further, if the signal acquisition device acquires a first signal, wherein the signal sent by the target signal source is a target signal, the first signal generally includes a non-target signal composed of the target signal and an interference signal, and the relative position of the signal acquisition device and the target signal source is acquired by measuring the position relationship between the position of the target signal source and the preset position of the signal acquisition device.
In one implementation scenario, the signal acquiring device is a microphone, and the microphone is configured to collect sound data, and after the microphone collects a first signal, the first signal may be sound data including a target signal and a part of an interference signal emitted by a user, where the user is a target signal source emitting the target signal, that is, a target sound source, and the interference signal in the sound data is noise, and a relative position between the target sound source and the microphone may be obtained by measuring a positional relationship between the target sound source and the microphone.
Step S12: the first signal is decomposed in the frequency domain into a plurality of first subband signals, wherein the plurality of first subband signals have different center frequencies.
Specifically, the first signal is decomposed in the frequency domain to obtain first subband signals corresponding to a plurality of frequency bands, and center frequencies of the plurality of first subband signals on corresponding response curves of the plurality of first subband signals are different from each other, and when the first signal is decomposed, if the first signal includes a target signal and a non-target signal, both the target signal and the non-target signal in the first signal are decomposed in the frequency domain.
In an implementation scenario, referring to fig. 2, fig. 2 is a schematic diagram of a response curve of the first subband signal corresponding to step S12 in fig. 1, after the first signal is decomposed into a plurality of first subband signals, center frequencies ω of the first subband signals are different on the response curve of the first subband signal corresponding to the plurality of frequency bands respectively0、ω1、ω2.., the response curve for the current center frequency is shifted in the frequency domain as compared to the response curve for the immediately preceding adjacent center frequency.
Step S13: respectively carrying out non-target signal elimination on the first subband signals to obtain second subband signals, wherein at least part of the non-target signals are reserved in the second subband signals.
Specifically, the first subband signals are filtered to filter at least part of non-target signals in the first subband signals to obtain second subband signals, and then preliminary filtering of the first subband signals is achieved to eliminate at least part of non-target signals.
In one implementation scenario, a corresponding reference beam filter is designed for the first subband signal, and a direction corresponding to the relative position of the signal acquisition device and the target signal source is set as a target direction, wherein the angle is theta0The target direction guide vector d of each frequency band is obtained based on the center frequency of each frequency bandm(θ0) And diffusion field coherence matrix ΓmThe reference beam filter w corresponding to the first subband signal in each frequency band is calculated with the following optimization and constraint conditionsm：
wm Hdm(θ0)＝1 (2)
Wherein σthrFor white noise gain lower limit constraint, when formula (2) and formula (3) are satisfied, the corresponding reference beam filter w is obtained when L (ω) in formula (1) is a maximum valuem。
It will be appreciated that the center frequency of each first subband signal is different, and therefore, the target direction steering vector d corresponding to different first subband signalsm(θ0) And diffusion field coherence matrix ΓmAlso different from each other, and the reference beam filter w obtained therebymRespectively corresponding to the first subband signal.
Further, due to the reference beam filter wmIn presence of a first subband signalThe corresponding relationship is then respectively utilized for the reference beam filter w corresponding to the first subband signalmThe non-target signals in the first sub-band signal can be filtered out with high precision.
Step S14: and respectively carrying out target signal elimination on the second sub-band signals to obtain third sub-band signals.
Specifically, the signal at the relative position of the signal acquisition device and the target signal source in the second subband signal is suppressed, and then the target signal in the second subband signal is eliminated, so as to obtain a third subband signal.
In one implementation scenario, the linear complement of the second subband signal is solved using matrix decomposition to obtain a third subband signal that is out of relative position.
In another implementation scenario, a blocking beam complementary to a spatial angle in the relative position direction is designed, wherein only signals in the relative position direction in the blocking beam are suppressed, gains in other directions except the relative position are all set to 1, and then the second subband signal is processed through the adaptive filter and the blocking beam to obtain a third subband signal from which the target signal is removed.
Step S15: the corresponding second and third subband signals are synthesized to obtain a fourth subband signal.
Specifically, the second subband signal includes a target signal at a relative position between the signal acquisition device and the target signal source, and a non-target signal outside the relative position. And the third subband signal is a non-target signal except for the relative position, and the third subband signal is used for canceling the non-target signal except for the relative position in the corresponding second subband signal respectively so as to obtain a plurality of fourth subband signals.
Step S16: the plurality of fourth subband signals are synthesized to obtain a second signal.
Specifically, the plurality of fourth subband signals are synthesized to splice the plurality of frequency bands, so as to obtain a second signal, where the second signal mainly includes a target signal at a relative position between the signal acquisition device and the target signal source.
It should be noted that, because the present embodiment decomposes the first signal in the frequency domain to obtain a plurality of first subband signals, frequency spectrum aliasing of the first subband signals is reduced, which is different from processing the signal in the full frequency domain, when filtering the signal in the full frequency domain, any filtering operation affects the adjacent frequency bands to cause nonlinear distortion, and the present embodiment effectively reduces the influence of filtering processing performed on the current frequency band on other frequency bands, and improves the precision of filtering out non-target signals, so that the second signal is enhanced compared with the mode of processing the signal in the full frequency domain.
In the above scheme, at least one first signal acquired by the signal acquisition device is decomposed into a plurality of first subband signals with different center frequencies in a frequency domain, the first subband signals are respectively subjected to non-target signal elimination to obtain second subband signals retaining part of the non-target signals, then the second subband signals are subjected to target signal elimination to obtain third subband signals, the third subband signals are signals except the target signals in the second subband signals, the corresponding second subband signals and the corresponding third subband signals are synthesized to obtain fourth subband signals, and the plurality of fourth subband signals are synthesized to obtain second signals, so that the second signals mainly include the target signals. Therefore, the first signal is decomposed into the plurality of first subband signals, and the first subband signals are used as the unit for signal processing, so that the spectrum aliasing of the first subband signals on each frequency band is reduced, the mutual interference among the plurality of first subband signals during signal processing is reduced, and the enhancement effect on the target signal in the second signal is improved.
Referring to fig. 3, fig. 3 is a schematic flow chart of a signal processing method according to another embodiment of the present application. Specifically, the method may include the steps of:
step S31: at least one first signal acquired by the signal acquisition device is acquired.
Specifically, the signal acquiring device may include a plurality of signal acquiring units, and the step S31 specifically includes: a plurality of first signals acquired by a plurality of signal acquisition units are acquired.
In an implementation scene, in response to the plurality of first signals acquired by the plurality of signal acquisition units, the position relationship between the target signal source and the central position of the signal acquisition device is acquired, so as to acquire the relative position between the signal acquisition device and the target signal source, thereby improving the efficiency of processing the signals.
In another implementation scenario, in response to the plurality of first signals acquired by the plurality of signal acquisition units, the position relationships between the signal acquisition units and the target signal source are respectively acquired, so as to obtain a first average value of angles between the plurality of signal acquisition units and the target signal source, and the relative position between the signal acquisition device and the target signal source is generated based on the first average value, so as to improve the precision of the relative position.
Step S32: the first signal is decomposed in the frequency domain into a plurality of first subband signals, wherein the plurality of first subband signals have different center frequencies.
The first signal is sub-band decomposed to decompose the first signal into a plurality of first sub-band signals in a frequency domain.
Specifically, the method may include: carrying out frequency spectrum shifting on a preset low-pass filter; the first signal is filtered by a plurality of frequency shifted low pass filters. The first signal may be decomposed in the frequency domain through the above process to obtain a plurality of first subband signals, so that the first subband signals are separated in the frequency domain. The above process is embodied as follows using equation (4):
wherein x isi(t) is the first signal, hproto(t) is a preset low-pass filter, and when the value of m changes, the preset low-pass filter is subjected to spectrum shifting according to the intermediate frequency interval extraction mode, that is, the formula (4) is
To obtain the mth decimation filter. The preset low-pass filter can be any one of a Butterworth filter, a Chebyshev filter, an elliptic function filter and a linear phase filter, and the preset low-pass filter respectively corresponds to the situations that the flatness is the most in a pass band, constant-amplitude ripple fluctuation exists in the pass band, constant-amplitude ripple fluctuation exists in both the pass band and a stop band, and 4 responses exist in the linear phase in the pass band.
Further, the first signal is filtered by a plurality of decimation filters to obtain a plurality of first subband signals, wherein the difference between the center frequencies of adjacent first subband signals is equal and is a preset value ω0The center frequency of the mth first subband signal is m omega0Spectral aliasing between the first subband signals in the frequency band is reduced by decomposing the first signal in the frequency domain by a decimation filter to decompose the first signal into a plurality of first subband signals completely and orderly.
Step S33: and downsampling the plurality of first subband signals, wherein the sampling interval of downsampling is less than or equal to the number of the plurality of first subband signals.
Specifically, the first subband signals are respectively down-sampled to reduce the influence of signal redundancy and further reduce the amount of computation to improve the efficiency of signal processing. The above step S33 is embodied as follows using the formula (5):
xi，m(n)＝xi，m(t)|t＝n*D，n＝0，1，2... (5)
and the sampling interval of the down-sampling is D, the sampling interval D is smaller than the number of the plurality of first sub-band signals, the number of the sampling points is n, the value of n is related to the signal attenuation of the first sub-band signals, and the down-sampling is carried out on the first sub-band signals until the signals are attenuated until no sampling points exist.
In an implementation scenario, the sampling interval is half of the number of the first subband signals, so that the interval between the sampling points is kept at a reasonable interval, which can not only feed back the characteristics of the first subband signals, but also greatly reduce the computation amount.
In another implementation scenario, the sampling interval is equal to the number of the first subband signals, so as to enlarge the interval between the sampling points, and the operation amount is reduced as much as possible on the basis of the feedback of the characteristics of the first subband signals.
Step S34: and respectively carrying out non-target signal elimination on the first subband signals to obtain second subband signals. Wherein the second subband signal is reserved with at least part of the non-target signal.
Specifically, the method may include: and carrying out non-target signal elimination on the first sub-band signal after down sampling. After the first sub-band signal is down-sampled, non-target signal elimination is carried out on the first sub-band signal, namely non-target signal elimination is carried out on the signal corresponding to the sampling point, and therefore processing efficiency is improved.
Further, the non-target signal elimination is performed on the first subband signal by using the reference beam filter corresponding to the first subband signal, wherein the reference beam filter may refer to the step S13, and is not described herein again. The above process is embodied as follows using equation (6):
yF，m(n)＝wm Txm(n) (6)
wherein x ism(n) is a signal matrix, x, corresponding to a plurality of first subband signalsm(n) specifically includes xm(n)＝[x0，m(n)，...xI-1，m(n)]TAnd the reference beam filter performs primary filtering on the non-target signals in all directions to eliminate most of interference signals at the relative positions of the signal acquisition device and the target signal source, so that the target signals in the relative position directions are closer to original signals sent by the target signal source, meanwhile, the reference beam filter performs primary filtering on the non-target signals outside the relative positions to eliminate partial non-target signals to obtain second sub-band signals, and partial non-target signals still remain in the second sub-band signals.
Step S35: and respectively carrying out target signal elimination on the second sub-band signals to obtain third sub-band signals.
Specifically, when the second subband signal still contains a non-target signal except for a part of relative positions, in order to obtain a purer target signal, the target signal in the second subband signal is theoretically eliminated first to obtain a third subband signal, and then the third subband signal is used to cancel out a part of signals in the second subband signal, so that the purer target signal can be obtained.
In one implementation scenario, a blocking beam is designed, in which only the signals at the above-mentioned relative positions are suppressed, i.e. the blocking beam is used to suppress the target signal. And processing the second subband signals by using the adaptive filter corresponding to each second subband signal and the blocking beam. And when any second subband signal comprises the target signal, fixing the parameters of the adaptive filter corresponding to the corresponding second subband signal. When any second subband signal does not include the target signal, the adaptive filter corresponding to the corresponding second subband signal is adaptively adjusted so as to more accurately track the non-target signal.
Specifically, the process of processing the second subband signal by using the adaptive filter corresponding to each second subband signal and the blocking beam is specifically expressed by the following formula (7):
yB，m(n)＝am TBm Txm(n) (7)
wherein, yB，m(n) is a third subband signal, amFor each second subband signal, BmTo block the beam, xmAnd (n) is a signal matrix corresponding to the plurality of second subband signals. Using an adaptive filter a for each second subband signalmAnd block beam BmProcessing the second subband signals respectively to obtain a plurality of third subband signals, wherein the beam B is blocked due to the target signal in the second subband signalsmThe third subband signal is suppressed and therefore comprises only non-target signals.
Further, when any one of the second subband signals does not include the target signal, the process of updating the adaptive filter corresponding to the corresponding second subband signal is specifically expressed as follows by using formula (8):
wm Txm(n)-am TBm Txm(n)→0 (8)
when the second sub-band signal does not include the target signal, in order to improve the precision of tracking the non-target signal, the adaptive filter a is usedmAdaptive adjustment is performed to make the second subband signal wm Txm(n) and a third subband signal am TBm Txm(n) the signal obtained after the superposition tends to be zero.
Step S36: the corresponding second and third subband signals are synthesized to obtain a fourth subband signal.
Specifically, the third subband signal is utilized to cancel part of the signals in the corresponding second subband signal, so as to obtain a fourth subband signal, and the fourth subband signal basically only includes the target signal of the corresponding first subband signal at the sampling point. The above process is embodied as follows using equation (9):
ym(n)＝yF，m(n)-yB，m(n) (9)
wherein, ym(n) is the fourth subband signal, yF，m(n) is the second subband signal obtained in equation (6), yB，m(n) is the third subband signal obtained in equation (7), and the third subband signal is inversely superimposed on the corresponding second subband signal to obtain a corresponding fourth subband signal.
It should be noted that, in the step S35, the adaptive filter corresponding to the corresponding second subband signal is updated, that is, the adaptive adjustment is performed on the third subband signal.
Specifically, the direction corresponding to the relative position of the signal acquisition device and the target signal source is set as the target direction, and when the signal acquisition device receives the signal of the target signal source, most of the first signals are concentrated in the target direction, that is, most of the first signals are the target signals.
Further, for a first subband signal obtained by decomposition and a second subband signal obtained by processing the first subband signal, if the first subband signal and the second subband signal include a target signal, most of signals are concentrated in a target direction, and if a frequency band corresponding to the first subband signal does not have the target signal, the corresponding second subband signal does not have the target signal.
Specifically, the second subband signal is processed by using an adaptive filter and a blocking beam corresponding to the second subband signal to obtain a third subband signal, the coincidence degree of the second subband signal and the third subband signal is compared, if the second subband signal includes a target signal, the coincidence degree of the second subband signal and the third subband signal is very low due to the fact that the target signal is suppressed, if the second subband signal does not include the target signal, the coincidence degree of the second subband signal and the third subband signal is very high, and when the coincidence degree of the second subband signal and the third subband signal reaches more than 90%, it is determined that the second subband signal does not include the target signal.
Further, in response to that the second subband signal does not include the target signal, the step of performing target signal cancellation on the second subband signal respectively further includes: the third subband signal is adaptively adjusted such that the fourth subband signal tends to zero in the absence of the target signal from the first subband signal.
Specifically, referring to the above equation (8), when the second subband signal does not include the target signal, the adaptive filter a is applied to improve the accuracy of tracking the non-target signalmPerforming adaptive updating to make the fourth subband signal obtained after the second subband signal and the third subband signal are superposed tend to be zero, so that when the second subband signal does not include the target signal, the adaptive filter amThe tracking effect on the non-target signals is optimal.
Furthermore, the second sub-band signals are obtained after being decomposed in the frequency domain, the frequency bands of the adaptive filters corresponding to the plurality of second sub-band signals are separated from each other during updating, interference between the frequency bands is reduced, the adaptive filters corresponding to the second sub-band signals do not need to be updated and stopped uniformly for all the frequency bands, updating is stopped only when a target signal exists in the current second sub-band signal, and if no target signal exists in other second sub-band signals, updating can be performed, so that non-target signals can be tracked more quickly, and the capability of suppressing the non-target signals is enhanced.
Step S37: and setting the fourth sub-band signals corresponding to other first sub-band signals except the sampling point to be zero.
Specifically, when the first subband signal is downsampled in step S33, and the fourth subband signal corresponding to the first subband signal except the sampling point is set to zero before the fourth subband signal is synthesized, so as to ensure the integrity of the entire first subband signal, the above process is expressed as follows by using equation (10):
and the fourth sub-band signal on the sampling point t ≠ n × D is obtained by superposing the second sub-band signal and the third sub-band signal in the formula (9), t ≠ n × D outside the sampling point, and the fourth sub-band signal is set to be 0 so as to obtain the fourth sub-band signals of all the sampling points and ensure the integrity of the corresponding first sub-band signal.
Step S38: the plurality of fourth subband signals are synthesized to obtain a second signal.
Specifically, the method may include: and filtering the corresponding fourth sub-band signals by utilizing the low-pass filters with shifted frequencies to further obtain second signals. The above process is embodied as follows using equation (11):
wherein,
like the decimation filter corresponding to each first sub-band signal in equation 4, in step S37, the fourth sub-band signals corresponding to other first sub-band signals except the sampling point are set to be zero, and when the fourth sub-band signal corresponding to the first sub-band signal is obtained, the fourth sub-band signals except the sampling point may have mirror-image interference signals, so that the corresponding fourth sub-band signals are filtered by the low-pass filters after shifting the frequencies again, and the obtained fourth sub-band signals are synthesized to obtain the second signal, thereby reducing the distortion of the target signal in the second signal and improving the accuracy of the second signal.
Further, referring to fig. 4, fig. 4 is a schematic diagram of a framework corresponding to fig. 3 in an embodiment, where the signal acquisition device includes a plurality of signal acquisition units, and when a plurality of first signals acquired by the plurality of signal acquisition units are acquired, the plurality of first signals need to be decomposed respectively, each first signal corresponds to a plurality of first sub-band signals, and the first sub-band signals are grouped according to respective frequency bands, so as to process the first sub-band signals on the same frequency band.
In one implementation scenario, the signal acquisition device includes a plurality of signal acquisition units arranged in an array. Wherein the step of decomposing the first signal into a plurality of first subband signals in the frequency domain comprises: and respectively decomposing the first signals corresponding to the plurality of signal acquisition units into a plurality of first sub-band signals.
Specifically, referring to fig. 3 and fig. 4, when I first signals are acquired, the I first signals are decomposed into M first subband signals, the M first subband signals corresponding to each first signal are classified according to corresponding frequency bands to obtain I first subband signals corresponding to each frequency band, and then each first subband signal is downsampled.
Further, before the step of performing non-target signal cancellation on the first subband signals, respectively, the method further includes: and synthesizing a plurality of first sub-band signals with the same center frequency in the plurality of first signals into one first sub-band signal.
Specifically, after the first subband signal corresponding to each frequency band is classified into the corresponding subband, the first subband signal on each frequency band is synthesized to obtain the synthesized first subband signal corresponding to each frequency band, and then step S34 in fig. 3 is performed to complete the subsequent steps in fig. 3, and then the second signal y (t) is obtained.
It can be understood that, after the first subband signal corresponding to each frequency band is obtained, the first subband signal is synthesized and then subjected to subsequent processing, which is beneficial to greatly reducing the computation amount and improving the efficiency of signal processing in an application scenario with relatively low requirement on the accuracy of signal processing.
In another implementation scenario, the signal acquisition device includes a plurality of signal acquisition units arranged in an array. Wherein the step of decomposing the first signal into a plurality of first subband signals in the frequency domain comprises: and respectively decomposing the first signals corresponding to the plurality of signal acquisition units into a plurality of first sub-band signals.
Specifically, referring to fig. 3 and fig. 4, when I first signals are acquired, the I first signals are decomposed into M first subband signals, the M first subband signals corresponding to each first signal are classified according to corresponding frequency bands to obtain I first subband signals corresponding to each frequency band, and then each first subband signal is downsampled.
Further, the step of respectively performing non-target signal cancellation on the first subband signals in fig. 3 includes: and respectively carrying out non-target signal elimination on the first sub-band signals decomposed by the plurality of first signals.
Specifically, the non-target signal cancellation is performed on the first subband signal corresponding to each frequency band, and then the subsequent steps in fig. 3 are performed to process the first subband signal respectively.
Further, the step of synthesizing the plurality of fourth subband signals comprises: and synthesizing the fourth sub-band signals corresponding to the plurality of first signals.
Specifically, before outputting the corresponding fourth sub-band signal on each frequency band, a plurality of fourth sub-band signals obtained after processing in the frequency band are processedIs synthesized to obtain a synthesized fourth subband signal ym(t), where M is 0, 1, 2.. M-1, that is, the corresponding first subband signals on each frequency band are respectively processed, and then after a plurality of fourth subband signals are obtained, the plurality of fourth subband signals on each frequency band are synthesized to obtain synthesized fourth subband signals, and then the M fourth subband signals are synthesized to obtain the second signal y (t).
It can be understood that, after the first sub-band signal corresponding to each frequency band is obtained, the first sub-band signal corresponding to each frequency band is processed respectively to obtain a plurality of fourth sub-band signals, and the fourth sub-band signal corresponding to each frequency band is synthesized, which is beneficial to improving the precision of signal processing in an application scenario with a high precision requirement of signal processing, so that a target signal in the second signal is more pure.
In one implementation scenario, the signal acquisition device is a microphone array that includes a plurality of microphones arranged in an array. After first signals collected by a plurality of microphones are acquired, the first signals are processed in any one of the implementation scenarios, where the first signals are sound data, the target signal source is a target sound source, and the target signal is target sound source data. And correspondingly processing the first signal to obtain a second signal, and further enhancing a target signal in the first signal so that the second signal mainly comprises target sound data corresponding to a target sound source.
Referring to fig. 5, fig. 5 is a schematic diagram of a frame of an embodiment of an electronic device according to the present application. The electronic device 50 comprises a memory 51 and a processor 52 coupled to each other, the memory 51 stores program instructions, and the processor 52 is configured to execute the program instructions to implement the steps in any of the signal processing method embodiments described above.
In particular, the processor 52 is configured to control itself and the memory 51 to implement the steps in any of the above-described embodiments of the signal processing method. Processor 52 may also be referred to as a CPU (Central Processing Unit). Processor 52 may be an integrated circuit chip having signal processing capabilities. The Processor 52 may also be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. In addition, processor 52 may be commonly implemented by a plurality of integrated circuit chips.
In this embodiment, the processor 52 is configured to obtain at least one first signal collected by the signal collecting device; the processor 52 decomposes the first signal into a plurality of first subband signals in the frequency domain; wherein the plurality of first subband signals have different center frequencies; the processor 52 performs non-target signal cancellation on the first subband signals, respectively, to obtain second subband signals; wherein the second subband signal retains at least part of the non-target signal; the processor 52 performs target signal cancellation on the second subband signals, respectively, to obtain third subband signals; the processor 52 synthesizes the corresponding second and third sub-band signals to obtain a fourth sub-band signal; the processor 52 synthesizes the plurality of fourth subband signals to obtain the second signal.
In the above scheme, at least one first signal acquired by the signal acquisition device is decomposed into a plurality of first subband signals with different center frequencies in a frequency domain, the first subband signals are respectively subjected to non-target signal elimination to obtain second subband signals retaining part of the non-target signals, then the second subband signals are subjected to target signal elimination to obtain third subband signals, the third subband signals are signals except the target signals in the second subband signals, the corresponding second subband signals and the corresponding third subband signals are synthesized to obtain fourth subband signals, and the plurality of fourth subband signals are synthesized to obtain second signals, so that the second signals mainly include the target signals. Therefore, the first signal is decomposed into the plurality of first subband signals, and the first subband signals are used as the unit for signal processing, so that the spectrum aliasing of the first subband signals on each frequency band is reduced, the mutual interference among the plurality of first subband signals during signal processing is reduced, and the enhancement effect on the target signal in the second signal is improved.
In some embodiments, processor 52 is configured to perform a spectral shift on a predetermined low pass filter; the processor 52 is configured to filter the first signal by using a plurality of frequency shifted low pass filters.
Different from the foregoing embodiment, the predetermined low-pass filter is shifted to obtain the decimation filters corresponding to different frequency bands, and the first signal is completely and orderly decomposed into a plurality of first subband signals by the decimation filters, thereby reducing the aliasing of the frequency spectrum between the first subband signals on the frequency band.
In some embodiments, the processor 52 is configured to filter the corresponding fourth subband signals by using a plurality of frequency shifted low pass filters.
Different from the foregoing embodiment, the plurality of frequency-shifted low-pass filters are used to filter the corresponding fourth subband signals, and then the obtained fourth subband signals are synthesized to obtain the second signal, so that the distortion of the target signal in the second signal is reduced.
In some embodiments, the processor 52 is configured to down-sample the plurality of first subband signals; wherein a sampling interval of the downsampling is less than or equal to a number of the plurality of first subband signals; the processor 52 is configured to perform non-target signal cancellation on the down-sampled first subband signal.
Different from the foregoing embodiment, the first subband signal is downsampled, so that the sampled first subband signal can not only feed back the characteristics of the first subband signal, but also reduce the amount of computation, and improve the efficiency of signal processing.
In some embodiments, the processor 52 is configured to set the fourth subband signal corresponding to the first subband signal other than the sample point to zero.
Different from the foregoing embodiment, the fourth subband signal corresponding to the other first subband signal except the sampling point is set to be zero, so as to ensure the integrity of the whole first subband signal and improve the accuracy of the signal.
In some embodiments, the processor 52 is configured to adaptively adjust the third subband signal such that the fourth subband signal tends to zero in the absence of the target signal from the first subband signal.
Different from the foregoing embodiment, since the first signal is decomposed in the frequency domain, the frequency bands corresponding to the processed second sub-band signal are separated from each other, so that interference between the frequency bands is reduced, the adaptive adjustment of the third sub-band signal does not require uniform update and stop of all the frequency bands, the adaptive adjustment of the third sub-band signal corresponding to each frequency band can be performed, and thus the non-target signal can be tracked more quickly, and the capability of suppressing the non-target signal is enhanced.
In some embodiments, the signal acquisition device comprises a plurality of signal acquisition units arranged in an array; the processor 52 is configured to decompose the first signals corresponding to the plurality of signal acquisition units into a plurality of first subband signals, respectively; the processor 52 is configured to combine a plurality of first subband signals having the same center frequency in the plurality of first signals into one first subband signal.
Different from the foregoing embodiment, the first subband signal is synthesized and then is subsequently processed, which is beneficial to greatly reducing the amount of computation and improving the efficiency of signal processing, and has the advantage of faster processing speed in a scene with relatively low requirement on signal processing precision.
In some embodiments, the signal acquisition device comprises a plurality of signal acquisition units arranged in an array; the processor 52 is configured to decompose the first signals corresponding to the plurality of signal acquisition units into a plurality of first subband signals, respectively; the processor 52 is configured to perform non-target signal cancellation on the first subband signals into which the plurality of first signals are decomposed, respectively; the processor 52 is configured to synthesize the fourth subband signals corresponding to the plurality of first signals.
Different from the foregoing embodiment, the plurality of first subband signals corresponding to the same frequency band are respectively processed to obtain a plurality of fourth subband signals, and then the plurality of fourth subband signals corresponding to the same frequency band are synthesized to obtain a synthesized fourth subband signal, and then the synthesized fourth subband signal is synthesized to obtain a second signal, so that the target signal in the second signal is purer, and the method is suitable for an application scenario with a higher requirement on the precision of signal processing.
Referring to fig. 6, fig. 6 is a schematic diagram of a memory device according to an embodiment of the present application. The memory device 60 stores program instructions 600 capable of being executed by the processor, the program instructions 600 being for implementing the steps in any of the signal processing method embodiments described above.
By the scheme, mutual interference among the first sub-band signals can be reduced, and the enhancement effect on the target signal in the second signal is improved.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some interfaces, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Claims (10)
1. A method of signal processing, the method comprising:
acquiring at least one first signal acquired by a signal acquisition device;
decomposing the first signal into a plurality of first subband signals in the frequency domain; wherein the plurality of first subband signals have different center frequencies;
respectively carrying out non-target signal elimination on the first sub-band signals to obtain second sub-band signals; wherein the second subband signal is reserved with at least part of non-target signals;
respectively carrying out target signal elimination on the second sub-band signals to obtain third sub-band signals;
synthesizing the corresponding second sub-band signal and the third sub-band signal to obtain a fourth sub-band signal;
synthesizing a plurality of said fourth subband signals to obtain a second signal.
2. The method of claim 1, wherein the step of decomposing the first signal into a plurality of first subband signals in the frequency domain comprises:
carrying out frequency spectrum shifting on a preset low-pass filter;
and filtering the first signal by using the low-pass filters with shifted frequencies respectively.
3. The method according to claim 2, wherein said step of synthesizing a plurality of said fourth subband signals comprises:
and filtering the corresponding fourth sub-band signals by using the plurality of frequency-shifted low-pass filters.
4. The method of claim 1, wherein the step of performing non-target signal cancellation on the first subband signals respectively further comprises:
down-sampling the plurality of first subband signals; wherein a sampling interval of the downsampling is less than or equal to a number of the plurality of first subband signals;
the step of performing non-target signal cancellation on the first subband signals respectively comprises:
and carrying out non-target signal elimination on the first sub-band signal after down sampling.
5. The method of claim 4, wherein the step of synthesizing the plurality of fourth subband signals is preceded by the step of:
and setting the fourth sub-band signals corresponding to the first sub-band signals except the sampling points to be zero.
6. The method of claim 1, wherein the step of performing target signal cancellation on the second subband signals respectively comprises:
adaptively adjusting the third subband signal such that the fourth subband signal tends to be zero in the absence of the target signal from the first subband signal.
7. The method of claim 1, wherein the signal acquisition device comprises a plurality of signal acquisition units arranged in an array;
the step of decomposing the first signal into a plurality of first subband signals in the frequency domain comprises:
decomposing the first signals corresponding to the plurality of signal acquisition units into a plurality of first sub-band signals respectively;
before the step of performing non-target signal cancellation on the first subband signals respectively, the method further includes:
and synthesizing a plurality of first sub-band signals with the same center frequency in a plurality of first signals into one first sub-band signal.
8. The method of claim 1, wherein the signal acquisition device comprises a plurality of signal acquisition units arranged in an array;
the step of decomposing the first signal into a plurality of first subband signals in the frequency domain comprises:
decomposing the first signals corresponding to the plurality of signal acquisition units into a plurality of first sub-band signals respectively;
the step of performing non-target signal cancellation on the first subband signals respectively comprises:
performing non-target signal cancellation on the first subband signals into which the plurality of first signals are decomposed, respectively;
said step of synthesizing a plurality of said fourth subband signals comprises:
and synthesizing the fourth sub-band signals corresponding to the plurality of first signals.
9. An electronic device, comprising a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is configured to execute the program instructions to implement the signal processing method according to any one of claims 1 to 8.
10. A storage device, characterized by program instructions executable by a processor for implementing the signal processing method of any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011615064.4A CN112669871A (en) | 2020-12-30 | 2020-12-30 | Signal processing method, electronic device and storage device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011615064.4A CN112669871A (en) | 2020-12-30 | 2020-12-30 | Signal processing method, electronic device and storage device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112669871A true CN112669871A (en) | 2021-04-16 |
Family
ID=75411386
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011615064.4A Pending CN112669871A (en) | 2020-12-30 | 2020-12-30 | Signal processing method, electronic device and storage device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112669871A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114513215A (en) * | 2022-02-18 | 2022-05-17 | 维沃移动通信有限公司 | Signal processing method of electronic equipment and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1719516A (en) * | 2005-07-15 | 2006-01-11 | 北京中星微电子有限公司 | Adaptive filter device and adaptive filtering method |
| CN1741411A (en) * | 2004-08-27 | 2006-03-01 | 华为技术有限公司 | Information channel estimating method and system in radio communication |
| CN101227537A (en) * | 2007-01-19 | 2008-07-23 | 中兴通讯股份有限公司 | Broadband acoustics echo eliminating method |
| CN102831898A (en) * | 2012-08-31 | 2012-12-19 | 厦门大学 | Microphone array voice enhancement device with sound source direction tracking function and method thereof |
| CN107316649A (en) * | 2017-05-15 | 2017-11-03 | 百度在线网络技术（北京）有限公司 | Audio recognition method and device based on artificial intelligence |
| CN107749305A (en) * | 2017-09-29 | 2018-03-02 | 百度在线网络技术（北京）有限公司 | Method of speech processing and its device |
| CN110689900A (en) * | 2019-09-29 | 2020-01-14 | 北京地平线机器人技术研发有限公司 | Signal enhancement method and device, computer readable storage medium and electronic equipment |
| CN111128218A (en) * | 2019-12-31 | 2020-05-08 | 恒玄科技(上海)股份有限公司 | Echo cancellation method and device |
-
2020
- 2020-12-30 CN CN202011615064.4A patent/CN112669871A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1741411A (en) * | 2004-08-27 | 2006-03-01 | 华为技术有限公司 | Information channel estimating method and system in radio communication |
| CN1719516A (en) * | 2005-07-15 | 2006-01-11 | 北京中星微电子有限公司 | Adaptive filter device and adaptive filtering method |
| CN101227537A (en) * | 2007-01-19 | 2008-07-23 | 中兴通讯股份有限公司 | Broadband acoustics echo eliminating method |
| CN102831898A (en) * | 2012-08-31 | 2012-12-19 | 厦门大学 | Microphone array voice enhancement device with sound source direction tracking function and method thereof |
| CN107316649A (en) * | 2017-05-15 | 2017-11-03 | 百度在线网络技术（北京）有限公司 | Audio recognition method and device based on artificial intelligence |
| CN107749305A (en) * | 2017-09-29 | 2018-03-02 | 百度在线网络技术（北京）有限公司 | Method of speech processing and its device |
| CN110689900A (en) * | 2019-09-29 | 2020-01-14 | 北京地平线机器人技术研发有限公司 | Signal enhancement method and device, computer readable storage medium and electronic equipment |
| CN111128218A (en) * | 2019-12-31 | 2020-05-08 | 恒玄科技(上海)股份有限公司 | Echo cancellation method and device |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114513215A (en) * | 2022-02-18 | 2022-05-17 | 维沃移动通信有限公司 | Signal processing method of electronic equipment and electronic equipment |
| CN114513215B (en) * | 2022-02-18 | 2023-12-01 | 维沃移动通信有限公司 | Signal processing method of electronic equipment and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8934641B2 (en) | Systems and methods for reconstructing decomposed audio signals | |
| US9754597B2 (en) | Alias-free subband processing | |
| DE69208234T2 (en) | Noise reduction microphone | |
| EP0086943B1 (en) | Adaptive spectrum shaping filter | |
| EP2124334B1 (en) | Filter bank system for hearing aids | |
| EP2608197A1 (en) | Method, device, and system for noise reduction in multi-microphone array | |
| DE102009034264A1 (en) | Apparatus for processing a sound signal and method for processing a sound signal | |
| AU2017208909A1 (en) | Subband spatial and crosstalk cancellation for audio reproduction | |
| US8295508B2 (en) | Processing an audio signal | |
| US11689855B2 (en) | Crosstalk cancellation for opposite-facing transaural loudspeaker systems | |
| US20130287226A1 (en) | Reduced-delay subband signal processing system and method | |
| US8150081B2 (en) | Method for optimizing a multilevel filter bank and corresponding filter bank and hearing apparatus | |
| CN112669871A (en) | Signal processing method, electronic device and storage device | |
| DE102018117558A1 (en) | ADAPTIVE AFTER-FILTERING | |
| JP2003501963A (en) | Symmetric subband acoustic echo cancellation | |
| EP1995993B1 (en) | Sound image localizer | |
| US20230051509A1 (en) | Method and system for implementing a modal processor | |
| US9445195B2 (en) | Directivity control method and device | |
| US10825443B2 (en) | Method and system for implementing a modal processor | |
| US20070036458A1 (en) | Digital signal processing apparatus and digital signal processing program | |
| JPH0934494A (en) | Voice signal processing circuit | |
| CN111585548B (en) | Clock crosstalk elimination circuit and electronic equipment | |
| JP3879559B2 (en) | Stereo microphone device | |
| CN116320851A (en) | Microphone array noise reduction method, device and system, electronic equipment and storage medium | |
| JP2006245668A (en) | Band-pass filter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |